• 0 Posts
  • 6 Comments
Joined 3 years ago
cake
Cake day: August 25th, 2023

help-circle


  • also for the environment, I would think. It saves a ton of useless traffic

    GPT is worse and it’s not even close.

    My PC can serve up a hundred requests per second running an HTTP server with a connected database with 200W power usage

    It takes that same computer 30-60s to return a response from a 13B parameter model (WAY less power usage than GPT), while using 400W of power thanks to the GPU

    Napkin math, the AI response uses about 10,000x more electricity


  • A server produces an amount of heat equivalent to it’s wattage.

    A 500W server rack will produce 1/3rd the amount of heat as a 1500W space heater. If your rack draws 100W at idle, than that’s how much heat it produces. So if it’s cold outside you could spin up folding at home or some other thing to burn excess CPU cycles

    As long as your server is inside your house it is offsetting the amount of heat your HVAC system needs to produce - granted it is also greatly increasing the amount of work your AC needs to do in the summer

    There is a cricket farm in Quebec that heats it’s enclosures with Bitcoin mining rigs.