get_flat_ccs_offset() reads the base of the flat CCS storage from the
hardware, scales it by the number of enabled L3 nodes, and rounds the
result up to 128K. Everything below that offset is then ...
They are not magic. You are still using electricity, and for the same amount of work that cloud providers do you will consume the same amount. If every one of the billions of people using chatgpt or whatever buys rtx 5090 and makes it churn 24/7 for their “local” ai then nothing will change for the environment.
use Local LLMS ;)
They are not magic. You are still using electricity, and for the same amount of work that cloud providers do you will consume the same amount. If every one of the billions of people using chatgpt or whatever buys rtx 5090 and makes it churn 24/7 for their “local” ai then nothing will change for the environment.
But isn’t it as bad as running a graphically intensive AAA game on your computer
That’s still just moving the impact from data centers to end users’ machines.
Gamers (especially those that own 5090) are a tiny minority compared to llm users.