A few years ago with ARM arriving at the data centers I envisioned there would be a day that density would go up and new data centers would be less in demand. I’m either too early or wrong.
In economics, the Jevons paradox, or Jevons effect, is said to occur when technological improvements that increase the efficiency of a resource’s use lead to a rise, rather than a fall, in total consumption of that resource.
Unfortunately using less of a good thing isn’t how we do things.
I’m thinking you might have been wrong. Even without AI, I don’t foresee demand for compute going down. Even if everything went over to ARM, I think that would have just slowed the rate of new builds.
Working for a fairly large open source project and we began testing arm hardware for in house use and it was ridiculous how much compute we could fit in the same U space.
We were doing nothing with GPU though, so CPU and memory speed was our bottleneck.
We were definitely more compute dense with our arm cluster but we couldn’t get as large. Yet. Maybe it’s changed now
A few years ago with ARM arriving at the data centers I envisioned there would be a day that density would go up and new data centers would be less in demand. I’m either too early or wrong.
Unfortunately using less of a good thing isn’t how we do things.
Also known as induced demand. Most of a thing drives more demand for that thing.
I’m thinking you might have been wrong. Even without AI, I don’t foresee demand for compute going down. Even if everything went over to ARM, I think that would have just slowed the rate of new builds.
Working for a fairly large open source project and we began testing arm hardware for in house use and it was ridiculous how much compute we could fit in the same U space.
We were doing nothing with GPU though, so CPU and memory speed was our bottleneck.
We were definitely more compute dense with our arm cluster but we couldn’t get as large. Yet. Maybe it’s changed now