I’m thinking you might have been wrong. Even without AI, I don’t foresee demand for compute going down. Even if everything went over to ARM, I think that would have just slowed the rate of new builds.
Working for a fairly large open source project and we began testing arm hardware for in house use and it was ridiculous how much compute we could fit in the same U space.
We were doing nothing with GPU though, so CPU and memory speed was our bottleneck.
We were definitely more compute dense with our arm cluster but we couldn’t get as large. Yet. Maybe it’s changed now
I’m thinking you might have been wrong. Even without AI, I don’t foresee demand for compute going down. Even if everything went over to ARM, I think that would have just slowed the rate of new builds.
Working for a fairly large open source project and we began testing arm hardware for in house use and it was ridiculous how much compute we could fit in the same U space.
We were doing nothing with GPU though, so CPU and memory speed was our bottleneck.
We were definitely more compute dense with our arm cluster but we couldn’t get as large. Yet. Maybe it’s changed now