Sam Altman says it’s better for RAM to be in a data center than on your desk
TL;DR
Asked about supply chain shortages, like the ongoing RAM shortage, OpenAI CEO Sam Altman said in an interview that it's "terrible" to have RAM in personal PCs instead of data centers. During his appearance on the Cheeky Pint podcast, where he also commented on AI's impact on math, Altman said: "A lot of people want local inference.
Nauti's Take
For small teams, this is a useful checkpoint when evaluating local AI setups: which models will actually run on-device every day, and how much memory will each user require? Before buying high-end workstations, compare real monthly usage, privacy requirements, and centralized API costs over a representative workflow.
Altman’s view reflects a cloud provider’s perspective, so it should be tested against workload data rather than treated as a complete market analysis.
Summary
Asked about supply chain shortages, like the ongoing RAM shortage, OpenAI CEO Sam Altman said in an interview that it's "terrible" to have RAM in personal PCs instead of data centers. During his appearance on the Cheeky Pint podcast, where he also commented on AI's impact on math, Altman said: "A lot of people want local inference.
And somehow, they assume that the problem is solved now because we are going to have open-source models, we're going to be able to run them on our computers, and so we're not going to need all the stuff in the data center.
Video
Sources
