Global AI computing will use ‘multiple NYCs’ worth of power by 2026, says founder [Video]

Nvidia and its partners and customers have steadily built larger and larger computer facilities around the world to handle the compute-intensive needs of training giant artificial intelligence (AI) programs such as GPT-4. That effort will gain continued importance as more AI models are put into production, says one startup serving the tech giants.

“People will want more compute, not necessarily because of scaling laws, but because you’re deploying these things now,” said Thomas Graham, co-founder of optical computing startup Lightmatter, during an interview last week in New York with Mandeep Singh, a senior technology analyst with Bloomberg Intelligence.

Also: I test AI tools for a living, and these are the only two worth paying for

Singh asked Graham if large language models (LLMs) such as GPT-4 will continue to “scale,” meaning grow in size as OpenAI and others try to achieve more ambitious models. 

Graham turned the question around, suggesting that the next stage …