Dylan Patel, founder of SemiAnalysis and one of my go-to experts on semiconductors and data center infrastructure joins me to discuss AI in 2025. Several key themes emerged about where AI might be headed in 2025:

1/ Big Tech’s accelerating CapEx and market adjustments
The hyperscalers are racing ahead in capital expenditure, with Microsoft’s annual outlay likely to surpass $80 billion (up from around $15 billion just five years ago). By mid-decade, total annual investments in AI-driven data centers could climb from around $150–200 billion today to $400–500 billion. While these expansions power more advanced models and services, such rapid spending raises questions for investors. Are shareholders ready for ongoing, multi-fold increases in data center build-outs?

2/ The competitive landscape and new infrastructure players
The expected explosion in AI workloads is drawing in a wave of new specialized GPU cloud providers—names like CoreWeave, Niveus, Crusoe—each gunning to become the next vital utility layer of AI compute. Unlike the hyperscalers, these players tap different pools of capital, including real-estate-like finance and private credit, enabling them to ramp up aggressively. This dynamic threatens the established order and could squeeze margins as competition heats up. The market is starting to understand that.

3/ The semiconductor supply chain isn’t the only bottleneck
We often talk about GPU shortages, but the real sticking point is broader infrastructural complexity. Yes, Nvidia and TSMC can ramp up chip supply. But even if you have enough high-end silicon, you still need power infrastructure and grid connectivity. Building multi-gigawatt data centers in the US—each the size of a utility-scale power plant—is now firmly on the agenda. In some states, data centers already consume 30% of the grid’s electricity. By 2027, AI data centers alone could account for 10% or more of total US electricity consumption, straining America’s aging infrastructure.

4/ Commoditization of models and margin pressure
A year ago, advanced language models were scarce and expensive. Today, open-source variants like Llama 3.1 are driving commoditization at speed, slicing away the profit margins of plain-vanilla model-serving. If your model doesn’t outperform the best open source, you’re forced to compete on price—and that’s a race to the bottom. Currently, only a handful of players (OpenAI and Anthropic among them) enjoy meaningful margins. As models proliferate, value will increasingly flow to those offering distinctive tools, integrating closely into enterprise workflows and locking in switching costs.

5/ Into 2025: exponential curves and new market norms
Despite these challenges—soaring costs, stalled infrastructure build-outs, margin erosion—Dylan is confident that exponential scaling will continue. The sector’s appetite for GPUs, specialized chips and next-gen data centers appears insatiable. We could easily see record-breaking fundraising rounds north of $10 billion for private AI ventures—funded by sovereign wealth funds and other capital pools that have barely scratched the surface of their capacity to invest in AI infrastructure. There’s also a very tangible productivity angle. AI coding assistants continue to reduce the cost of software development. Some software companies could be looking at 20–30% staff reductions in these technical teams as high-level coding becomes automated. This shift, still in its early days, will have profound downstream effects on the entire software ecosystem.

Find us:

• Exponential View
• SemiAnalysis

As we race towards a future powered by AI and data centres, how will the insatiable demand for energy impact the environment? With the richest companies ploughing billions into energy generation, might there be some unexpected upsides for the climate transition? And can exponential technologies address the climate crisis on a finite planet?

Cleaning Up host Michael Liebreich sits down with Azeem Azhar, founder of Exponential View, to explore the complex relationship between exponential growth, climate change, and the societal implications of transformative technologies. Michael and Azeem delve into the promises and pitfalls of a future shaped by the rapid advancements in renewable energy, battery storage, and artificial intelligence.

This podcast was originally published on Cleaning Up.

Artificial Intelligence is on every business leader’s agenda. How do we make sense of the fast-moving new developments in AI over the past year? Azeem Azhar returns to bring clarity to leaders who face a complicated information landscape.

This week, Azeem speaks with Richard Socher, CEO and founder of You.com, an AI chatbot search engine at the forefront of truthful and verifiable AI. They explore approaches to building AI systems that are both truthful and verifiable. The conversation sheds light on the critical breakthroughs in AI, the technical challenges of ensuring AI’s reliability, and Socher’s vision for the future of search.

They also discuss:

• How AI’s future is tied to advancements in natural language processing.
• The role of scientific rigor in large language models’ current and future developments.
• The founding of You.com and its mission to revolutionize search.
• Predictions for the next big breakthroughs in AI.

@azeem
@RichardSocher

Further resources:

• Why AI is humanity’s mirror — and what we can learn from it (Richard Socher, TED, 2023)
• The Promise of AI with Fei-Fei Li (Azeem Azhar, Exponential View, 2020)
• AI is the real web3 (Azeem Azhar, Exponential View, 2023)