The McKinsey US CSO survey found that more than 90% of companies are using generative AI, yet only 1% say the technology is fundamentally changing the way they operate. Microsoft is now restructuring its cloud AI stack to help close that gap. With the launch of Microsoft Foundry (originally introduced as Azure AI Foundry at Microsoft Ignite 2024), the company has consolidated Azure OpenAI Service, Azure AI Studio, Azure Machine Learning, Azure Cognitive Services, and Azure AI Search into a single platform. Today, more than 10,000 organizations, including Heineken, Fujitsu, and Carvana, have already migrated their AI workloads onto Microsoft Foundry.
This shift matters because the prior Azure AI architecture was already slowing AI-powered feature rollouts. Before 2024, companies had to build custom workflows across multiple AI services just to support a single use case. That meant managing separate SDKs and inconsistent governance across powerful but still siloed Azure AI components. That fragmentation pushed compliance reviews into months-long cycles and inflated the total cost of ownership. The trade-off of the current trend of consolidating Azure AI services is that every Azure AI customer now has to rework their stack.
In this article, we explain why Microsoft is consolidating its AI services under Foundry and what this shift means for businesses already using Azure AI or planning to integrate it.





