Microsoft's Maia 300 chip targets 40% efficiency gain over Nvidia GPUs
Microsoft announced its third-generation Maia 300 AI chip on October 12, 2026, claiming it will deliver 40 percent more tokens per megawatt than Nvidia-based GPU systems. Production rollout is scheduled for 2027.
Updated
Why it matters
- Microsoft announced its third-generation Maia 300 AI chip on October 12, 2026.
- Microsoft expects Maia 300 to deliver 40 percent more tokens per megawatt than leading GPU-based systems.
- Maia 300 will become the 'primary AI inference system' across Microsoft's products and services.
- Microsoft will start rolling out Maia 300 to production in 2027.
- Scott Guthrie, executive vice president of Microsoft's cloud group, made the efficiency claim in a Microsoft blog post.
Microsoft expects its third-generation Maia AI accelerator to deliver 40 percent more tokens per megawatt than leading GPU-based systems, the company said on October 12, 2026, sharpening the challenge to Nvidia's grip on cloud AI hardware.
The chip, named Maia 300, will become the "primary AI inference system" across Microsoft products and services. Production rollout begins in 2027. The Verge first reported the announcement under the headline "Microsoft's new AI chip makes it less reliant on Nvidia's GPUs" — a framing that puts the strategic stakes between the two companies in plain language.
"We expect Maia 300 to deliver 40 percent more tokens per megawatt compared to leading GPU-based systems," Scott Guthrie, executive vice president of Microsoft's cloud group, wrote in a Microsoft blog post on October 12. The metric — model output per unit of electricity — has become the central battleground for inference silicon.
What does Microsoft want from a custom chip?
Microsoft built Maia 300 to handle the workload that runs when a user queries a model: inference. Microsoft already operates one of the largest inference fleets in the industry for products including Bing, Microsoft 365 Copilot, and the Azure OpenAI Service.
Microsoft said the chip is more capable than previous generations at running "the latest reasoning models and agentic tasks." Reasoning models are systems that take additional steps before answering; agentic tasks are workflows in which the model plans actions and invokes external tools on the user's behalf. Both workloads are growing inside Microsoft's enterprise contracts as companies deploy Copilot agents to automate document processing, customer service, and software development.
Routing more of that traffic through Microsoft-designed silicon directly cuts Microsoft's spending on Nvidia GPUs, which dominate the AI accelerator market today.
How significant is the 40 percent efficiency claim?
Microsoft disclosed no raw performance numbers for Maia 300 — no teraflops, no memory bandwidth, no interconnect speed. The company also declined to specify which "leading GPU-based systems" it compared against.
That omission is standard practice for hyperscalers releasing custom silicon. A general-purpose GPU benchmark tells a different story than one tuned for a specific model's behavior, and cloud operators rarely invite direct comparisons.
The 40 percent efficiency figure would matter most for high-volume inference deployments, where electricity costs compound across millions of queries per minute. If Microsoft retains the efficiency gain internally, the result is wider operating margin on each Azure AI transaction. If Microsoft passes the savings through pricing, customers running agents and Copilot workloads at scale would see lower bills.
When does Maia 300 reach production?
Microsoft said Maia 300 will "start being rolled out to production in 2027." The announcement included no timetable for specific Azure regions, services, or customer tiers.
The chip will form part of what Microsoft is calling an "Azure Maia system," designed to scale to multi-gigawatt deployments. Single-gigawatt campuses have become the standard planning unit for frontier AI data centers — measured in continuous electrical load across tens of thousands of accelerators. A multi-gigawatt Maia deployment, if built, would rank among the largest single-chip programs in commercial cloud history.
Microsoft's blog post referenced a "full 96-accelerator" configuration for Maia 300 systems, but the surrounding technical specifications were not included in the announcement. The Verge's full story carries the additional detail Microsoft released.
Why does this matter for Nvidia?
The Verge's headline framing — "less reliant on Nvidia's GPUs" — captures the strategic pressure in one phrase. Microsoft's customers do not buy chips; they buy tokens, image generations, and agent calls. Every workload that shifts from Nvidia hardware to Microsoft-designed silicon reduces the share of the cloud AI bill that flows to Santa Clara.
Nvidia retains a commanding position in AI training, where frontier-model labs continue to standardize on its high-end accelerators. Inference is a different market. It runs continuously, rewards efficiency over peak speed, and favors hardware tuned to specific model architectures. Microsoft is signaling that it intends to compete on the dimension it can control — power per token.
What details remain undisclosed?
Microsoft has not announced:
- Pricing for Azure tiers using Maia 300
- Benchmark comparisons against specific Nvidia products such as the H100 or B200
- The foundry partner and process node for the chip
- The first customer-facing workloads routed to Maia 300
- The release date for the additional specifications The Verge reported as available
Microsoft typically introduces new silicon through internal workloads first, exposing production performance only after months of real traffic. Customers running multi-year commitments to Azure OpenAI Service will look for evidence that the efficiency claim holds outside controlled benchmarks.
What's next?
The 2027 rollout leaves Microsoft roughly 14 months to validate Maia 300 at scale before exposing the chip to revenue-generating Azure services. Microsoft will likely provide further detail at its annual Ignite conference or in subsequent quarterly earnings calls.
The central question for Microsoft is not whether Maia 300 can match Nvidia's flagship parts on raw throughput. It is whether a chip tuned for inference, deployed at multi-gigawatt scale, can move enough of Microsoft's AI workloads off Nvidia hardware to justify the multi-year engineering investment required to design it.
Microsoft has now named its chip, drawn its efficiency line in the sand, and set a 2027 date. Hitting the 40 percent efficiency target in production is the harder problem the company now has until next year to solve.
Original: blogs.microsoft.com
More from Marcus Bennett
Show full bio
Senior reporter covering companies, deals and strategy in artificial intelligence and machine learning at AI In Context.
197 articles
Related articles
- Microsoft will run its Maia AI chips at gigawatt scale from 2027
- NVIDIA to invest up to $100 billion in OpenAI for 10 gigawatts of AI infrastructure
- Microsoft Shifts AI Strategy Toward Homegrown Chips to Cut Nvidia Reliance
- OpenAI and Broadcom Unveil Jalapeño, a Custom LLM Inference Chip
- OpenAI Commits to 6 Gigawatts of AMD GPUs in Multi-Year Deal