Chips · accelerators · Microsoft

Microsoft Maia 100 · Maia

64 GB of memory a chip; the vendor publishes no compute figure

Promised for the first half of 2024; past its date, no dated shipment on record. Epoch AI names it at no AI data center and 1 GPU cluster. Microsoft across the site.

Embed

The frame credits Microsoft, Epoch AI, AI data centers and Epoch AI, Data on GPU clusters and links back to its page. Preview it.

Cite
CSV Post on X

Each figure in Microsoft’s own words

one chip, dense compute; memory is high-bandwidth memory
Memory
64 GB provide a total of 1.8 terabytes per second of bandwidth and 64 gigabytes of capacity Inside Maia 100: Revolutionizing AI Workloads with Microsoft's Custom AI Accelerator
Memory bandwidth
1.8 TB/s provide a total of 1.8 terabytes per second of bandwidth and 64 gigabytes of capacity Inside Maia 100: Revolutionizing AI Workloads with Microsoft's Custom AI Accelerator
Maximum power
700 W Designed to support up to 700W TDP but provisioned at 500W Inside Maia 100: Revolutionizing AI Workloads with Microsoft's Custom AI Accelerator

Microsoft publishes no compute figures for Maia 100 on its own pages; the figures shown at Hot Chips 2024 are on hotchips.org, not a Microsoft site. Power is the 700 W design limit; Microsoft says the chip is provisioned at 500 W. No Microsoft page found says Maia 100 is in production or in service, so delivery is null.

1 dated promise

each date links to the page it is quoted from
  1. 15 Nov 2023 Promised Maia and Cobalt chips start to roll out to Microsoft datacenters early in 2024 in the first half of 2024. The chips will start to roll out early next year to Microsoft's datacenters With a systems approach to chips, Microsoft aims to tailor everything from silicon to service to meet AI demand

Named at no AI data center Epoch AI tracks

H100-equivalents and power are the whole site’s today, with every chip it holds

2,048 chips in 1 GPU cluster

Epoch AI’s list of AI supercomputers, which stops in July 2025
GPU clusters with this chip
ClusterOwnerCountryChipsFirst operational
Microsoft Ares/Maia Microsoft United States of America 2,048 2023-11-15

Epoch AI’s names for this chip: Maia 100 (M100).