Chips · accelerators · AMD

AMD Instinct MI300X · Instinct MI300

1,733 gigaflops of dense BF16 compute per watt, at 750 W

Shipped 6 Dec 2023; shipped by the first date promised. Epoch AI names it at no AI data center and 3 GPU clusters.

Embed

The frame credits AMD, Epoch AI, AI data centers and Epoch AI, Data on GPU clusters and links back to its page. Preview it.

Cite
CSV Post on X

Each figure in AMD’s own words

one chip, dense compute; memory is high-bandwidth memory
BF16, dense
1,300 TFLOPS Peak bfloat16 1.3 PFLOPs AMD Instinct MI300X product page (1.3 PFLOPS on the page)
FP8, dense
2,610 TFLOPS Peak Eight-bit Precision (FP8) Performance (E5M2, E4M3) 2.61 PFLOPs AMD Instinct MI300X product page (2.61 PFLOPS on the page)
Memory
192 GB Dedicated Memory Size 192 GB AMD Instinct MI300X product page
Memory bandwidth
5.3 TB/s Peak Memory Bandwidth 5.3 TB/s AMD Instinct MI300X product page
Maximum power
750 W Typical Board Power (TBP) 750W AMD Instinct MI300X product page
Compute per watt
1,733 GFLOPS/Wdense BF16 over maximum power; 3,480 GFLOPS/W at FP8

The product page rounds BF16 to 1.3 PFLOPS and FP8 to 2.61 PFLOPS; its footnote gives 1307.4 and 2614.9 TFLOPS. The first MI300X-specific window found is from June 2023; AMD's June 2022 statement covers the MI300 family before the MI300X was named.

3 dated promises and the shipment

each date links to the page it is quoted from
  1. 13 Jun 2023 Promised launch in 2023. led by the launch of our Instinct MI300 accelerators planned for later this year AMD Data Center and AI Technology Premiere press release
  2. 1 Aug 2023 Promised launch and production ramp in the fourth quarter of 2023. on-track to launch and ramp production of MI300 accelerators in the fourth quarter AMD second quarter 2023 financial results, 8-K exhibit 99.1
  3. 31 Oct 2023 Promised volume production in the fourth quarter of 2023. AMD InstinctTM MI300A and MI300X GPUs are on track for volume production in the fourth quarter AMD third quarter 2023 financial results, 8-K exhibit 99.1
  4. 6 Dec 2023 Shipped: AMD announced availability. Today, AMD (NASDAQ: AMD) announced the availability of the AMD InstinctTM MI300X accelerators AMD Instinct MI300 Series launch press release

Named at no AI data center Epoch AI tracks

H100-equivalents and power are the whole site’s today, with every chip it holds

20,384 chips in 3 GPU clusters

Epoch AI’s list of AI supercomputers, which stops in July 2025
GPU clusters with this chip
ClusterOwnerCountryChipsFirst operational
Oracle OCI MI300x Oracle United States of America 16,384 2024-11-15
Vultr Chicago Cluster Vultr United States of America 3,000 2024-12-11
TensorWave MI300X Cluster 1 Phase 1 TensorWave United States of America 1,000 2024-04-01

Epoch AI’s names for this chip: AMD Instinct MI300X.

Other AMD chips