Alibaba Reportedly Plans to Order Over 40,000 AMD MI308 AI Chips
Alibaba Group is reportedly considering a significant purchase of 40,000 to 50,000 MI308 AI accelerators from Advanced Micro Devices (AMD). The MI308 is a specialized chip designed by AMD specifically for the Chinese market, having secured US export approval subject to a 15% licensing fee paid to US authorities. Technically, the chip features 192GB of HBM3 memory and supports long-context inference for 70-billion-parameter large language models on a single unit. Priced at approximately $12,000, it offers a cost advantage of roughly 15% compared to NVIDIA’s H20 alternative and has avoided similar security scrutiny. This potential deal represents a major strategic advancement for AMD in expanding its footprint within China's competitive AI sector. Furthermore, it provides Chinese AI developers with a crucial additional option for high-performance computing power amidst ongoing geopolitical constraints on semiconductor exports. The move highlights the evolving dynamics in the global AI hardware market, where companies are adapting to regulatory frameworks while seeking efficient solutions for large-scale model training and inference.
Wire timeline
Alibaba Reportedly Plans to Order Over 40,000 AMD MI308 AI Chips
Alibaba Group is reportedly considering a significant purchase of 40,000 to 50,000 MI308 AI accelerators from Advanced Micro Devices (AMD). The MI308 is a specialized chip designed by AMD specifically for the Chinese market, having secured US export approval subject to a 15% licensing fee paid to US authorities. Technically, the chip features 192GB of HBM3 memory and supports long-context inference for 70-billion-parameter large language models on a single unit. Priced at approximately $12,000, it offers a cost advantage of roughly 15% compared to NVIDIA’s H20 alternative and has avoided similar security scrutiny. This potential deal represents a major strategic advancement for AMD in expanding its footprint within China's competitive AI sector. Furthermore, it provides Chinese AI developers with a crucial additional option for high-performance computing power amidst ongoing geopolitical constraints on semiconductor exports. The move highlights the evolving dynamics in the global AI hardware market, where companies are adapting to regulatory frameworks while seeking efficient solutions for large-scale model training and inference.
TechNode