(Shutterstock)
The American semiconductor giant AMD is currently under market scrutiny for its ability to challenge NVIDIA's AI GPU dominance. AMD is set to officially unveil its next-generation Instinct MI300 series accelerators on December 7th Taipei time. CEO Lisa Su will lead her team to join AI industry partners and customers to showcase how AI hardware and software platforms are reshaping the vision for AI, self-adaptive computing, and high-performance computing (HPC).
Despite the US-China bans, the demand for AI GPUs is unstoppable and on the rise. AMD's MI300 series is expected to ship up to 400,000 units in 2024. Major clients include Microsoft (MSFT) and Google (GOOG). If not for restricted TSMC CoWoS production capacity and NVIDIA already reserving over 40% of the capacity, shipment volumes could see another upward adjustment.
The MI300X accelerator supports up to 192 GB of HBM3 memory, providing the computational power and memory efficiency needed for large language model inference and generative AI workloads. With its large memory capacity, customers can handle large language models like Falcon-40B using just one MI300X GPU accelerator, handling models with 400 parameters. The MI300A, developed for high-performance computing and AI workloads, is the world's first APU accelerator designed to assist hardware execution. AMD, through the ROCm software ecosystem tailored for data center accelerators, is pushing its ready and comprehensive open AI software platform into the market.
Recently, AMD's AI platform secured a major deal with Microsoft, who officially announced multiple new products featuring MI300X, Epyc processors, and Ryzen processors equipped with AI engines. Among these, the new Azure ND MI300x v5 virtual machine (VM) series is equipped with MI300X, optimizing AI workloads. These developments are boosting investor confidence in AMD.
Copyright Statement
The copyright for this article belongs the author and CMoney Financial News. Reproduction without explicit permission is strictly prohibited and may result in legal recourse.
Disclaimer
The information presented on this website is intended solely for reference and does not imply any endorsement for buying or selling. Investors are advised to assume full responsibility for the risks associated with trading.
