Huawei Unveils CloudMatrix 384 AI Computing System to Compete with Nvidia

On July 26, 2023, Huawei Technologies introduced its AI computing system, the CloudMatrix 384, at the World Artificial Intelligence Conference (WAIC) in Shanghai. This system is positioned as a competitor to Nvidia's GB200 NVL72, which is currently one of the most advanced offerings from the U.S. chipmaker. The unveiling attracted significant attention from the global AI community, highlighting Huawei's ambition to capture a larger share of China's burgeoning artificial intelligence market.

Reuters

The CloudMatrix 384 features 384 of Huawei's latest 910C chips, which, according to industry analysis, outperform Nvidia's GB200 NVL72 in certain performance metrics. Nvidia's system utilizes 72 B200 chips. Analysts from SemiAnalysis attribute Huawei's competitive edge to its innovative system design, which enhances overall performance by leveraging a higher number of chips and advanced system-level architectures. The CloudMatrix employs a "supernode" architecture that facilitates high-speed interconnectivity among chips, further optimizing its performance.

Reuters

Dylan Patel, founder of SemiAnalysis, has noted that Huawei's advancements in AI system capabilities could potentially surpass those of Nvidia. This sentiment was echoed by Nvidia CEO Jensen Huang, who acknowledged Huawei's rapid progress and specifically mentioned the CloudMatrix as a noteworthy example of their innovation. Despite facing U.S. export restrictions, Huawei has emerged as a leading domestic supplier of chips critical for AI development in China.

Reuters

While Huawei's advancements are notable, the company continues to navigate challenges posed by international trade restrictions and scrutiny over its technology. Critics argue that the geopolitical tensions surrounding Huawei may hinder its ability to compete effectively on a global scale, particularly against established players like Nvidia.

Reuters

Huawei representatives at the WAIC declined to provide detailed comments about the CloudMatrix 384 when approached by media. Additionally, a spokesperson for Huawei did not respond to inquiries regarding the system's specifications and capabilities. This lack of engagement raises questions about the company's transparency and willingness to discuss its innovations in detail.

Reuters

As Huawei continues to develop its AI technologies, the company is expected to further refine the CloudMatrix system and expand its capabilities. The ongoing competition with Nvidia will likely drive both companies to innovate rapidly, impacting the broader AI landscape in the coming years.

Reuters

• “moving quite fast” — Jensen Huang, CEO of Nvidia

Reuters