The DRAM Shortage: Impact of the AI Boom on Memory Prices

The current shortage of Dynamic Random Access Memory (DRAM), particularly high-bandwidth memory (HBM), is primarily driven by the unprecedented demand from artificial intelligence (AI) data centers. As companies invest heavily in AI infrastructure, the demand for DRAM has surged, leading to an 80-90% increase in prices in recent months. This situation has left manufacturers of personal computers and other consumer electronics struggling to secure necessary memory supplies.

Institute of Electrical and Electronics Engineers (IEEE)

The DRAM industry is characterized by cyclical booms and busts, influenced by the high costs of building new fabrication plants (fabs), which can exceed $15 billion. Historically, firms have been hesitant to expand production capacity during downturns, leading to significant supply shortages when demand spikes. The current cycle traces back to the COVID-19 pandemic, when data center giants like Amazon, Google, and Microsoft stockpiled memory to support remote work, driving prices up. However, as demand stabilized in 2022, prices fell, prompting major manufacturers like Samsung to cut production by 50% to avoid losses.

Institute of Electrical and Electronics Engineers (IEEE)

Currently, nearly 2,000 new data centers are either planned or under construction globally, representing a potential 20% increase in capacity. McKinsey estimates that companies will invest $7 trillion in data centers by 2030, with a significant portion directed toward AI-focused facilities. Nvidia has emerged as a primary beneficiary, with its data center revenue skyrocketing from approximately $1 billion in late 2019 to $51 billion by October 2025. This surge in demand for GPUs, which require substantial DRAM, has led to a dramatic increase in the proportion of revenue from HBM for manufacturers like Micron, which expects HBM-related revenue to grow from 17% in 2023 to nearly 50% by 2025.

Institute of Electrical and Electronics Engineers (IEEE)Digg

Despite the construction of new fabs by Micron, Samsung, and SK Hynix, these facilities are not expected to alleviate the supply shortage until at least 2027 or 2028. Micron's new HBM fab in Singapore and other expansions will not be operational until 2027, while Samsung's new plant in South Korea is set to begin production in 2028. Industry experts, including Intel CEO Lip-Bu Tan, have indicated that relief from the supply constraints is unlikely until 2028.

Institute of Electrical and Electronics Engineers (IEEE)Digg

To address the ongoing supply issues, the industry is focusing on innovations in memory technology and advanced packaging techniques. These innovations aim to improve stacking efficiency and coordination between memory suppliers and AI chip designers. However, experts caution that prices may not decrease significantly even with new supply, as demand for compute power continues to grow.

Institute of Electrical and Electronics Engineers (IEEE)

Critics argue that the current memory shortage reflects a failure of the DRAM industry to adapt to rapidly changing market demands. The reluctance of manufacturers to invest during downturns has exacerbated the current crisis, leaving many sectors reliant on DRAM vulnerable to price fluctuations and supply constraints.

Institute of Electrical and Electronics Engineers (IEEE)

• “There’s no relief until 2028.” — Lip-Bu Tan, CEO of Intel

Institute of Electrical and Electronics Engineers (IEEE)

• “In general, economists find that prices come down much more slowly and reluctantly than they go up.” — Mina Kim, Economist, Mkecon Insights

Institute of Electrical and Electronics Engineers (IEEE)

The DRAM shortage, fueled by the AI boom, poses significant challenges for various technology sectors. As companies navigate this landscape, the interplay between supply, demand, and technological advancements will shape the future of the memory market.

Digg