Nvidia Corp. and SK Hynix Inc. signed a multi-year technology partnership to co-develop next-generation AI memory chips [1, 2].
The agreement aims to resolve the AI memory bottleneck, a critical hardware constraint that limits the speed and efficiency of large-scale artificial intelligence processing [3, 5].
Announced June 8, 2024, in Seoul, South Korea, the deal focuses on creating specialized memory for Nvidia’s AI infrastructure, which the company refers to as AI factories [1, 3]. This collaboration leverages the memory expertise of SK Hynix to support the expanding requirements of data-center infrastructure [3, 5].
While some reports describe the goal as the development of AI chips generally [4], other records specify the focus is on memory chips designed for the Vera Rubin architecture and subsequent generations [5]. These high-performance components are essential for the massive data throughput required by modern generative AI models.
The partnership comes as Nvidia continues to expand its ecosystem of hardware providers to maintain its lead in the AI boom [3]. By securing a long-term supply and development pipeline with a South Korean giant, Nvidia reduces the risk of supply chain disruptions for its most advanced accelerators [1, 3].
SK Hynix will work closely with Nvidia to ensure that the memory technology evolves in tandem with the processing power of the GPUs [1, 2]. This integration is intended to optimize the performance of AI factories, allowing for more complex computations with lower latency [1, 5].
“The agreement aims to resolve the AI memory bottleneck”
This partnership signals a shift from off-the-shelf hardware procurement to deep architectural co-development. By integrating memory design directly into the roadmap for its AI factories, Nvidia is attempting to eliminate the 'memory wall' where GPU processing speeds outpace the ability of memory to deliver data. For the broader industry, this tightens the link between U.S. chip designers and South Korean manufacturers, potentially creating a higher barrier to entry for competitors lacking such strategic alliances.
