As Tom’s Hardware reports (https://www.tomshardware.com/pc-components/dram/jedec-releases-new-sphbm4-standard-to-slash-ai-memory-costs-narrow-512-bit-interface-enables-dropping-expensive-interposers-for-organic-substrates), the JEDEC consortium has released a new memory standard called SPHBM4, specifically tailored to the demands of AI and high-performance computing. SPHBM4 aims to provide the high bandwidth of HBM4 memory while foregoing expensive silicon interposers and instead using a more cost-effective organic substrate technology.
New Approach for High-Bandwidth Memory
HBM4 (High Bandwidth Memory fourth generation) is currently one of the fastest memory standards for graphics processors and AI accelerators. However, manufacturing costs are very high due to the complex integration using silicon interposers and CoWoS (Chip-on-Wafer-on-Substrate) technology. SPHBM4 addresses this by employing a narrower 512-bit interface that enables a direct connection on organic substrates. This eliminates the costly interposers, significantly lowering production costs.
Technical Details and Advantages
The SPHBM4 standard offers bandwidth comparable to HBM4 while supporting more efficient and cost-effective manufacturing. The narrower interface reduces space requirements and simplifies packaging. For manufacturers of AI accelerators and high-performance GPUs, this means they can implement high-data-rate memory solutions at lower costs.
This development is particularly relevant as demand for AI hardware and data-intensive applications continues to grow. Memory bandwidth is a critical bottleneck in the performance of modern AI models, and more affordable memory solutions can promote the adoption and capability of such systems.
Bild: Sergei Starostin / Pexels · Pexels · Pexels Lizenz: kostenlos nutzbar, Attribution freiwillig