What's Happening?
Sandisk and SK hynix have unveiled the High Bandwidth Flash (HBF) specification, a new storage technology designed to combine the non-volatility of 3D NAND with the performance of High Bandwidth Memory (HBM). Released through the Open Compute Project,
HBF aims to provide a new memory tier for AI inference systems, offering capacities up to 512GB and bandwidths ranging from 0.4 TB/s to 3.0 TB/s. The technology uses the Universal Chiplet Interconnect Express (UCIe) standard for integration with computing platforms. Despite its potential, only Google and Tenstorrent have shown interest in the HBF consortium, while major companies like AMD, Intel, and Nvidia have not yet expressed interest.
Why It's Important?
The introduction of HBF could significantly impact AI and computing industries by providing a cost-effective solution for workloads requiring large memory pools. By offering higher capacity and non-volatility, HBF could enhance AI inference capabilities, making it a valuable asset for companies looking to optimize their computing resources. The open standard nature of HBF through the OCP could encourage broader adoption and innovation in the tech industry. However, the lack of interest from major players could pose challenges to its widespread implementation.
What's Next?
The future of HBF depends on its adoption by key industry players. As Sandisk and SK hynix continue to develop the technology, they may need to demonstrate its advantages over existing solutions to attract more participants. The success of HBF could lead to further advancements in AI and computing technologies, potentially influencing the development of future memory standards. The ongoing collaboration and interest from companies like Google could pave the way for broader acceptance and integration of HBF in various applications.
