What's Happening?
IBM has entered into a multi-year agreement with Together AI, valued at $240 million, to develop a large-scale AI inference cluster on IBM Cloud using Nvidia hardware. This cluster, which is expected to be operational by the first quarter of 2027, will
utilize Nvidia HGX B300 systems and Spectrum-X Ethernet networking gear. Together AI, a San Francisco-based company, will leverage this infrastructure to run inference on open-source AI models. The collaboration is part of IBM's broader strategy to enhance its open-source AI infrastructure, which includes a $5 billion commitment with Red Hat to secure open-source software using AI tools.
Why It's Important?
This deal signifies IBM's strategic push into the open-source AI infrastructure market, enhancing its capabilities to support enterprise-grade AI applications. By partnering with Together AI and Nvidia, IBM aims to provide scalable and economical AI solutions, which could attract more enterprises seeking high-performance AI models without the high costs associated with closed models. This move could potentially increase IBM's market share in the AI sector and strengthen its position against competitors in the cloud computing and AI infrastructure markets.
What's Next?
The AI inference cluster is set to be available by early 2027, and its deployment will likely influence IBM's future collaborations and technological advancements in AI. As the infrastructure becomes operational, it may lead to increased adoption of IBM Cloud services by enterprises looking for robust AI solutions. Additionally, the success of this project could pave the way for further partnerships and innovations in AI technology, potentially impacting the broader tech industry.
