IBM and Together AI have signed $240 million deal to run an Nvidia-powered AI inference cluster on IBM Cloud.
IBM has inked a $240 million deal with neocloud provider Together AI to offer a cloud service that will run large capacity, open-source AI inference workloads.
The service will be based on a large cluster of Nvidia HGX B300 systems running Spectrum-X Ethernet networking and residing in IBM Cloud. Together AI will then use this cluster to provide open-source model inference services for enterprise customers.
The Together AI platform supports open models such as DeepSeek, Nemotron, MiniMax, Kimi, and GLM that the company says gives developers and customers the freedom to customize and fine-tune them at a lower-cost than a single proprietary model for their own applications. Together AI offers GPU infrastructure and AI services to developers and enterprises.
A hybrid environment on IBM Cloud powered by Nvidia GPUs connected with Nvidia Spectrum-X Ethernet networking and Together AI’s inference platform gives organizations a reliable foundation to build, deploy and scale AI systems, IBM stated. In addition, the technology behind the agreement is important to IBM as it relies on infrastructure it is working to develop with Nvidia. The two vendors recently expanded their collaboration to grow the use of GPU-native data analytics, intelligent document processing, on-premises and regulated infrastructure deployments to help enterprise customers move AI from pilot to production, according to IBM.
Vipul Ved Prakash, CEO at Together AI, said the collaboration with IBM will help Together AI continue its expansion into the enterprise space and make open-source AI more accessible to developers and enterprises. “Working alongside IBM with Nvidia gives us that foundation. This cluster lets us bring production-grade inference to more companies, faster, and it’s a big step in our push to make open-source AI the obvious choice for enterprises,” Prakash said in a statement.
The deal is the latest to contribute to a swell of AI-optimized infrastructure as a service (IaaS) activity. IBM Cloud competes with AWS, Google Cloud, Microsoft Azure, Coreweave, Lambda and many others in a rapidly expanding AI IaaS market.
Gartner just this week forecast that worldwide spending on AI-optimized IaaS is projected to grow 96% through 2026, reaching $42 billion. The market will sustain high growth and reach $66 billion in 2027, according to the firm.
In particular, the growing share of inference workloads is expected to reshape cloud investment priorities: “The rise of agentic AI amplifies compute intensity through multistep, autonomous execution, making inference the dominant consumption model and positioning AI-optimized IaaS as a critical enabler of enterprise AI strategies,” Gartner stated.
“As organizations shift from model development to production-scale deployment, fine-tuned and domain-specific models (DSMs) are increasingly integrated into customer-facing and operational systems, requiring continuous, real-time execution rather than periodic training,” said Hardeep Singh, senior principal research analyst at Gartner, in a statement. “This shift is accelerating the cloud consumption patterns and creating sustained demand for AI-optimized infrastructure.”
In 2026, global spending on inference ($23.3 billion) will surpass that of training ($19 billion), Gartner stated. Fifty-five percent of AI-optimized IaaS spending is forecast to support inference in 2026 and is set to reach 59% in 2027.
