Oracle Cloud Infrastructure (OCI) has tapped AMD’s powerful Instinct MI300X accelerators to fuel its cutting-edge AI computing needs. With the introduction of the new OCI Compute Supercluster instance, BM.GPU.MI300X.8, OCI is empowering enterprises to tackle some of the most demanding artificial intelligence (AI) workloads, including large language model (LLM) training and inference, by leveraging the capabilities of AMD’s GPUs.
The supercluster can integrate up to 16,384 MI300X GPUs in a single high-speed network fabric, making it one of the most robust AI infrastructures available in the cloud. Companies like Fireworks AI are already taking advantage of this computing power to accelerate AI model development and deployment.
A New Era for AI in the Cloud
OCI’s adoption of AMD Instinct MI300X GPUs represents a significant leap in AI infrastructure, enabling customers to process massive AI models with hundreds of billions of parameters. These powerful GPUs come with ROCm open software, providing the flexibility to optimize workloads without the constraints often associated with virtualized environments. OCI’s bare metal instances allow for more direct access to hardware, maximizing performance for high-throughput AI tasks.
“We are excited to offer more choice for customers seeking to accelerate AI workloads at a competitive price point,” said Donald Lu, senior vice president of software development at Oracle Cloud Infrastructure. He emphasized that the integration of AMD’s high-performance accelerators brings new efficiency to AI infrastructure by eliminating virtualized compute overhead.
Unrivaled Power for AI Training and Inference
The AMD Instinct MI300X GPUs have been rigorously tested and validated on OCI, where they demonstrated remarkable AI inferencing and training performance. Notably, these GPUs are designed to handle latency-sensitive tasks even with large batch sizes, a critical feature for deploying expansive LLMs that need to fit within a single node.
With its exceptional memory capacity and bandwidth, the MI300X GPU is already being adopted by AI companies. Fireworks AI, a platform focused on building and deploying generative AI solutions, is one such enterprise leveraging the OCI Supercluster for its diverse AI applications.
Lin Qiao, CEO of Fireworks AI, expressed the platform’s enthusiasm for OCI’s new offering: “The amount of memory capacity available on the AMD Instinct MI300X and ROCm open software allows us to scale services to our customers as models continue to grow.” Fireworks AI supports over 100 models and aims to help enterprises build complex AI systems that can be adapted to various industries and use cases.
Leading the Charge in Cloud AI Infrastructure
OCI’s Supercluster is distinguished not just by the number of GPUs it can support but by its high-performance design, which is engineered for the most intensive AI applications. This supercharged network fabric, powered by AMD’s advanced GPU technology, allows developers to seamlessly scale their operations. With the ability to support expansive models, OCI has positioned itself as a leading choice for AI-driven enterprises.
Andrew Dieckmann, corporate vice president and general manager of AMD’s Data Center GPU Business, highlighted the growing momentum of the Instinct MI300X accelerators, stating, “The combination of AMD Instinct MI300X and ROCm open software will benefit OCI customers with high performance, efficiency, and greater system design flexibility.”
As AI continues to evolve, demand for high-performance cloud infrastructure will only grow. By integrating AMD’s cutting-edge accelerators, OCI is ensuring that it can meet the needs of enterprises tackling the most challenging AI tasks today—and in the future.
A Competitive Edge for AI Workloads
The competitive advantage offered by OCI’s new AI supercluster lies in its ability to handle massive models without compromising performance. Companies focused on AI training and inference can now take advantage of the immense scalability, memory capacity, and efficiency provided by AMD’s GPUs at a competitive price.
With the increasing complexity of AI models, businesses need infrastructure that can grow alongside their computational demands. Oracle’s partnership with AMD, through the adoption of the MI300X accelerators, offers a compelling solution for those looking to push the boundaries of AI innovation.
As companies like Fireworks AI demonstrate, the future of enterprise AI development lies in cloud environments that prioritize performance and flexibility, and OCI is poised to be at the forefront of this evolution.