Case Study: Modal Labs achieves fast, reliable AI GPU access with Oracle OCI AI Infrastructure

Modal Labs solves AI compute snags for developers with OCI AI Infrastructure

Modal Labs, an infrastructure-as-a-service platform for developers building data, AI, and machine learning applications, needed fast, reliable access to high-performance NVIDIA GPUs at scale to support demanding generative AI and large batch workloads. Before working with Oracle, the company struggled to secure enough GPU capacity with the performance and flexibility its customers required, especially for rapid cold starts in serverless environments.

Oracle implemented OCI AI Infrastructure, including bare metal instances and VMs with NVIDIA H100, A100, and A10 Tensor Core GPUs, giving Modal Labs access to potentially thousands of GPUs with short lead times. As a result, Modal Labs can now deliver the capacity customers need more quickly and offer a wider variety of compute shapes, improving reliability and flexibility for developers.

Modal Labs

Erik Bernhardsson

Founder and CEO