Case Study: Cohere achieves scalable, secure AI model training and deployment with Oracle Cloud Infrastructure

Cohere trains and deploys its generative AI models on OCI

Cohere, a security-first enterprise AI company, needed more GPU capacity and a scalable Kubernetes environment to train and deploy its growing large language models while maintaining strong performance and security. Oracle helped Cohere meet rising customer demand on its multi-cloud platform using Oracle Cloud Infrastructure (OCI) and Oracle Cloud Infrastructure Kubernetes Engine (OKE).

Oracle implemented OCI GPUs, OKE, and highly optimized RDMA networking to speed model training and inference, while its support and security teams worked closely with Cohere on deployment and a Security Maturity Profile Assessment. As a result, Cohere was able to scale AI workloads more flexibly, train models faster, improve efficiency, and gain confidence in its security posture without running out of GPU resources.

Cohere

Autumn Moulder

VP of Infrastructure & Security