Case Study: a leading delivery company scales AI operations with Portkey

How a leading delivery platform built a GenAI system to support 1000+ engineers

The customer, a leading delivery company, faced significant challenges in scaling its AI operations. With over 400 engineers using more than 150 AI models from multiple providers, the company grappled with infrastructure bottlenecks, high costs from redundant API calls, and the complexity of ensuring reliability and security. To manage this, they turned to vendor Portkey and its AI Gateway service.

Portkey implemented its solution in a hybrid model, running the data plane within the customer's own VPC for security while leveraging Portkey's cloud-based control features. The results were substantial: the system achieved 99.99% uptime while processing tens of millions of requests, rescued nearly half a million failed calls with smart fallbacks, and saved over $500,000 by reducing LLM spends. Portkey's infrastructure now supports over 1,000 engineers, enabling faster innovation and sustainable growth.