Case Study: Inworld achieves millisecond-latency AI at massive scale with Google Cloud and Apigee

Inworld supports millions of concurrent users with millisecond latency using Apigee

Inworld, an AI developer platform for consumer applications like games and virtual assistants, faced the challenge of scaling its AI runtime to support tens of millions of concurrent users with millisecond latencies while maintaining cost-effectiveness. To meet these demanding requirements for real-time online experiences, Inworld turned to the vendor Apigee and Google Cloud.

Apigee and Google Cloud provided a solution where Inworld hosts its databases and builds its scalable runtime platform. This integrated tech stack cost-effectively supports millions of simultaneous users with mere millisecond latencies, eliminates clumsy data transfers from third-party systems, and enables Inworld's customers to power their applications with Gemini LLMs. The results allow Inworld to reliably handle its vast capacity needs and scale well into the future.

Inworld