Case Study: GetYourGuide Scales LLM Evaluation with SuperAnnotate

GetYourGuide onboarded 45 users and processed 340,000 evaluation items with SuperAnnotate

GetYourGuide, a global travel experience platform, faced challenges scaling its LLM evaluation processes as generative AI became more critical to its products. The company relied on a disjointed system of team-specific spreadsheets, which led to inconsistent quality assurance, unreliable version control, and inefficient manual coordination. To support its growing AI initiatives, GetYourGuide needed a centralized and flexible platform, leading them to partner with the vendor SuperAnnotate.

By implementing the SuperAnnotate platform, GetYourGuide standardized evaluation schemas and consolidated teams onto shared, automated workflows. This solution enabled the onboarding of 45 internal users in one month and the processing of over 340,000 evaluation items in the first year. SuperAnnotate made evaluation a core, efficient part of the AI development cycle, allowing GetYourGuide to ship new generative AI features to customers much faster and with greater confidence in their quality.

GetYourGuide