Case Study: The Economist Group achieves measurable AI quality and 96.9% task success with Amplitude Agent Analytics

The Economist Group reaches 96.9% task success with Amplitude

The Economist Group, known for its global analysis and intelligence, faced a challenge in measuring the quality of its AI research assistant, Lens. It was difficult to pinpoint areas for improvement as traditional product analytics could not determine if an AI-generated answer was good, and manual session reviews were too slow to act upon. They turned to Amplitude and its Agent Analytics service to find a solution.

By implementing Amplitude Agent Analytics, The Economist Group gained measurable signals for AI quality, including intent classification and outcome tracking. This allowed them to move from hunches to data-driven improvements, connecting quality signals to real product usage. As a result, Amplitude helped them achieve a 96.9% task success rate for Lens and cut weekly task failures by 84%.

The Economist Group