Case Study: Major Global Ecommerce Company achieves rapid feature testing and scalable ad-hoc evaluations with Appen

The customer was able to scale its evaluation capabilities much more quickly, while maintaining quality standards

Major Global Ecommerce Company engaged Appen to address urgent ad-hoc evaluation needs that were pulling resources away from core site testing. These ad-hoc tasks often arrived with minimal notice and limited guidelines, required immediate turnaround, and demanded experienced raters in search, social and eCommerce evaluation—so the customer sought Appen’s project management expertise and on-demand rater capacity.

Appen used its Flexible Projects roster and platform (including API support) to perform a rapid needs analysis, review evaluation guidelines with the feature team, upload test data, and mobilize 10–20 qualified raters per project. The initial “suggested search” evaluation was launched within two days and completed two days later; over the next few months the customer completed ten more ad-hoc projects with average turnarounds of two to three days. As a result, Appen enabled the Major Global Ecommerce Company to scale evaluation capacity quickly, maintain quality standards, act on feature-test results within days, and stay within budget.