Case Study: Coursera builds reliable AI learning tools with Braintrust

Coursera boosts AI grading feedback 45x with Braintrust

Coursera, a global online learning platform, faced challenges in evaluating its AI features like the Coursera Coach chatbot and AI-assisted grading tools. Their previous process relied on fragmented manual reviews and spreadsheets, making it difficult to validate and ship reliable AI applications quickly. To address this, they turned to Braintrust to implement a structured evaluation workflow.

Using the Braintrust platform, Coursera built a four-step evaluation process involving clear criteria, curated datasets, and a mix of heuristic and AI-based scorers. This solution allowed their teams to rapidly iterate and confidently push features to production. The results were significant: the Coursera Coach maintains a 90% learner satisfaction rating, while the AI grading tool provides 45x more feedback and has driven a 16.7% increase in course completions.

Coursera