Case Study: Optimizely achieves lower Developer Pain Index and faster, higher-quality releases with BrowserStack's scalable cloud testing

Optimizely achieves testing maturity with BrowserStack’s scalable cloud infrastructure

Optimizely, the progressive delivery and experimentation platform, was hampered by a flaky, resource‑constrained on‑premise test grid that increased developer frustration and drove up its internal Developer Pain Index. Real browser end‑to‑end tests proved fragile and slow, and an earlier cloud provider’s instability failed to solve capacity and maintenance issues. To address this, Optimizely moved its testing to BrowserStack, using Automate and App Automate to replace the on‑prem infrastructure.

BrowserStack’s elastic cloud and diagnostic features (video, console logs) let Optimizely parallelize tests, integrate across multiple CI environments, and stop spending engineering time on grid maintenance. The result: engineers built a robust Behavely end‑to‑end framework, many tests now run on BrowserStack, and more than 15,000 automated, parallelized test cases execute across Optimizely’s CI every 45 minutes with releases to pre‑production every 4 hours. BrowserStack’s platform reduced maintenance overhead, lowered the Developer Pain Index, accelerated release frequency, and improved overall code quality and engineer satisfaction.

Optimizely

Brian Lucas

Senior Staff Software Engineer