Case Study: Crumbl achieves scalable data observability with Prefect

Crumbl’s 45-person engineering team modernizes data ops with Prefect

Crumbl, a dessert startup specializing in gourmet cookies, faced operational challenges as it grew from a single store to an international franchiser. Their data team relied on individually scheduled AWS Lambdas, which became unwieldy to troubleshoot and inaccessible. They needed a more resilient and observable data workflow automation tool to support their fast-paced operations and provide better visibility for diagnosing issues.

The solution was implemented with Prefect, which replaced their Lambda functions. Using Prefect, the team redesigned their entire stack, integrating with Snowflake and dbt. This provided easy observability of ETL job statuses, allowing for quick monitoring, debugging, and rerunning of jobs. The results for Crumbl included increased confidence in data accuracy and availability for stakeholders, the ability to support a complex rotating menu with advanced inventory planning, and a record-speed reaction time to data issues, creating incalculable efficiency gains for the data team.

Crumbl