Case Study: Vimeo ensures data freshness with Great Expectations

How Vimeo uses GX to ensure data freshness and overcome their data quality issues

Vimeo, a leading HD streaming video platform, needed a better way to monitor its data pipelines and catch issues caused by service interruptions or upstream schema changes. The BI engineering team was dealing with missing or stale data across downstream tables, especially during pipeline migrations and when moving hundreds of DAGs, and wanted a solution that could validate data both pre-ingestion and post-ingestion. Vimeo turned to Great Expectations (GX) to help address these data quality and freshness challenges.

Great Expectations was deployed within Vimeo’s Airflow DAGs on Google Cloud to monitor pipelines feeding the Snowflake data warehouse, with alerts sent via Slack or email if data stopped arriving for more than 24 hours or if freshness checks failed. This helped Vimeo quickly detect outages, investigate missing data, and fix issues before stakeholders or dependent teams were impacted. As a result, Great Expectations gave Vimeo faster problem resolution and stronger confidence in data freshness across new and existing pipelines.

Vimeo

Evan Calzolaio

BI Engineering Team