Case Study: Mapbox achieves faster data pipeline development and lower testing costs with Dagster Labs

Mapbox reduces pipeline work from days to 1-2 hours with Dagster Labs

Mapbox, a provider of mapping and location data platforms, faced significant challenges with its legacy Airflow orchestration system, which led to slow development cycles and high costs as testing had to be done on production infrastructure. They partnered with Dagster Labs to incrementally adopt the Dagster data orchestrator to improve their developer productivity without a full system rewrite.

The solution from Dagster Labs involved compiling new Dagster pipelines into Airflow DAGs, allowing for interoperability with the existing system. This approach enabled local testing with ephemeral resources, drastically reducing development costs by over 50%. The results were substantial, with Dagster Labs helping to reduce a core data processing task from taking days or weeks of human effort down to just 1-2 hours, dramatically accelerating the delivery of new data products.

Mapbox