Case Study: Catalyst Cooperative liberates public utility data with Dagster Labs

Catalyst Cooperative adds 100s of new data assets with Dagster Labs

Catalyst Cooperative, a data analysis cooperative, faced significant challenges managing their Public Utility Data Liberation (PUDL) project. Their initial DIY Python ETL pipeline had become entangled, making it difficult to add new data sources, access interim data, and understand dependencies. This hindered their goal of making public energy data accessible to researchers and advocates. The team needed a proper data orchestration tool to simplify their workflow.

By adopting Dagster, Catalyst Cooperative implemented a declarative, data-aware orchestration solution. The migration to Dagster streamlined the process of adding new datasets, accelerated development cycles, and made interim data assets easily available to users. As a result, the team can now focus on data cleaning instead of infrastructure, enabling them to scale the project and distribute user-friendly data products more effectively, thereby expanding their impact.

Catalyst Cooperative