Case Study: Climate Policy Radar scales climate document processing and AI workflows with Prefect

Climate Policy Radar processes 25,000 policy documents with Prefect

Climate Policy Radar, an NGO making climate laws and policies accessible, faced significant engineering bottlenecks in processing tens of thousands of complex documents. Their previous orchestration with AWS Step Functions created inefficiencies, manual work, and prevented data scientists from independently running their own scripts. This manual orchestration at scale was a major challenge for their growing team.

By implementing Prefect, the team built a flexible data orchestration platform. The solution enabled data scientists to independently deploy and run their workflows, saving months of work on a major research project with Google. Prefect now orchestrates over 3,300 flows monthly, processing a massive corpus of documents and powering new AI systems, which has prepared the organization for a 10x scale-up in their litigation data project.

Climate Policy Radar