Case Study: Black Crow AI achieves more reliable Airflow scaling and faster data pipeline development with Astronomer, Inc.

Bringing E-Commerce Brands and Customers Closer Together with Black Crow AI

Black Crow AI helps e-commerce brands improve customer acquisition by using AI-driven data products and marketing automation across channels like Shopify, email, SMS, and social media. As its data ecosystem grew, the company struggled to scale Airflow reliably, especially while managing many connectors, frequent ETL jobs, and the risk of outages that could disrupt dashboards and model-driven insights.

Black Crow AI migrated from MWAA to Astronomer, Inc.’s managed Airflow platform, Astro, with help from Astronomer, Inc.’s field engineers. The two-week migration moved 19 active DAGs with more than 1,000 tasks each, enabled a successful upgrade from Airflow 2.7.3 to 2.9.3, and gave the team rollback and support safeguards; as a result, Black Crow AI regained about 20% more time to focus on building and optimizing pipelines.

Black Crow AI

Will Norman

Sr. Staff Engineer