Case Study: Karmic achieves scalable, secure data infrastructure and automated Redshift ETL with Astronomer, Inc.'s Cloud Airflow

A Astronomer, Inc. Case Study

Preview of the Karmic Case Study

Karmic - Customer Case Study

Karmic delivers a modern expense-management platform for employers, banks, and retailers and faced a critical need for a scalable, secure data infrastructure as it grew. After outgrowing plug-and-play ETL tools, Karmic chose Astronomer, Inc.’s Cloud Airflow (Managed Apache Airflow) to orchestrate reliable, production-grade data flows into Amazon Redshift.

Astronomer, Inc. worked with Karmic to build a dynamic Airflow DAG that opens per-task SSH tunnels to Postgres, writes table lists as Airflow Variables, streams table data to S3, and loads it into Redshift—allowing tables to be added or removed automatically. The solution met Karmic’s security and operational needs, enabled modular testing of workflow steps, and delivered trustworthy Redshift data for company-wide analytics, helping Karmic iterate faster and adopt data-driven decision making.


Open case study document...

Karmic

Yang Wang

Data Science Product Manager


Astronomer, Inc.

17 Case Studies