Case Study: adjoe streamlines data science workflows with Apache Airflow

Adjoe - Customer Case Study

Adjoe, a company specializing in mobile platforms, faced challenges with job scheduling as their data science needs grew. Their previous methods, using Kubernetes cronjobs and AWS Lambda functions, were insufficient for managing complex workloads. They required a more robust and flexible orchestration tool, leading them to adopt Apache Airflow.

Apache Airflow was implemented on Kubernetes within a new AWS environment. This solution provided the needed stability and scalability, allowing adjoe to efficiently manage and schedule a wide variety of workloads through DAGs. The results include streamlined job management, easier monitoring, and a significant reduction in infrastructure overhead. Data scientists gained autonomy, accelerating development. The team now manages over 20 DAGs and 50 tasks, with plans to double the number of DAGs soon.

Adjoe

Tadeh Alexani

Adjoe