Case Study: Adyen scales data workflows and empowers teams with Apache Airflow

Adyen - Customer Case Study

Adyen, a global financial technology platform, previously used a custom-built orchestration framework that became difficult to maintain as the number of users and teams grew. The in-house tool consumed significant development time for fixes and failed to keep pace with industry standards. Adyen needed a modern solution for its Big Data Platform to schedule ETL jobs efficiently and provide users with the ability to redo or undo their tasks.

By implementing Apache Airflow, Adyen was able to scale its operations, supporting over 100 users across 20 teams. The platform's extensibility allowed for custom plugins and user roles, empowering data scientists to write and monitor their own DAGs with minimal training. As a result, Adyen grew its usage to over 200 DAGs and 5,000 tasks, freeing its infrastructure team from maintenance work to focus on integrating new technologies. Apache Airflow enabled the company to accelerate its development speed significantly.

Adyen

Jorrick Sleijster

Adyen