Case Study: MyJobMatcher achieves fast, near-real-time processing of 200M records/day with Integrate.io

Processing 200 million records per day goes from daunting to delightful

MyJobMatcher, a UK-based staffing and recruitment website (11–50 employees) that matches résumés to relevant jobs, faced the challenge of moving and connecting massive volumes of data—100–200 million records per day—quickly with limited team resources. To solve this, they turned to Integrate.io and implemented Integrate.io’s ETL tool.

Integrate.io’s ETL tool allowed MyJobMatcher to build efficient data pipelines, consolidate multiple sources, and load analytics into Amazon Redshift with minimal staff effort. As a result, MyJobMatcher now processes 100–200M records per day much faster, can analyze data frequently to make near-real-time decisions, and gains deeper insights from email and website activity to continuously optimize its matching algorithms.

MyJobMatcher

Craig Burton

Technical Director