Case Study: COTA improves ETL pipelines for cancer data with Sunscrapers

Cota improves ETL pipelines with Sunscrapers using 3 data engineers since 2021

The customer, COTA, a healthcare company dedicated to organizing real-world cancer data, faced a challenge in building and improving its ETL pipeline to transform and warehouse complex clinical data. They needed to find data engineers skilled in a niche technology stack to aggregate data from diverse sources, improve performance, and ensure data quality and reliability. They engaged the vendor, Sunscrapers, for dedicated development teams.

Sunscrapers provided COTA with data engineers who were onboarded and integrated with the in-house team. Under COTA's management, the Sunscrapers team delivered measurable improvements by revamping an integration service to make it faster, setting up a warehouse structure on Google Cloud, and rigorously testing the system for reliability. The results included improvements to ETL pipeline build time and quality, with three data engineers involved in the project since 2021.

Cota