Case Study: DataBase Technologies, Inc achieves 10x faster marketing data transforms with Innovative Routines International (IRI) CoSort

CoSort Transforms Big Marketing Data 10x Faster than SQL

DataBase Technologies, Inc. (DBT) is a specialist in building and maintaining very large marketing databases and had to ingest and aggregate a new stream of 350 million transaction records per day (joining to files up to 100 million records). Their existing high-end SQL engines required more than two days to load and index a 350 GB dataset, so DBT sought a high-performance sort/transform solution and selected CoSort (SortCL) from Innovative Routines International (IRI).

IRI’s CoSort/SortCL was deployed to pre-sort, transform, filter, merge and join DBT’s large datasets, dramatically improving throughput. The vendor’s tool produced roughly 10x faster join performance versus DBT’s SQL package (example: 9 minutes 37 seconds vs. 1 hour 38 minutes), enabled simple sorts to be done in a day or two instead of much longer, and drove much higher CPU/disk utilization. IRI also provided responsive support and thorough documentation, delivering clear, measurable reductions in processing time so DBT can handle its daily 350M‑record workflows.