Case Study: ReversingLabs serves file reputation data for billions of files with ScyllaDB

Serving File Reputation for Twenty Billion Files

ReversingLabs, a cybersecurity company specializing in threat intelligence, needed a highly available database to support its TitaniumCloud platform, which serves file reputation data for over twenty billion files. Their challenge was to achieve consistent sub-2 millisecond latencies for billions of daily queries while efficiently handling a massive variety of record sizes, from 1KB to 500MB.

ScyllaDB was implemented as the production database, chosen for its performance and compression capabilities. By optimizing ScyllaDB's LZ4 compression with a larger chunk size, ReversingLabs achieved a 49% storage reduction. The solution delivered exceptional performance with average read latencies under 1 millisecond and p99 read latencies under 7 milliseconds, enabling the platform to reliably serve over 26 million requests per hour during peak traffic.

ReversingLabs

Goran Cvijanovic

Senior Software Architect