Case Study: urlscan.io Scales Fast, Low-Latency Threat Analysis with Backblaze B2 Cloud Storage

urlscan.io scales to 700,000 scans a day with Backblaze

urlscan.io, a threat analysis service, faced a significant scaling challenge as its storage footprint grew past 60TB. The company scans over 700,000 websites daily, producing millions of files that it must store in perpetuity. Its original multi-platform storage solution was inflexible, slow, and limited in capacity and concurrency, threatening its ability to grow. This led them to seek a new solution from vendor Backblaze.

By implementing Backblaze B2 Cloud Storage, urlscan.io gained a scalable and high-performance solution. The Backblaze S3 Compatible API made migration easy and integration with NGINX caching allows tens of thousands of daily users to access files quickly without a CDN. The results include retrieval times of under one second in the 95th percentile, significantly improved latency, and simple, predictable budgeting. Backblaze now stores over 1 billion files for urlscan.io, providing the peace of mind and scalability needed to focus on their core mission.

Urlscan.io