Case Study: Scrapinghub halves deployment time and achieves 100% uptime with Confluent Cloud

Scrapinghub Accelerates Next-Generation Web Scraping Service with Confluent Cloud

Scrapinghub, a leading web-scraping provider, needed to accelerate delivery of its new AI-enabled AutoExtract service while ensuring reliability and scalability to meet growing customer demand. To achieve fast time-to-market and avoid infrastructure overhead, Scrapinghub built AutoExtract on Confluent Cloud (Confluent) running on Google Cloud Platform with an Apache Kafka–based event-streaming backbone.

Confluent Cloud provided a managed Kafka cluster that teams could deploy in minutes, enabling autonomy and halving deployment time versus self-managed infrastructure. The solution delivered measurable results: initial setup completed in minutes, 100% uptime post-launch, minimized latencies with no cloud vendor lock-in, and the ability to horizontally scale from ~12 requests/sec toward 100+ requests/sec—achievements directly enabled by Confluent.

Scrapinghub

Ian Duffy

DevOps Engineer