Case Study: Proofpoint achieves real-time scalable streaming analytics with Upsolver

Proofpoint Building an Agile and Scalable Streaming Data Infrastructure over S3

Proofpoint’s Meta Networks team needed a scalable way to manage rapidly growing streaming network data for security monitoring, internal research, and customer-facing analytics. As their data volumes expanded from dozens of GBs to hundreds of TBs per month, they wanted to build an AWS S3-based data lake without the complexity of a traditional data warehouse or open-source big data tools.

Upsolver provided the solution by enabling declarative pipelines for ingesting, transforming, and joining multiple live data streams in S3 and Kinesis. With Upsolver, Proofpoint’s team built an operational data lake in less than three weeks with just one developer, achieved around 1-second query response times, and quickly added new analytics capabilities as the business grew.

Proofpoint