Case Study: NYSE achieves real-time insights across 20+ PB to improve market surveillance and compliance with Cloudera Enterprise Data Hub

NYSE Gaining Real-time Insights from More Than 20 PB of Data

Intercontinental Exchange (ICE), operator of the New York Stock Exchange, needed to process and gain real‑time insights from massive, rapidly growing streams of market data. As its data lake surpassed 20 PB, legacy technologies couldn’t scale, forcing data silos and limiting analytics, surveillance and compliance capabilities.

ICE deployed Cloudera’s enterprise data hub (Cloudera Enterprise, Data Hub Edition) with Apache Impala, Apache Spark and Cloudera Navigator to handle more than 20 PB with ~30 TB added daily. The platform unified data, added governance and SQL/Spark analytics, enabled new data sources and machine learning, and delivered real‑time market surveillance and improved member compliance.

NYSE

Steve Hirsch

Chief Data Officer, Intercontinental Exchange