Case Study: Global Consulting Firm accelerates data ingest 8x with Optiv

Optiv Empowers Global Consulting Firm to Expedite Data Processing Speed and Gain Customer Insight

Global Consulting Firm, a management consulting organization, was struggling with a slow on-premise ETL and analytics process for proprietary data, which delayed customer insights and burdened data scientists with managing disconnected environments. The company also lacked the in-house expertise to securely implement data engineering in Azure Databricks, creating performance and security challenges. Optiv helped address these issues with its Secure Data Cloud service.

Optiv embedded with the team to assess the existing environment, redesign the data pipeline, and migrate the process to a unified cloud-based platform using Databricks and Spark analytics. The result was an 8x faster ingest pipeline, cutting processing time for 400 GB of data from 16 hours to under 2 hours and reducing 70 GB of data processing from 8 hours to 1 hour. Optiv also improved alignment between data engineers and data scientists, enabled scalable cluster sizing in Databricks, and uncovered a major production bug during testing so the customer could patch it.