Case Study: Dynamic Holding Company reduces AWS costs and speeds ETL processing with NeenOpal

How We Transformed Workloads and Slashed Costs for a Dynamic Holding Company

NeenOpal was engaged by a dynamic holding company to address significant challenges in their AWS data infrastructure. The client was facing high costs, particularly from Glue Jobs linked to DynamoDB costing $5,000 monthly, and needed to migrate 150 ETL pipelines from the soon-to-be-inaccessible AWS Data Pipeline service. They also experienced critical delays in data retrieval from their AtData service for email intelligence, which was hampering their lead generation efforts.

The solution implemented by NeenOpal involved migrating all 150 ETL pipelines to AWS Glue with no customer downtime and optimizing the workflows. Key initiatives included reducing unnecessary Glue Crawler executions and re-architecting jobs to use a more efficient process involving S3 and Redshift. These efforts resulted in a 90% reduction in job runtime and slashed the monthly DynamoDB-related Glue costs from $5,000 to between $400 and $500, delivering substantial cost savings and enhanced operational efficiency for the client.