Case Study: Argus Data Insights processes 100,000 files daily with Vega IT

Argus Data Insights handles 100,000 files daily with Vega IT

Argus Data Insights, a provider of media monitoring and analysis solutions, engaged Vega IT to help transfer a data flow from a struggling legacy system. Their challenge was to integrate a new data source and optimize their existing infrastructure to handle the load more efficiently, as their relational database was buckling under constant queries.

Vega IT implemented an extension to the client's data lake by leveraging their existing Azure infrastructure, adding components like EventGrid and Kubernetes. The solution streamlined data processing to handle 100,000 files daily, with files processed in milliseconds. The system can now efficiently process over 10,000 files simultaneously without performance issues. Vega IT also assisted with compliance by defining and implementing a 30-day data retention policy.

Argus Data Insights