Case Study: UK Data Service achieves scalable, secure hybrid data access and advanced analytics with Amazon Web Services

UK Data Service - Customer Case Study

UK Data Service is the UK’s largest repository of economic and social data, supporting researchers, policymakers, and industry. Faced with a need to broaden access while protecting sensitive records and working to a modest public budget, the organization required a hybrid, highly scalable architecture that preserved open‑source workflows, met strict security standards, and made authentication and data access seamless for users regardless of where data is hosted.

The Service implemented a hybrid cloud and on‑premises design using AWS (Amazon EC2, S3, RDS) alongside open‑source tools (Kylo, HBase, Spark) with support from Hortonworks and Cloudwick. The result is automated, policy‑driven routing of datasets, ISO‑aligned security, elastic capacity for massive collections (including future smart‑meter data), and powerful, user‑friendly search and visualization—delivering predictable costs and a consistent experience for end users.

UK Data Service

Nathan Cunningham

Associate Director