Case Study: NASA achieves 100x faster cloud data access with Earthmover's Icechunk

A Earthmover Case Study

Preview of the NASA Case Study

NASA speeds Earth data access 100x with Earthmover

NASA, the world's leading Earth-observing organization, faced a challenge with its massive cloud data migration. Its archival data formats were not designed for high-performance access in cloud object storage, creating a performance dilemma for applications needing to extract specific data points. Earthmover partnered with NASA to pilot its open-source Icechunk tensor storage engine to solve this cloud data dilemma.

Earthmover's solution used Icechunk to create a virtual Zarr data cube from the existing archival files, eliminating the need for a costly data migration. This approach enabled a 100x speedup for extracting time series data, reducing a process that took 5 minutes to just 3 seconds. The solution provided massive potential cost savings by allowing efficient data access from inexpensive S3 storage, potentially saving tens of millions of dollars in storage costs alone for NASA's petabyte-scale archive.


View this case study…

Earthmover

6 Case Studies