Earthmover
6 Case Studies
A Earthmover Case Study
NASA, the world's leading Earth-observing organization, faced a challenge with its massive cloud data migration. Its archival data formats were not designed for high-performance access in cloud object storage, creating a performance dilemma for applications needing to extract specific data points. Earthmover partnered with NASA to pilot its open-source Icechunk tensor storage engine to solve this cloud data dilemma.
Earthmover's solution used Icechunk to create a virtual Zarr data cube from the existing archival files, eliminating the need for a costly data migration. This approach enabled a 100x speedup for extracting time series data, reducing a process that took 5 minutes to just 3 seconds. The solution provided massive potential cost savings by allowing efficient data access from inexpensive S3 storage, potentially saving tens of millions of dollars in storage costs alone for NASA's petabyte-scale archive.