Case Study: Magic Eden achieves 96% lower query latency with StarTree and Apache Pinot

Magic Eden cuts query latency by 96% with StarTree

Magic Eden, a leading NFT marketplace, faced the challenge of providing real-time analytics on its vast volume of blockchain transactions. Their previous system, which relied on Spark ETL jobs and Postgres caches, resulted in unacceptable five-minute data delays, allowing competitors to offer faster analytics on Magic Eden's own data. To reclaim its advantage, Magic Eden turned to vendor StarTree and its managed real-time analytics service powered by Apache Pinot.

By implementing StarTree and Apache Pinot, Magic Eden achieved transformative results. The solution provided near-instantaneous data updates, reducing cache intervals from minutes to under five seconds. Pinot’s upsert capability and star-tree index feature drastically improved performance, cutting query latency by 96% from 2.5 seconds to 108 milliseconds. Furthermore, StarTree's use of RocksDB allowed Magic Eden to handle 20 times more data per machine, significantly reducing infrastructure costs while delivering fast, accurate, and scalable real-time analytics.

Magic Eden