Case Study: O’Reilly Media achieves 100x faster analysis of millions of job postings with Pivotal Greenplum Database

OReilly Media Enabling rapid analysis of huge quantities of data

O’Reilly Media, a publisher and events organizer focused on technology trends, needed a faster way to analyze millions of IT job postings from Simply Hired to inform books, conferences, consulting and business development. Their open-source database grew to tens of millions of records and queries were painfully slow—about 10 hours per query—making trend analysis time-consuming and impractical.

O’Reilly moved its data into Pivotal Greenplum Database, consolidating hundreds of millions of job posts into a massively parallel data warehouse. Query performance improved roughly 100x (from ~10 hours to ~6 minutes), enabling more complex, accurate queries, and the system now handles about 170 million postings with capacity to scale toward 500 million, dramatically improving trend visibility and decision making.

OReilly