Case Study: OpenAI achieves structured job board scraping and resume matching with Firecrawl

OpenAI scrapes job boards in 22s with Firecrawl

OpenAI needed to track open roles across multiple companies but faced the challenge of traditional web scraping, which required writing and maintaining a separate, brittle parser for each unique career page. These pages often load data with JavaScript and link out to various third-party applicant tracking systems (ATS), making consistent data extraction difficult. They turned to vendor Firecrawl and its web scraping service to solve this.

Firecrawl implemented a schema-based scraping solution using its scrape and batch scrape endpoints. This approach used a single, reusable schema to extract structured job data from any ATS, such as Ashby or Greenhouse, eliminating the need for per-site custom code. The result was a scalable pipeline that could reliably pull job listings and detailed role information into clean JSON. The solution also included an LLM-powered feature to rank scraped jobs against a candidate's resume, demonstrating the measurable impact of automating a previously manual and error-prone process.

OpenAI