Case Study: Leading Auto Marketplace increases Google crawl 19x and doubles organic traffic with Botify

How an online auto marketplace increased their Google crawl by 19x (and doubled organic traffic) in less than 3 months

The customer, a leading auto marketplace, faced a significant SEO challenge where over 99% of its 10 million pages were never crawled by Google. With no in-house SEO staff, they engaged Botify and its analytics platform to gain visibility into their site structure, which was plagued by wasted crawl budget, non-compliant pages, and poor internal linking, preventing their valuable content from being indexed and found.

Botify's solution involved two key actions: updating the robots.txt file to stop Google from crawling worthless pages and overhauling the internal linking structure to make key content accessible. As a result, the auto marketplace increased Google's crawl of its site by 19 times and doubled its weekly organic traffic from 40,000 to 80,000 visits in less than three months.