Case Study: arXiv secures and scales open science with Fastly CDN and Next-Gen WAF

arXiv blocks 150 million malicious requests in a month with Fastly

arXiv, a foundational open-access science repository, faced rapid traffic growth driven by both human researchers and automated AI crawlers. Their lean engineering team was overwhelmed by server load and the difficulty of distinguishing legitimate traffic from malicious requests using manual intervention and custom software. To address this challenge, arXiv partnered with vendor Fastly to implement its CDN and Next-Gen WAF to automate infrastructure and regain control.

The solution from Fastly involved caching read-only data at the edge to manage traffic spikes and deploying its Next-Gen WAF to proactively block malicious requests. This resulted in Fastly seamlessly managing record traffic spikes of up to 650 million CDN requests and blocking over 150 million malicious attacks in a single month. The implementation also provided crucial routing support for arXiv's cloud migration and reduced operational costs through seamless Google Cloud integrations.

arXiv