Case Study: Snap achieves safer AI red teaming and $1M in bounty milestones with HackerOne

Pioneering AI Red Teaming and Celebrating a Decade of Partnership

Snap Inc., the company behind Snapchat, faced the challenge of proactively identifying and mitigating potential safety and security vulnerabilities within its generative AI products, such as Lenses and My AI. To build a safer platform, they partnered with the security firm HackerOne to conduct specialized AI red teaming exercises.

Using HackerOne's platform and innovative methodologies, including Capture-the-Flag (CTF) exercises and their AI tool Hai, Snap engaged a diverse global community of security researchers. This collaboration led to the discovery of previously unknown vulnerabilities and helped refine their AI safety benchmarks. The successful solution resulted in over $1 million in bounties paid to researchers and established Snap's program as a model for the industry, demonstrating HackerOne's critical role in enhancing their security posture.

Snapchat

Ilana Arbisser

Technical Lead, AI Safety