Case Study: NovelAI achieves 3x faster generation and 75% lower cloud costs with CoreWeave

How Coreweave Helped NovelAI Grow from 0 to 40K Users in 3 Months

NovelAI, an AI storytelling platform focused on privacy and encrypted, unrestricted creative expression, saw rapid growth after launching its beta. As usage surged to 40K registered users, the company faced climbing infrastructure costs and slower generation speeds that threatened the user experience.

CoreWeave provided Kubernetes-powered infrastructure with dynamic GPU scaling and fast model loading to support NovelAI’s GPT-J 6B-based “Sigurd” storytelling model. With CoreWeave, NovelAI served requests 3x faster and cut cloud costs by 75%, delivering a significantly better performance-adjusted cost and more reliable generation speed even under peak load.

NovelAI

Eren Doğan

Chief Executive Officer