Case Study: Glean.ai achieves 90%+ model accuracy and 30% lower costs with Cake

Glean.ai boosts accuracy to 90%+ and cuts costs 30% with Cake

Glean.ai, an accounts payable platform, needed a highly accurate AI solution to process financial documents but faced challenges with the high costs, reliability issues, and data privacy concerns of using external proprietary LLMs. To build a strategic advantage and improve their ML pipeline, they partnered with the vendor Cake and leveraged its all-in-one AIOps platform.

The solution involved using Cake's platform to develop, deploy, and manage a fine-tuned, in-house LLM. Cake provided key components like Llama Factory for fine-tuning and vLLM for inference. This move, facilitated by Cake, resulted in model accuracy jumping from 70% to over 90% and cut human-in-the-loop operating costs by more than 30%, saving Glean the equivalent of two and a half full-time engineering hires.

Glean.ai