Case Study: Maitai achieves low-latency, high-throughput inference with SambaNova Systems

Maitai uses SambaCloud to deliver Inference-as-a-Service

Maitai provides fully managed inference-as-a-service for enterprise customers, fine-tuning their models for specific applications and hosting them on the fastest hardware available. The company needed a way to deliver “no compromise inference” with ultra-low latency, high throughput, and strong accuracy, while also meeting enterprise requirements around reliability, privacy, and security. SambaNova Systems helped Maitai address these challenges with SambaCloud.

Using SambaCloud powered by the SN40L RDU, SambaNova Systems enables Maitai to quickly bring customer model checkpoints onto its platform and serve them with the performance its customers expect. The solution delivers the low latency and high throughput needed for production deployment, helping Maitai better satisfy enterprise customers that were struggling to move fine-tuned models from proof of concept to production.

Maitai

Christian Dal Santo

CEO and Founder