Skip to content
MarkTechPost· Asif Razzaq·· 15 h agoAI score58

Sarvam launches Token Factory, an India-hosted inference platform serving 8 open models

Sarvam Launches Sarvam Token Factory: Bringing India-Hosted Inference to 8 Open Models

AI summary

Sarvam launched Sarvam Token Factory, an inference platform that serves its own Sarvam 105B and open-weight models such as GLM 5.3, DeepSeek V4.1 Flash 1017, Kimi K3.1 Pro and Gemma 4 31B from NVIDIA B200 clusters in India through one OpenAI-compatible API. The stack builds on vLLM, SGLang, Dynamo and Mooncake, and Sarvam reports that caching serves 95.7% of prompt tokens on DeepSeek V4.1 Flash, which handles 450B+ tokens per day. Introductory pricing starts at ₹10 input and ₹25 output per 1M tokens for Sarvam 105B through the end of 2026, and all benchmark numbers are self-reported, with Together AI still faster on DeepSeek V4.1 Flash streaming.

Source:MarkTechPost · marktechpost.com