Moonshot's Kimi K3 now available on Modal with day-zero vLLM support

Modal made Moonshot's Kimi K3 available on its platform on release day, offering the 2.8 trillion parameter multimodal model with a 1M token context window through a token-priced Shared API and dedicated Auto Endpoints. Modal says a custom DFlash speculator tuned to K3's architecture raises interactivity from 100 to 460 tokens per second and throughput from 800k to 1.5 million TPM per GPU on agentic workloads. The model uses a mixture-of-experts design with 16 of 896 experts active per token, and Moonshot contributed a new prefix-caching implementation to vLLM ahead of the release.