Modal Blog· Ben Shababo·· 29 d agoAI score34
Augment Your LiveKit Agent with Modal GPUs
Augment Your LiveKit Agent with Modal GPUs
AI summary
Modal explains how to run LiveKit Agents with open-weights or custom models on its serverless GPUs, using BitHuman's open-weights Expression Video Avatar voiced by Qwen3-TTS to clone Charles Frye. The setup exposes the avatar container's /launch endpoint via a Modal Server and uses Sticky Sessions to keep WebSocket clients on the same container, with GPU snapshots hiding cold starts.
Source:Modal Blog · modal.com