Skip to content
Modal Blog· Ben Shababo·· 29 d agoAI score34

Augment Your LiveKit Agent with Modal GPUs

Augment Your LiveKit Agent with Modal GPUs

AI summary

Modal explains how to run LiveKit Agents with open-weights or custom models on its serverless GPUs, using BitHuman's open-weights Expression Video Avatar voiced by Qwen3-TTS to clone Charles Frye. The setup exposes the avatar container's /launch endpoint via a Modal Server and uses Sticky Sessions to keep WebSocket clients on the same container, with GPU snapshots hiding cold starts.

Source:Modal Blog · modal.com