How Lemon Slice built real-time generative video with Modal and Daily

Lemon Slice built Lemon Slice Live, a product for real-time video conversations with AI characters, using Modal and Daily's low-latency primitives to reach an end-to-end video response latency of 3-6 seconds. The pipeline runs a Pipecat server and a 1B parameter video model on separate Modal containers that communicate via Modal's Tunnel and are co-located with region selection, with Deepgram, Grok and ElevenLabs handling speech-to-text, LLM response and text-to-speech. Earlier, two Python Modal Functions let Lemon Slice scale to 10,000 requests per hour without managing an ECS cluster, job queue or load balancer.