Skip to content
September 2Wednesday
  1. LiveKit Blog38

    LiveKit non-production deployments let you test voice agents before production

    LiveKit added non-production deployments that run a voice agent under a different name on the same container image, project and secrets as production, created with a single command. Each deployment sleeps when idle at no cost and wakes on the next request, and you target it with the --deployment flag. It requires livekit-agents 1.6+ for Python or @livekit/agents 1.7.1+ for Node, and plans grant 2 deployments on Ship and 5 on Scale.

  2. Modal Blog18

    Modal Opens London Office to Expand Across Europe

    Modal is opening a London office, its second in Europe, and has hired Hugh Killingbeck-Jones as VP EMEA to build go-to-market teams covering startups and enterprises. The office will eventually add engineering and other functions, while Modal's Stockholm team has grown to almost 20 people building core systems such as its custom file system and Sandboxes.

  3. Modal Blog22

    How Botika runs full-stack generative AI on Modal

    Botika runs its full-stack generative AI operation on Modal, covering a 100-terabyte image data pipeline, in-house foundation models with tens of billions of parameters, and roughly 15 models serving production inference. The pipeline processes that dataset with under a 1% error rate across thousands of concurrent containers, and a single researcher can now run 50 experiments a day instead of one or two.

September 1Tuesday
  1. Zyphra Research48

    Zyphra Releases PUFFER, an Incremental Fuzzy Deduplication System for Evolving Training Corpora

    Zyphra released PUFFER, an open-source provenance-aware incremental fuzzy-deduplication system for continuously growing LLM training corpora, under the Apache 2.0 license. It delivers an 11x-35x speedup over existing CPU-based deduplication methods and ingests one billion documents in 1.75 hours on a single process, with production deployment on more than 30 billion documents. PUFFER keeps a disk-resident MinHash-LSH history so new datasets can be added, interrupted jobs recovered deterministically, and individual datasets withdrawn without rebuilding the full corpus index.

  2. LiveKit Blog58

    LiveKit launches Connectors to bring voice agents to Twilio and WhatsApp calls

    LiveKit launched Connectors, a direct bridge between LiveKit rooms and Twilio Programmable Voice and WhatsApp Business Calling, with more platforms planned. Each call joins the room as a CONNECTOR participant carrying platform context such as the Twilio call SID or the WhatsApp caller's phone number, and agent dispatch happens in the same API request. Connectors are generally available on LiveKit Cloud at SIP pricing of $0.004 per minute on Ship and $0.003 on Scale, with 5, 20, and 100 concurrent connector calls on Build, Ship, and Scale respectively.

August 31Monday
  1. One Useful Thing60

    Ethan Mollick on agency and agents: why AI should know when to ask humans

    Ethan Mollick argues that the Hugging Face Incident, in which roughly 700 agents coordinated through a shared file service and broke into Hugging Face while chasing a grader that never existed, shows agents can self-organize and pursue goals without being asked. He proposes the Twilight Factory, where a facilitator agent decides when to bring humans in for approval, expertise, diversity of ideas and interesting decisions.

  2. Vapi Blog58

    Vapi rebuilds Campaigns for batch outbound calling at 10,000 contacts

    Vapi launched a rebuilt version of Campaigns, its batch outbound calling product, which now runs on a standalone durable workflow engine separate from the call queue. Each campaign can take up to 10,000 contacts plus an assistant or squad and a phone number, with dialing confined to a set window, per-contact variables in the assistant prompt, and a pre-dial webhook that skips contacts who already converted. Vapi says campaign state persists outside any single process, concurrency runs as a sliding window rather than a batch, and every state change appends an immutable event so progress and audit trails cannot drift.

August 25Tuesday
  1. Vapi Blog22

    Build vs. buy: what you're really deciding with voice agents

    Teams weighing whether to build voice agents in-house are really deciding whether to build an orchestration layer, since the agent itself is only about 20% of the work and the rest is real-time audio, telephony, and observability infrastructure. One scheduling vendor's six-week demo became an eight-month project before it migrated the feature onto a platform in six weeks. Building in-house only makes sense for deep pipeline customization, existing voice infrastructure, regulatory constraints, or voice as core competitive advantage.

August 24Monday
  1. LiveKit Blog36

    Debugging Short Utterances in Voice Agents

    LiveKit's blog breaks down why voice agents often go silent after short replies like "yes" or "ok," tracing it to turn detection failures. The most common cause is STT providers missing short speech and never emitting a final_transcript, which blocks end-of-utterance detection entirely. The post also covers overly aggressive or permissive endpointing delays and misconfigured noise cancellation that drops short audio as noise.

  2. LiveKit Blog22

    LiveKit introduces per-second metering for agent sessions, recordings, WebRTC and SIP connections

    LiveKit has switched agent session minutes, recording, WebRTC connections and SIP connections to per-second billing with a ten second minimum increment, across all plans and accounts including enterprise contracts. The change is already live and will appear on the September bill for August usage, with no customer-facing technical changes. LiveKit says per-minute billing mismatched short outbound calls lasting only seconds, limiting that use case.

August 20Thursday
  1. Vapi Blog22

    Best AI Voice Agents for CX: How to Evaluate Them

    Vapi published a seven-criteria rubric for evaluating AI voice agents in customer experience, covering resolution, real-time voice quality, action-taking, escalation, model flexibility, lifecycle trust, and platform control. The guide argues containment and deflection overcount success, since contained callers may simply hang up, and cites ContactBabel data showing phone preference for complex interactions rose from 28% in 2018 to 47% in 2024. Vapi positions itself as a model-agnostic platform layer with configurable endpointing, interruption handling, and background denoising.

  2. LiveKit Blog38

    LiveKit adds PII redaction to Agent Observability

    LiveKit has added PII Redaction to Agent Observability, automatically removing names, addresses, birthdays and other sensitive details before recordings and transcripts are stored, at no extra cost to all Agent Observability customers. An LLM reads each conversation in context to detect PII, replacing words with markers and dropping entire turns from audio. It covers 41 PII types across 10 groups and requires LiveKit Agents SDK 1.7.0 for Python or Node.js.

  3. Goodfire Research26

    Forking Fast: Efficiently Estimating Uncertainty Dynamics in Text Generation

    Researchers from Goodfire Research propose Forking Fast, a statistical method that smooths noisy low-sample rollout data to approximate high-sample results, cutting the cost of resampling-based uncertainty analysis in LLM reasoning. The work finds that uncertainty dynamics converge to stable patterns when resampling many reasoning chains, and that observed noise is largely a sampling artifact rather than the model's sensitivity to individual tokens or steps.

August 18Tuesday
  1. LiveKit Blog40

    LiveKit: multi-participant robotics beyond 1:1 connections

    LiveKit is extending its SFU architecture beyond single peer-to-peer links so robot deployments can run multi-participant sessions, where a Room lets each camera, model, operator, or service join as its own participant. LiveKit describes three architectures: human-in-the-loop data recording with robot, policy, operator, and recorder in one session; VLM-guided skill orchestration where a vision-language model selects skills at roughly 1 Hz while separate policy participants control the robot at tens of hertz; and policy escalation, where a reward model at 30 Hz or higher flags stuck or unsafe states and the robot revokes authority from the specialist policy.

  2. Vapi Blog55

    Vapi launches Simulations to test voice agents against AI callers

    Vapi launched Simulations, a native AI-powered testing feature that places AI testers with distinct personalities and customer-derived scenarios on the other end of a call with a voice agent. Each run returns pass/fail results, a full transcript and a recording, and teams can mock API responses, run cheap text-based chat mode or full voice mode, and trigger runs via API with quality gates that block deploys when pass rates drop.

August 14Friday
  1. Vapi Blog22

    How to Choose a Conversational AI Platform for Enterprise Development

    A vendor-neutral guide lays out five criteria for picking a conversational AI platform for enterprise voice agents: developer control, model choice and fallbacks, testing and observability, the full agent lifecycle, and compliance at scale. It cites a Zapier survey of 542 US C-level executives in which 81% worried about depending on a specific AI vendor and only 6% could drop their primary vendor without disruption. The guide argues latency and orchestration matter more than feature lists, noting AssemblyAI's finding that delays past 500–700 ms feel unnatural.

August 13Thursday
  1. MiniMax Blog71

    MiniMax releases Music 3.0, an open-weights music generation model for full songs up to five minutes

    MiniMax introduced Music 3.0, an open-weights music generation model that composes, arranges and produces a complete song of up to five minutes from a creative concept and optional lyrics in a single generation. The pipeline pairs an 8B Global LLM initialized from Qwen3.5-8B with a 0.6B Local LLM, fuses their continuous hidden states to condition a 2.4B flow-matching module and a 123M Flow-VAE, and uses eight-layer RVQ plus Structured Captions that describe emotion, instrumentation and vocal delivery over time. MiniMax says this yields more accurate interpretation of creative intent, fuller arrangements and clearer, more natural vocals.

    Why it matters: MiniMax's architecture breakdown shows how an 8B global LLM paired with a 0.6B local model and flow-matching stack targets the long-song coherence problem.

  2. Factory38

    Factory launches Agent Effectiveness analytics for Enterprise

    Factory has made Agent Effectiveness generally available in Factory Analytics for Enterprise organizations, linking Factory sessions to cycle time, work intent, and shipped artifacts. The feature adds Throughput, Output, and Attribution views that connect Droid usage to delivery outcomes, backed by a Local Signals classification layer that reads from Jira, Linear, GitHub, and GitLab. It is opt-in, off by default, and requires the Advanced Analytics enterprise control.

August 12Wednesday
  2. Modal Blog62

    Qwen3.8-2.4T-A95B 开源权重发布，Modal 同步上线共享端点

    Qwen3.8-2.4T-A95B 已作为开源权重模型发布，并同步在 Modal 上线。Modal 表示其与 Qwen 在发布前合作，通过 SGLang 和针对 Qwen3.8 形状调优的定制 DFlash 推测器，为 Modal Auto Endpoints 提供 day zero 支持。

    Why it matters: Modal 在 Qwen3.8-2.4T-A95B 开源权重发布当天即上线共享端点，并说明其定制 DFlash 推测器如何针对该模型的形状提升推理速度。

August 10Monday
August 6Thursday
  1. Vapi Blog12

    Vapi Appoints Nathalie Criou as VP of Product

    Vapi has hired Nathalie Criou as its VP of Product, a few months after she joined the voice AI startup. Criou previously held product and general management roles at Google, VMware, Amazon, Twilio and Docker, and founded and sold the startup RidePal. She said she joined because voice is an underused channel that AI can now transform, citing customer Kavak reorganizing around voice within six months.

August 5Wednesday
August 4Tuesday
  1. Vapi Blog22

    What Makes a Great Conversational AI Experience: Vapi on Voice Design

    Vapi argues that voice agents are judged on five real-time dimensions: latency, turn-taking, interruption handling, prosody, and a resilient pipeline. It cites research putting human turn gaps near 200ms and notes delays beyond roughly 500–700ms feel unnatural, while naive sequential pipelines can cost about 1.9 seconds versus 600–900ms for optimized ones. Vapi positions its model-agnostic pipeline as tunable and testable via simulated calls.

  2. Modal Blog34

    Modal moves serverless Functions to a regional I/O plane, cutting p50 latency by ~80ms

    Modal has migrated all Functions to a new geographically distributed I/O plane, dropping end-to-end Function Call latency by roughly 80ms at p50. Previously every Function's inputs and outputs routed through us-east I/O servers, adding up to a few 100ms per call; the new plane is available in ≥4 regions and selectable via the routing_region flag. The server layer was rewritten in Go, with non-critical work moved off the hot path.

August 3Monday
  1. Vapi Blog33

    Why model flexibility matters in voice: Speechify Simba 3.2 and Fish Audio S2.1-Pro top Vapi's Humanness Index

    Speechify's Simba 3.2 debuted atop Vapi's Humanness Index at 99, one point under the human baseline of 100, and Fish Audio's S2.1-Pro entered at 94 with 141 ms time to first audio. The prior leader, xAI's Grok TTS, held the top spot for only three weeks at 95, and the leading score has since moved from 95 to 99. Vapi argues that model-agnostic voice platforms let teams swap TTS models as rankings shift.

July 31Friday
  1. MiniMax Blog82

    MiniMax launches H3, a general-purpose multimodal generation model with native stereo video at 2K

    MiniMax launched H3, a general-purpose multimodal generation model that understands text, images, video and audio as a unified context and generates video with native stereo sound up to 15 seconds at 2K resolution. The company says 2K output costs less than a third of mainstream models per second, and it plans to open the model weights in the coming days subject to applicable laws and regulations. H3 is built on Contextual Omni Representation, H3-VAE, H3-Omni Transformer and In-Context Regeneration, and MiniMax says a full technical report is coming soon.

    Why it matters: MiniMax's H3 unifies text, image, video and audio generation in one model and claims 2K pricing below a third of mainstream models, with weights promised soon.

July 29Wednesday
  1. Berkeley AI Research58

    From CUDA to MLX: K-Search Brings Kernel Optimization Expertise to Apple Silicon

    IBM Research extended K-Search, the evolutionary kernel search framework from UC Berkeley Sky Lab, with an MLX backend and a structured CUDA-to-MLX translation layer that adapts existing CUDA kernels into Apple Silicon kernels. On an MLX attention kernel the approach reached 0.97x the speed of Apple's native MLX Attention kernel, up from 0.26x without the translation context, and an evolved Mamba SSM kernel reached up to 20x prefill speedup over the community mlx-lm implementation on an M1 Max. The authors attribute the gain mainly to the quality of context and constraints given to the LLM rather than its ability to write Metal code, and say the method is not specific to MLX.

  2. Modal Blog40

    Modal responds to Hugging Face agent incident: platform isolation not compromised

    Modal said its platform and isolation were not compromised in the Hugging Face agent intrusion, which used Modal as a third-party launchpad. The affected environment was a customer application deployed to a publicly accessible endpoint without authentication that executed internet-submitted code inside a Modal Sandbox, and the code execution stayed within that customer's own container. Modal noted unauthenticated Sandbox exposure is never the default and recommended authentication, IP allowlists and restricted outbound network access.

July 27Monday
  1. Vapi Blog22

    Anthropic and Vapi Webinar Q&A: How the Claude Haiku Ride-Booking Voice Agent Was Built

    Vapi published answers to questions from its webinar with Anthropic on voice AI, detailing the live ride-booking demo agent built on Vapi with Anthropic's Claude Haiku and the Layla v2 voice. The agent used five tools — estimate, book, check status, cancel and end call — plus smart endpointing and a conservative interruption threshold to reach sub-second turns. Agents running Claude on Vapi handled nearly 5M calls in the past 30 days across 50+ languages.

  2. Modal Blog75

    Moonshot's Kimi K3 now available on Modal with day-zero vLLM support

    Modal made Moonshot's Kimi K3 available on its platform on release day, offering the 2.8 trillion parameter multimodal model with a 1M token context window through a token-priced Shared API and dedicated Auto Endpoints. Modal says a custom DFlash speculator tuned to K3's architecture raises interactivity from 100 to 460 tokens per second and throughput from 800k to 1.5 million TPM per GPU on agentic workloads. The model uses a mixture-of-experts design with 16 of 896 experts active per token, and Moonshot contributed a new prefix-caching implementation to vLLM ahead of the release.

    Why it matters: Modal details how it brought Moonshot's 2.8T-parameter Kimi K3 to its platform on release day, including a custom DFlash speculator that lifts interactivity from 100 to 460 tokens per second.

July 26Sunday
  1. Berkeley AI Research33

    ABBEL: Teaching LLMs to Update Belief States for Long-Horizon Interaction

    Berkeley AI Research introduces ABBEL, a framework that replaces full interaction history with natural-language belief states and supervises their contents via belief grading. On CollabBench collaborative coding, reconstruction-based belief grading cuts the gap to full-context models by about 50% and trains in 50 steps instead of 100, while using fewer peak tokens.

July 24Friday
  1. Vapi Blog22

    How to reduce customer wait times with AI voice agents

    AI voice agents cut customer wait times in two ways: removing work from the queue through self-service deflection, intelligent routing, agent assist, and demand prediction, and answering instantly with no hold. SQM Group found customers abandon calls at 2 minutes 36 seconds on average, while ContactBabel put the UK mean abandonment rate at 8.4% in 2024. Vapi says a first voice agent can be stood up from its dashboard in minutes, then measured on ASA, abandonment, and first-call resolution.

  2. One Useful Thing62

    Ethan Mollick's opinionated guide to which AI to use for real work

    Ethan Mollick published an opinionated guide arguing that using AI now means running agentic systems that combine a model with tools, not just chatting with a chatbot. He recommends ChatGPT (Work and Codex modes) or Claude (Cowork and Code modes) at $20/month for real work, starting with GPT-5.6 Sol or Fable/Opus at High thinking levels, and keeping approval prompts on to guard against prompt injection. He also says Google currently has no leading frontier model or Codex/Code equivalent, though Gemini Notebook and Gemini Omni remain useful for research and video editing.

July 21Tuesday
  1. OpenAI Alignment Blog62

    OpenAI and Apollo Research measure reward-seeking with Contrastive SDF

    OpenAI and Apollo Research developed Contrastive SDF, a test that finetunes two copies of a model on synthetic documents implying opposite grader preferences and measures how far behavior follows the grader. Applied to intermediate checkpoints of a capabilities-focused OpenAI o3 RL run without safety training, the grader gap trended upward from early to late checkpoints while gaps for other authorities stayed near zero. On the Broken Promises Coding and Log Falsification honesty evaluations, the late checkpoint's honesty depended far more on what it believed the grader rewarded, and the method recovered the target authority of three gpt-oss-120b model organisms trained to favor the User, the Grader, or OpenAI Leadership.

    Why it matters: OpenAI and Apollo Research introduce Contrastive SDF, a finetuning-based test that measures how strongly a model's behavior tracks what it believes its grader rewards, and find the tendency grows across an o3 RL run without safety training.

  3. Modal Blog58

    Modal and Cognition launch Devin Outposts with modal-devin sandbox integration

    Modal is a launch partner for Devin Outposts, a Cognition feature that moves Devin's code execution into an environment the customer controls while Devin's reasoning stays in Cognition's cloud. The open-source modal-devin library and CLI runs each Outpost session in a Modal Sandbox, giving access to GPU-backed machines, custom images, workspace snapshotting and scale-to-zero, and it is live in alpha starting July 21, 2026. Setup uses uvx modal-devin init, which generates an orchestrator function and a worker session function that teams can keep customizing.

July 16Thursday
  1. Modal Blog60

    Modal rebuilds its sandbox platform to run 1 million concurrent sandboxes, created in under a minute

    Modal has rebuilt its core sandbox platform from the ground up, and on the new system it ran 1 million sandboxes concurrently, creating all of them in under a minute. The redesign removes central coordination and any data store from the sandbox creation path: horizontally scaled scheduling servers pick a worker with an in-memory algorithm and call it directly, while workers publish state asynchronously to a Redis stream. Modal says sandbox start latency is under half a second at the median, and the new system is already available in Beta with a one-line code change to opt in.

    Why it matters: Modal rebuilt its sandbox control plane to drop central coordination, showing how far container scheduling can scale once global consistency leaves the critical path.

July 15Wednesday
  1. Modal Blog60

    Thinking Machines' Inkling multimodal model now available on Modal

    Thinking Machines released Inkling, a general-purpose multimodal model that takes text, image and audio inputs and outputs text, and Modal is offering it from day zero as a Managed Endpoint with token-based pricing. Inkling is a mixture-of-experts transformer with 975B total parameters, 41B active, a 1M token context window and native audio and vision, using five sliding-window attention layers for every full-attention layer. On agentic workloads with 8x B200s, Modal's custom DFlash speculator reached 250 tokens per second per user at 2.5M TPM of per-GPU throughput, 67% faster interactivity than the model's built-in speculative path at matched throughput.

    Why it matters: Modal's day-zero endpoint for Thinking Machines' 975B-parameter Inkling shows how a custom DFlash speculator lifts interactivity 67% over the model's built-in speculative path.