Skip to content

Fields

Voice & audio Latest

AI speech and audio: synthesis, real-time voice conversation, music generation and audio understanding.

6 picked6 in the last 30 days114 collected

November 10 00:00 updated

Voice & audio

November 10TuesdayItems 1–6 of 6
  1. Google Developers Blog72

    Google AI Edge Gallery adds on-device speech recognition and text-to-speech

    Google introduced on-device Automatic Speech Recognition and Text-to-Speech in Google AI Edge Gallery, letting apps run multilingual ASR and expressive TTS fully offline alongside on-device SLMs like Gemini Nano and Gemma 4. On Android, ML Kit's new speech models transcribe 100+ languages at 10x real-time speed with an 8.0% to 9.0% Word Error Rate on FLEURS, while the few-step diffusion TTS starts speaking in about 100 ms and generates 24 kHz audio at up to 50x real-time speed. Cross-platform support comes through MediaPipe Tasks and LiteRT with open-weight bundles including Parakeet-TDT 0.6B, PocketTTS 100M, Kokoro-82M and Phonon 31M, demonstrated in the XR Language Teacher showcase and voice-enabled AI Chat.

    Why it matters: Google adds fully offline ASR and TTS to AI Edge Gallery, with ML Kit reporting 100+ language transcription at 10x real time and a diffusion TTS that starts speaking in about 100 ms.

November 9Monday
  1. Zyphra Research78

    Zyphra releases ZONOS3-Mini, an Apache 2.0 zero-shot voice-cloning TTS model that runs on-device

    Zyphra released ZONOS3-Mini, a sparse MoE text-to-speech model with 100M active and 800M total parameters under Apache 2.0, trained on 112 NVIDIA H100s in 2.5 days. It reaches under 570 ms time-to-first-audio in the browser on a Pixel 9 and under 150 ms on an M3 MacBook Air, with runtimes for WebGPU, SGLang, vLLM and GGML. The model adds control over identity, accent, quality, mood and delivery, including word-level steering, and Zyphra reports it ranks first among open models on its new ZTTS2-Eval benchmark.

    Why it matters: Zyphra's compact MoE TTS model pairs zero-shot voice cloning with word-level delivery control while running in real time on phones and laptops.

November 6Friday
  1. Meta Newsroom · AI62

    Meta rolls out real-time voice and expressive avatars in its Muse app

    Meta is rolling out real-time voice conversations and expressive avatars in the Muse app on mobile, web and Mac, starting in the US. Users tap the phone icon to talk, can interrupt responses, and choose from hundreds of voices plus voice-only, avatar or full-screen modes. Voice is coming soon to AI Glasses and Muse Charm.

    Why it matters: Meta's Muse app now supports real-time voice conversations with expressive avatars, showing how voice and interruption handling are moving into consumer AI assistants.

October 20Tuesday
  1. Mistral AI82

    Mistral releases Voxtral 3 speech models and voice agent SDK

    Mistral released Voxtral 3, a family of speech-to-text and text-to-speech models plus a voice agent SDK built on LiveKit that streams listening, reasoning, tool calling and speaking in one pipeline. Voxtral Small Transcribe 3 covers 50+ languages with diarization and context biasing, Voxtral Mini TTS 3 supports 35+ languages and 50+ dialects, and the stack is available through Mistral's EU-hosted API or self-deployment. Pricing starts at $0.0035/min for batch transcription and $13 per 1M characters for TTS.

    Why it matters: Mistral's Voxtral 3 pairs multilingual speech models with a LiveKit-based voice agent SDK, giving teams a sovereign-deployable option for real-time voice agents.

October 15Thursday
  1. inclusionAI Repositories67

    inclusionAI releases Ming-3.0-audio-flash and Ming-3.0-audio-tiny audio models

    inclusionAI released Ming-3.0-audio-flash, a 126B-parameter Mixture-of-Experts audio model with 6.5B activated parameters, alongside the compact Ming-3.0-audio-tiny at 9.3B parameters with 2.7B activated. The flash model covers Chinese and English speech recognition across dialects and noisy multi-speaker settings, long-audio understanding, non-speech sound and music perception, audio reasoning, and end-to-end spoken dialogue with optional synthesized speech output. It ships with vLLM-Omni, SGLang, and Transformers inference paths under the MIT License, with default Flash profiles using tensor parallelism across four 80 GB H800 GPUs at 128K context.

    Why it matters: The release details a 126B-parameter MoE audio model with 6.5B activated parameters, plus a 9.3B tiny variant, giving a concrete reference for open audio-language model sizing and deployment.

  2. Apple Newsroom60

    Apple launches iPhone Duo, its first foldable iPhone with a 7.58-inch inner display

    Apple announced iPhone Duo, its first foldable iPhone, featuring the largest iPhone display yet: a 7.58-inch inner screen that is 50 percent larger than iPhone 18 Pro Max's display, plus a 5.4-inch outer display covering 90 percent of iPhone 18 Pro's screen area. It runs on the A20 Pro chip with a dual-battery architecture, and iOS 27 is reworked for the foldable form factor, including Split View for showing Siri and Mail side by side. Siri AI, powered by Apple Intelligence, is rolling out in beta with iOS 27 in English first and will not initially be available in the EU; Apple notes Siri AI and other new Apple Intelligence features will not be available in China.

    Why it matters: Apple's first foldable iPhone pairs a 7.58-inch inner display with a 5.4-inch outer screen and an A20 Pro chip, showing how iOS 27 and Siri AI are being adapted to a foldable form factor.