Skip to content
#On-device
  1. Hacker News · AI88

    Edge0 open-sources Edge0-145B and Edge0-120B on-device models with inference framework

    Edge0 open-sourced Edge0-145B and Edge0-120B along with its unified inference framework and deployment tools, claiming Edge0-145B is the first open-source 145B-parameter on-device model. The company reports 29GB peak memory, 1,100+ tokens/s prefill, 80+ tokens/s decode and roughly 120W typical power on a compatible laptop, with 128K–256K context. It cites internal scores of 64.6 on DeepSWE 1.1, 86.52 on Terminal-Bench 2.1, 90.4 on GPQA-Diamond and 80.6 on IFBench, and says weights are on Hugging Face with day-one support for macOS, Windows and Linux.

    Why it matters: Edge0 open-sources a 145B on-device model that reports 29GB peak memory and 80+ tokens/s decode, offering a concrete data point on how far local inference can scale.

  1. Google Developers Blog72

    Google AI Edge Gallery adds on-device speech recognition and text-to-speech

    Google introduced on-device Automatic Speech Recognition and Text-to-Speech in Google AI Edge Gallery, letting apps run multilingual ASR and expressive TTS fully offline alongside on-device SLMs like Gemini Nano and Gemma 4. On Android, ML Kit's new speech models transcribe 100+ languages at 10x real-time speed with an 8.0% to 9.0% Word Error Rate on FLEURS, while the few-step diffusion TTS starts speaking in about 100 ms and generates 24 kHz audio at up to 50x real-time speed. Cross-platform support comes through MediaPipe Tasks and LiteRT with open-weight bundles including Parakeet-TDT 0.6B, PocketTTS 100M, Kokoro-82M and Phonon 31M, demonstrated in the XR Language Teacher showcase and voice-enabled AI Chat.

    Why it matters: Google adds fully offline ASR and TTS to AI Edge Gallery, with ML Kit reporting 100+ language transcription at 10x real time and a diffusion TTS that starts speaking in about 100 ms.

  1. Zyphra Research78

    Zyphra releases ZONOS3-Mini, an Apache 2.0 zero-shot voice-cloning TTS model that runs on-device

    Zyphra released ZONOS3-Mini, a sparse MoE text-to-speech model with 100M active and 800M total parameters under Apache 2.0, trained on 112 NVIDIA H100s in 2.5 days. It reaches under 570 ms time-to-first-audio in the browser on a Pixel 9 and under 150 ms on an M3 MacBook Air, with runtimes for WebGPU, SGLang, vLLM and GGML. The model adds control over identity, accent, quality, mood and delivery, including word-level steering, and Zyphra reports it ranks first among open models on its new ZTTS2-Eval benchmark.

    Why it matters: Zyphra's compact MoE TTS model pairs zero-shot voice cloning with word-level delivery control while running in real time on phones and laptops.

  1. Google Research72

    Google researchers detect hypertension signs with smartwatch PPG and accelerometer data, no cuff calibration needed

    Google Research published a Nature study on AI-PPG-ACC-HTN, a multimodal system that detects signs of hypertension from smartwatch PPG and accelerometer data without cuff calibration. Validated against 24-hour ambulatory blood pressure monitoring in 196 participants across five US sites, it reached 65.8% sensitivity and 90.0% specificity for initial screening, and 78.4% sensitivity and 90.9% specificity for confirmatory testing. The authors describe the work as early feasibility research, not a replacement for clinical arm cuffs or a standalone diagnosis.

    Why it matters: Google's cuffless smartwatch hypertension model is benchmarked against 24-hour ambulatory monitoring, showing how passive multi-day sensor aggregation could support opportunistic screening.

  1. Preferred Networks News71

    PFN releases PLaMo 3 Translate open-weight translation LLM for edge devices

    Preferred Networks released PLaMo 3 Translate, a translation-specialized LLM used in its PLaMo Translation service, as an open-weight model on Hugging Face on November 5. 8B, 2B, 8B and 31B) and supports 53 languages including Japanese and English, running on smartphones, laptops and internal servers without a cloud connection.

    Why it matters: PFN releases a translation-specialized LLM in four sizes from 0.8B to 31B, letting companies and individuals run 53-language translation on-device without cloud access.

  1. Apple Newsroom60

    Apple launches iPhone Duo, its first foldable iPhone with a 7.58-inch inner display

    Apple announced iPhone Duo, its first foldable iPhone, featuring the largest iPhone display yet: a 7.58-inch inner screen that is 50 percent larger than iPhone 18 Pro Max's display, plus a 5.4-inch outer display covering 90 percent of iPhone 18 Pro's screen area. It runs on the A20 Pro chip with a dual-battery architecture, and iOS 27 is reworked for the foldable form factor, including Split View for showing Siri and Mail side by side. Siri AI, powered by Apple Intelligence, is rolling out in beta with iOS 27 in English first and will not initially be available in the EU; Apple notes Siri AI and other new Apple Intelligence features will not be available in China.

    Why it matters: Apple's first foldable iPhone pairs a 7.58-inch inner display with a 5.4-inch outer screen and an A20 Pro chip, showing how iOS 27 and Siri AI are being adapted to a foldable form factor.

You are all caught up