Skip to content
Only Models#On-device
  1. Hacker News · AI88

    Edge0 open-sources Edge0-145B and Edge0-120B on-device models with inference framework

    Edge0 open-sourced Edge0-145B and Edge0-120B along with its unified inference framework and deployment tools, claiming Edge0-145B is the first open-source 145B-parameter on-device model. The company reports 29GB peak memory, 1,100+ tokens/s prefill, 80+ tokens/s decode and roughly 120W typical power on a compatible laptop, with 128K–256K context. It cites internal scores of 64.6 on DeepSWE 1.1, 86.52 on Terminal-Bench 2.1, 90.4 on GPQA-Diamond and 80.6 on IFBench, and says weights are on Hugging Face with day-one support for macOS, Windows and Linux.

    Why it matters: Edge0 open-sources a 145B on-device model that reports 29GB peak memory and 80+ tokens/s decode, offering a concrete data point on how far local inference can scale.

  1. Zyphra Research78

    Zyphra releases ZONOS3-Mini, an Apache 2.0 zero-shot voice-cloning TTS model that runs on-device

    Zyphra released ZONOS3-Mini, a sparse MoE text-to-speech model with 100M active and 800M total parameters under Apache 2.0, trained on 112 NVIDIA H100s in 2.5 days. It reaches under 570 ms time-to-first-audio in the browser on a Pixel 9 and under 150 ms on an M3 MacBook Air, with runtimes for WebGPU, SGLang, vLLM and GGML. The model adds control over identity, accent, quality, mood and delivery, including word-level steering, and Zyphra reports it ranks first among open models on its new ZTTS2-Eval benchmark.

    Why it matters: Zyphra's compact MoE TTS model pairs zero-shot voice cloning with word-level delivery control while running in real time on phones and laptops.

  1. Preferred Networks News71

    PFN releases PLaMo 3 Translate open-weight translation LLM for edge devices

    Preferred Networks released PLaMo 3 Translate, a translation-specialized LLM used in its PLaMo Translation service, as an open-weight model on Hugging Face on November 5. 8B, 2B, 8B and 31B) and supports 53 languages including Japanese and English, running on smartphones, laptops and internal servers without a cloud connection.

    Why it matters: PFN releases a translation-specialized LLM in four sizes from 0.8B to 31B, letting companies and individuals run 53-language translation on-device without cloud access.

You are all caught up