Runitlocal.io is a site for running AI on your own hardware, pitched by "people who run it." It probes your GPU directly in the browser, with the GPU read locally and never sent to the site, and reports speeds as estimates unless marked measured. Users who benchmark their own rigs are invited to send in their results.
Air-LLM is an edge LLM inference architecture in which a central radio such as a 5G base station broadcasts model weights over the air, and edge users complete GEMV directly in the RF domain using RF mixers, so devices never store or load weights. Tested on NVIDIA Sionna ray-traced channels in two real urban scenes with a real RF mixer profile, it limits WikiText-2 perplexity degradation on LLaMA-3.1-8B to 4.0% while saving 157.7x/40.4x energy versus FP16 and weight-only quantization baselines. With 20 users, airtime is 104.1x/26.0x shorter, and because the central radio stays user-unaware, one broadcast serves unlimited users in coverage.
OwnOwl released a v0.2 test build of its iPhone app that runs a large language model entirely on-device, with no internet used for chatting. The update speeds up first replies by warming up on load and caching each conversation, adds longer default answers with a Continue button, and lets the app remember user-confirmed facts. It requires an iPhone with 6 GB of RAM or more and iOS 17 or newer, with model downloads of about 6 GB (GigaChat), 9 GB (Ling), or 14 GB (Gemma).
Aptiv engineering VP Guillermo Pita explains how end-to-end AI differs from traditional modular ADAS by training a single model to learn driving behavior directly from data instead of chaining separate perception, tracking, planning and control modules. He cites more human-like driving as the main advantage, with explainability and debugging as the key challenges, and names data diversity rather than raw mileage as the central training problem.
Edge0 open-sourced Edge0-145B and Edge0-120B along with its unified inference framework and deployment tools, claiming Edge0-145B is the first open-source 145B-parameter on-device model. The company reports 29GB peak memory, 1,100+ tokens/s prefill, 80+ tokens/s decode and roughly 120W typical power on a compatible laptop, with 128K–256K context. It cites internal scores of 64.6 on DeepSWE 1.1, 86.52 on Terminal-Bench 2.1, 90.4 on GPQA-Diamond and 80.6 on IFBench, and says weights are on Hugging Face with day-one support for macOS, Windows and Linux.
Why it matters: Edge0 open-sources a 145B on-device model that reports 29GB peak memory and 80+ tokens/s decode, offering a concrete data point on how far local inference can scale.
Liquid AI released LiquidCodec, a roughly 74M-parameter streaming speech tokenizer that powers its LFM3-Audio-2B and LFM3-Omni-2B models, with weights published on Hugging Face. The codec compresses 24 kHz audio into 12 token streams at 12.5 Hz frames and runs on a single CPU thread, where Liquid AI reports about 361x real-time encoding and 87x decoding. Liquid AI says it beat X-Codec 2, NanoCodec and Mimi on ViSQOL and mel distance across all 8 test sets, though NanoCodec still led PESQ (WB) on 7 of 8 sets.
Tether AI Research released BotPsy, a 0.8B-parameter agentic model built on Qwen3.5-0.8B for on-device personal-assistant tool use. It roughly doubles its base model's agentic scores, with BFCL v4 rising from 23.4 to 44.0 and τ-bench from 23.2 to 51.5, and beats every model up to 1.2B parameters tested across six tool-use benchmarks. It also cuts unsafe responses to 21% from 36% and uses about 3× fewer reasoning tokens on GPQA Diamond.
Google is bringing Gemini Intelligence to more Android devices, including the first Motorola Gemini Intelligence phone, motorola signature 27, up for U.S. pre-order on November 19, and Pixel 10, Pixel 10 Pro XL and Pixel 10 Pro Fold via today's Pixel Drop. New capabilities include Create My Widget, which builds custom widgets from a text description using Gmail, Calendar and Search data, and Device Assistance for controlling and fixing your phone by asking Gemini. Rambler is now available on Pixel 10 series and motorola signature 27, task automation expands to the UK, India and Japan, and Create My Widget is coming to Pixel Watch in the next few weeks.
Google introduced on-device Automatic Speech Recognition and Text-to-Speech in Google AI Edge Gallery, letting apps run multilingual ASR and expressive TTS fully offline alongside on-device SLMs like Gemini Nano and Gemma 4. On Android, ML Kit's new speech models transcribe 100+ languages at 10x real-time speed with an 8.0% to 9.0% Word Error Rate on FLEURS, while the few-step diffusion TTS starts speaking in about 100 ms and generates 24 kHz audio at up to 50x real-time speed. Cross-platform support comes through MediaPipe Tasks and LiteRT with open-weight bundles including Parakeet-TDT 0.6B, PocketTTS 100M, Kokoro-82M and Phonon 31M, demonstrated in the XR Language Teacher showcase and voice-enabled AI Chat.
Why it matters: Google adds fully offline ASR and TTS to AI Edge Gallery, with ML Kit reporting 100+ language transcription at 10x real time and a diffusion TTS that starts speaking in about 100 ms.
Zyphra released ZONOS3-Mini, a sparse MoE text-to-speech model with 100M active and 800M total parameters under Apache 2.0, trained on 112 NVIDIA H100s in 2.5 days. It reaches under 570 ms time-to-first-audio in the browser on a Pixel 9 and under 150 ms on an M3 MacBook Air, with runtimes for WebGPU, SGLang, vLLM and GGML. The model adds control over identity, accent, quality, mood and delivery, including word-level steering, and Zyphra reports it ranks first among open models on its new ZTTS2-Eval benchmark.
Why it matters: Zyphra's compact MoE TTS model pairs zero-shot voice cloning with word-level delivery control while running in real time on phones and laptops.
Google Research published a Nature study on AI-PPG-ACC-HTN, a multimodal system that detects signs of hypertension from smartwatch PPG and accelerometer data without cuff calibration. Validated against 24-hour ambulatory blood pressure monitoring in 196 participants across five US sites, it reached 65.8% sensitivity and 90.0% specificity for initial screening, and 78.4% sensitivity and 90.9% specificity for confirmatory testing. The authors describe the work as early feasibility research, not a replacement for clinical arm cuffs or a standalone diagnosis.
Why it matters: Google's cuffless smartwatch hypertension model is benchmarked against 24-hour ambulatory monitoring, showing how passive multi-day sensor aggregation could support opportunistic screening.
Waymo is readying its fleet for severe winter weather, including a historic El Niño season, by expanding the 6th-generation Waymo Driver's cold-weather capabilities. The system combines cameras, radar and lidar with built-in heaters and micro-wipers, measures real-time traction at each wheel, and uses snow tires, while vehicles act as mobile weather stations sharing road data across the fleet. Waymo says it will slow, limit or pause service when conditions exceed its Safety Framework boundaries, and is running closed-course testing and heavy-snowfall data collection in Alaska this season.
Preferred Networks released PLaMo 3 Translate, a translation-specialized LLM used in its PLaMo Translation service, as an open-weight model on Hugging Face on November 5. 8B, 2B, 8B and 31B) and supports 53 languages including Japanese and English, running on smartphones, laptops and internal servers without a cloud connection.
Why it matters: PFN releases a translation-specialized LLM in four sizes from 0.8B to 31B, letting companies and individuals run 53-language translation on-device without cloud access.
Nanbeige has released Nanbeige4.3-33B, an open-weights dense reasoning model under Apache 2.0 that scores 20 on the Artificial Analysis Intelligence Index v5, matching Qwen3.8 27B (xhigh) at 20. The 33B model has a 524K-token context window, text-only input and output, and no confirmed public APIs, and it scores 30% on Terminal-Bench 4.0 versus 6% for Qwen3.8 27B while trailing on HLE-Diamond (7% vs. 15%). On AA-Omniscience v1.1 it records an 18% hallucination rate versus 29% for Qwen3.8 27B, with a 71% decline rate, and it uses 158K output tokens per Intelligence Index task versus 110K for Qwen3.8 27B.
Google 在 Google Play services 中发布 LiteRT 端侧推理运行时，其 GPU 推理速度约为旧版 GPU delegate 的 1.4 倍，并新增 CompiledModel API。
Apple announced a new iMac powered by the M6 chip, featuring an up-to-12-core CPU and GPU with Neural Accelerators in each core, plus a Dual 16-core Neural Engine for up to 5x faster on-device AI than M4. Apple claims up to 18x faster performance than the most popular Intel-based iMac and up to 12x faster AI prompt processing in LM Studio versus M1. Pre-orders open October 28, with availability from Friday, November 6.
Apple announced the new 14-inch MacBook Pro with M6, featuring a 12-core CPU and 12-core GPU that deliver up to 30 percent faster graphics and up to 25 percent faster AI workloads than M5. The chip adds a Dual 16-core Neural Engine and GPU Neural Accelerators for on-device AI, with up to 24 hours of battery life, Wi-Fi 7, and Bluetooth 6. Pre-orders open October 28, with availability starting Friday, November 6.
Apple unveiled the all-new iPad mini, featuring an 8.5-inch OLED display with more than 2x the peak brightness of the previous generation, a thinner and lighter design, and the A20 Pro chip with Neural Accelerators in each GPU core and a Dual 16-core Neural Engine. It adds IP67 water and dust resistance, a 12MP Center Stage front camera, and Apple Intelligence with on-device processing and Private Cloud Compute. Pre-orders start October 28 in 36 countries and regions, with prices from $699 for the Wi-Fi model and $849 for Wi-Fi + Cellular.
Waymo is expanding its fully autonomous ride-hailing service to Toronto, its first Canadian market, with a goal of welcoming its first riders in 2028. Waymo vehicles will begin driving manually on Toronto streets in the coming days as part of a phased, safety-first validation process starting with high-definition mapping. The company is partnering with Toronto-based Element Fleet Management and plans to invest in hundreds of roles across fleet maintenance, validation driving and customer service.
Apple announced iPhone Duo, its first foldable iPhone, featuring the largest iPhone display yet: a 7.58-inch inner screen that is 50 percent larger than iPhone 18 Pro Max's display, plus a 5.4-inch outer display covering 90 percent of iPhone 18 Pro's screen area. It runs on the A20 Pro chip with a dual-battery architecture, and iOS 27 is reworked for the foldable form factor, including Split View for showing Siri and Mail side by side. Siri AI, powered by Apple Intelligence, is rolling out in beta with iOS 27 in English first and will not initially be available in the EU; Apple notes Siri AI and other new Apple Intelligence features will not be available in China.
Why it matters: Apple's first foldable iPhone pairs a 7.58-inch inner display with a 5.4-inch outer screen and an A20 Pro chip, showing how iOS 27 and Siri AI are being adapted to a foldable form factor.
Apple introduced Apple HomeView, a 7-inch Liquid Retina smart home display that combines entertainment, FaceTime calls, home monitoring and hands-free automation, priced at $299 in the U.S. The device recognizes users by face to surface their personal content and runs Siri AI, a new more conversational version of Siri that can draw on personal context when paired with an Apple Intelligence-enabled iPhone or iPad. Pre-orders opened October 13 in Australia, Canada, India, New Zealand, the UK and the U.S., with availability starting Friday, November 13; Apple says HomeView is not for sale in the European Union because Siri AI is currently unavailable in iOS there.
Apple announced the fourth-generation Apple TV 4K, featuring Siri AI, a new version of Siri powered by the next generation of Apple Intelligence that offers a full-screen conversational search experience. Built-in far-field microphones enable hands-free Siri use, and with an Apple Intelligence-enabled iPhone the assistant can answer personal-context requests such as playing a show a friend recommended. The device is priced at $299 in the U.S., with pre-orders open in the U.S. and 29 other countries and regions and in-store availability starting Friday, November 13; Siri AI is available as a beta on Apple TV 4K (2nd generation or later) in eight English-language markets at launch.