Skip to content
#Multimodal
  1. Apple Newsroom60

    Apple launches HomeView with Siri AI, priced at $299

    Apple released HomeView, a $299 home device that recognizes up to six people by face and shows their personal content in Messages, FaceTime, Calendar, Reminders, and Find My. Siri AI on HomeView adds onscreen awareness and can draw on a paired Apple Intelligence-enabled iPhone or iPad for personal context, with English support in the U.S., Australia, Canada, India, New Zealand, Singapore, South Africa, and the UK. Orders open today in Australia, Canada, India, New Zealand, Singapore, the UK, and the U.S., while the device is not sold in the EU because Siri AI is unavailable in iOS there.

    Why it matters: Apple's first home device with Siri AI shows how face recognition and personal context could turn a shared screen into a personalized assistant.

  2. Google DeepMind90

    Google DeepMind releases Gemini 4 Hydrogen, a faster Gemini 4 model for coding and agentic workflows

    Google DeepMind introduced Gemini 4 Hydrogen, a Gemini 4 model built for fast everyday coding and agentic execution rather than the long-horizon reasoning of Gemini 4 Carbon and Argon. It scores 51 on the Artificial Analysis Intelligence Index at its default high thinking level versus 50 for Argon, reaches 54 at a new xhigh setting, and is priced flat at $1.50 per million input tokens and $7.50 per million output tokens across its 1 million-token context window. Google also launched Orchestrator in Google Antigravity, which switches between models like Carbon and Hydrogen within a session and reached near-Carbon task success on Terminal-Bench 4.0 while using 24% less quota and finishing 19% faster.

    Why it matters: Google's Gemini 4 Hydrogen targets fast everyday coding and agentic work, with flat $1.50/$7.50 per million token pricing across a 1M context window and a new Orchestrator that switches between Gemini 4 models.

  1. vLLM Blog64

    vLLM-Omni benchmarks MiniMax H3-Image on Vera Rubin: 0.87s 4K generation and 6,115 images/hour

    vLLM-Omni brought MiniMax H3-Image to NVIDIA Vera Rubin and measured 0.87-second median latency for native 4096×4096 text-to-image on four GPUs, plus 6,115 images/hour in a separate throughput configuration. H3-Image is an open-weight text-to-image and editing model that pairs a Qwen3-VL encoder with a 33.1B dense DiT and an image VAE, handling both tasks in six sampling steps with up to 16 reference images. The team reports MXFP8 DiT GEMMs, Ulysses SP4, AdaLN caching and a VAE decoding change that cut decode time from 2.635s to 0.213s, and lists recipes for AMD, Intel, Huawei Ascend and Moore Threads hardware.

    Why it matters: vLLM-Omni's benchmark shows MiniMax H3-Image running on Vera Rubin at subsecond 4K latency, with per-hardware configurations and a cost model for serving economics.

  2. vLLM Blog60

    vLLM adds day-0 support for Thinking Machines' Inkling 2 Small

    vLLM supports Thinking Machines' Inkling 2 Small on day 0, a multimodal text-and-vision MoE with 594B total and 17B active parameters and up to 1M tokens of context. The integration adds kernel fusion with PDL, sequence parallelism for prefill that cuts an 8K-token prefill step by 22% at TP4 and 26% at TP8, and a Gluon relative attention decode kernel that drops a batch-1 decode step at 100K context from 15.1 ms to 4.8 ms. vLLM reports up to 630 TPS/user at TP4 on GB200 with acceptance length 3.5, and also supports LoRA and RL via SkyRL.

    Why it matters: vLLM 在发布当天即支持 Inkling 2 Small，并给出内核融合、序列并行和 Gluon 解码内核的具体优化数据，可供部署大 MoE 模型的团队参考。

  3. Google Blog · AI78

    Google launches Gemini Decisions API and Gemini Decision 1 model for fast closed-set decisions

    Google introduced the Gemini Decisions API, powered by the new Gemini Decision 1 model (gemini-decision-1) and available through the Gemini API in Google AI Studio. A single multimodal input of up to 256K tokens can be checked against up to 1,000 yes/no, multiple-choice and rubric-scoring questions in one forward pass, returning probabilities and confidence scores at 150-250 ms end-to-end latency for $0.10 per 1M input tokens with no output-token charges. Google says the model leads its benchmark suite with the lowest calibration error and is nearly 5x cheaper than Gemini 3.5 Flash-Lite with the Interactions API; internal uses include model routing in Gemini Notebook, wireframe generation in Stitch and adversarial-content checks for MCP tools in Search.

    Why it matters: Google's new endpoint scores up to 1,000 multimodal yes/no, choice and rubric questions in one pass at 150-250 ms, giving agent routing and policy checks a cheaper alternative to generative calls.

  1. Simon Willison82

    Simon Willison tests Gemini 4 Carbon in Antigravity IDE as Google opens access to all users

    Gemini 4 Carbon, announced two weeks ago for a subset of cyber defenders, is now available to everyone at $2/million input and $10/million output, with prices scheduled to double to $4/$20 on December 1st. Simon Willison tested it in Google's Antigravity IDE, generating a Three.js animation of a mech stomping through New York City using OpenStreetMap data, and noted that Google CEO Sundar Pichai highlighted Antigravity's /swarm feature building an open-world 3D game with Blender assets, WebGL shaders and Lyria music.

    Why it matters: Simon Willison tests Gemini 4 Carbon's coding and 3D generation in Antigravity IDE, offering a hands-on look at Google's newest model before its price doubles on December 1st.

  1. OpenRouter Announcements72

    OpenRouter benchmarks 15 vision models and Mistral OCR on scanned documents

    OpenRouter tested 15 vision models, Mistral OCR and Tesseract on eight self-made degraded scans, and Claude Opus 5.5 was most accurate with 262 of 264 key values correct at $16.42 per 1,000 pages, while Mistral OCR was best value at 258 of 264 for $2.02. On a faded receipt, GPT-6 Luna and GPT-6.1 Sol invented card digits, a server name and wifi passwords, errors that character error rates do not reveal. The post includes code to transcribe scans, turn reasoning off, cross-check two models from different labs and run Mistral OCR through the file-parser plugin.

    Why it matters: A hands-on benchmark of 15 vision models plus Mistral OCR and Tesseract on eight degraded scans, with runnable code for cross-checking two models to catch fabricated values.

  2. Claude YouTube78

    Anthropic releases Claude Fable 5.2 for ambitious technical work

    Anthropic released Claude Fable 5.2, a model designed for the most daunting technical challenges and ambitious open-ended projects, with improvements in coding, reasoning and vision. The company recommends starting with Opus 5.5 for most coding and knowledge tasks; Fable 5.2 is available today on Pro, Max, Team and Enterprise plans.

    Why it matters: Claude Fable 5.2 targets ambitious open-ended technical work, with stated gains in coding, reasoning and vision, while Opus 5.5 remains the recommended default for most coding and knowledge tasks.

  1. Meta AI Research Blog78

    Meta releases Muse Ember, its smallest and most efficient model for agent tasks

    Meta released Muse Ember, its smallest and most efficient model, aimed at the repetitive work agents do all day such as tool calls, coding subtasks, routing, extraction and long document parsing. Meta says it matches Claude Haiku 5.5's best score at about a third of the cost and beats every GPT-6 Luna setting, at $0.10 per million input tokens and $0.50 per million output tokens. It ships with a 1M-token context window, up to 512K output tokens, native text, image, audio and video input, and is available today on Muse Code and the Meta Model API as muse-ember-1.0.

    Why it matters: Meta's smallest model targets the high-volume agent steps, and its cost-per-task comparison against Claude Haiku 5.5 and GPT-6 Luna shows where the efficiency claim comes from.

  1. Meta Newsroom · AI62

    Meta rolls out real-time voice and expressive avatars in its Muse app

    Meta is rolling out real-time voice conversations and expressive avatars in the Muse app on mobile, web and Mac, starting in the US. Users tap the phone icon to talk, can interrupt responses, and choose from hundreds of voices plus voice-only, avatar or full-screen modes. Voice is coming soon to AI Glasses and Muse Charm.

    Why it matters: Meta's Muse app now supports real-time voice conversations with expressive avatars, showing how voice and interruption handling are moving into consumer AI assistants.

  2. Google DeepMind78

    Google DeepMind releases Gemini Omni 1.2 Flash with 15-second clips and 30% lower price

    Google DeepMind rolled out Gemini Omni 1.2 Flash, now generally available across the Gemini API and Gemini for business, with native 15-second video generation, multi-turn conversational editing and stronger reference following. The price drops 30% from Gemini Omni 1.1 to $0.07 per second for 720p video, and users can draft at 360p or 720p before upscaling to 1080p or 4K. Clips can be set from 3 to 15 seconds in one-second increments, and outputs carry an imperceptible SynthID watermark.

    Why it matters: Gemini Omni 1.2 Flash raises native clip length to 15 seconds and cuts the price 30% to $0.07 per second of 720p video, with multi-turn conversational editing now generally available.

  3. Google Blog · AI80

    Google releases Gemini Omni 1.2 Flash with 15-second clips and a 30% price cut

    Google DeepMind rolled out Gemini Omni 1.2 Flash and made it generally available across the Gemini API and Gemini for business. The model generates and edits native clips up to 15 seconds, up from 10 seconds in Omni 1.1, supports multi-turn conversational editing, and holds character, product, and style references more consistently; 720p video now costs $0.07 per second, 30% less than Omni 1.1. Outputs carry a SynthID watermark, and the model is rolling out in Flow, Google Vids, the Gemini app, and Google Ads.

    Why it matters: Gemini Omni 1.2 Flash cuts the price 30% to $0.07 per second for 720p video while extending native clips to 15 seconds, giving teams producing video at scale a cheaper option to compare against prior versions.

  1. Preferred Networks News71

    PFN releases PLaMo 3 Translate open-weight translation LLM for edge devices

    Preferred Networks released PLaMo 3 Translate, a translation-specialized LLM used in its PLaMo Translation service, as an open-weight model on Hugging Face on November 5. 8B, 2B, 8B and 31B) and supports 53 languages including Japanese and English, running on smartphones, laptops and internal servers without a cloud connection.

    Why it matters: PFN releases a translation-specialized LLM in four sizes from 0.8B to 31B, letting companies and individuals run 53-language translation on-device without cloud access.

  1. Meta AI Research Blog88

    Meta releases Muse Spark Open, an 816B open-weight multimodal model that runs on two Mac Studios

    Meta released the weights for Muse Spark Open, an open-weight natively multimodal model with 816B total parameters (42B active) and a 1M-token context window, positioned for coding and agentic work. It is the first model in its class to run on a desktop using two Apple M5 Ultra Mac Studios with the MLX framework, and it is available through API partners including Baseten, Fireworks AI, Groq, Modal, Nebius, OpenRouter and Together AI, with weights on Hugging Face, Amazon SageMaker AI, Google Cloud Model Garden and Microsoft Foundry Models. Meta says the model ships with auto-tunable Helion GPU kernels in SGLang, delivering 1.03-3.95x kernel-level speedups on NVIDIA and AMD GPUs and a 3% end-to-end speedup on AMD MI350.

    Why it matters: Meta releases open weights for an 816B-parameter multimodal model that runs on two Mac Studios, giving developers a local option for long-horizon coding and agentic tasks.

  1. Mistral AI82

    Mistral launches Mistral Large 4 preview, a 1T-parameter multimodal model with weights due this month

    Mistral has launched a public preview of Mistral Large 4, a 1 trillion-parameter natively multimodal model with 52 billion active parameters, available now through the Mistral Studio API. Mistral says the model is competitive with the strongest open-source models and outperforms other open-weight models from the US and Europe, scoring 82% on an Artificial Analysis Cyber Index vulnerability reproduction and patching test and 49.8% on its combined Coding Agent Index. The weights are set to be released by the end of the month, after red-teaming with cybersecurity partners and authorities; Mistral says the model was trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs in its own European datacenters.

    Why it matters: Mistral's largest model yet claims open-weight leadership in cybersecurity and agentic coding, with weights promised by month's end.

  1. MiniMax Blog71

    MiniMax releases Music 3.0, an open-weights music generation model for full songs up to five minutes

    MiniMax introduced Music 3.0, an open-weights music generation model that composes, arranges and produces a complete song of up to five minutes from a creative concept and optional lyrics in a single generation. The pipeline pairs an 8B Global LLM initialized from Qwen3.5-8B with a 0.6B Local LLM, fuses their continuous hidden states to condition a 2.4B flow-matching module and a 123M Flow-VAE, and uses eight-layer RVQ plus Structured Captions that describe emotion, instrumentation and vocal delivery over time. MiniMax says this yields more accurate interpretation of creative intent, fuller arrangements and clearer, more natural vocals.

    Why it matters: MiniMax's architecture breakdown shows how an 8B global LLM paired with a 0.6B local model and flow-matching stack targets the long-song coherence problem.

  1. MiniMax Blog82

    MiniMax launches H3, a general-purpose multimodal generation model with native stereo video at 2K

    MiniMax launched H3, a general-purpose multimodal generation model that understands text, images, video and audio as a unified context and generates video with native stereo sound up to 15 seconds at 2K resolution. The company says 2K output costs less than a third of mainstream models per second, and it plans to open the model weights in the coming days subject to applicable laws and regulations. H3 is built on Contextual Omni Representation, H3-VAE, H3-Omni Transformer and In-Context Regeneration, and MiniMax says a full technical report is coming soon.

    Why it matters: MiniMax's H3 unifies text, image, video and audio generation in one model and claims 2K pricing below a third of mainstream models, with weights promised soon.

  1. Modal Blog60

    Thinking Machines' Inkling multimodal model now available on Modal

    Thinking Machines released Inkling, a general-purpose multimodal model that takes text, image and audio inputs and outputs text, and Modal is offering it from day zero as a Managed Endpoint with token-based pricing. Inkling is a mixture-of-experts transformer with 975B total parameters, 41B active, a 1M token context window and native audio and vision, using five sliding-window attention layers for every full-attention layer. On agentic workloads with 8x B200s, Modal's custom DFlash speculator reached 250 tokens per second per user at 2.5M TPM of per-GPU throughput, 67% faster interactivity than the model's built-in speculative path at matched throughput.

    Why it matters: Modal's day-zero endpoint for Thinking Machines' 975B-parameter Inkling shows how a custom DFlash speculator lifts interactivity 67% over the model's built-in speculative path.

  1. MiniMax Blog87

    MiniMax M3 released with 1M context, frontier coding and native multimodality

    MiniMax released M3, an open-weight model it says is the first to combine frontier coding and agentic performance, a 1M-token context window, and native image and video input. M3 uses MiniMax's new MSA sparse attention architecture, which the company reports cuts per-token compute at 1M context to 1/20 of the previous generation and speeds prefill by more than 9x and decoding by more than 15x. It scores 59.0% on SWE-Bench Pro, 66.0% on Terminal-Bench 2.1 and 74.2% on MCP Atlas, and is available through MiniMax Code, the Token Plan and the API, with weights and a technical report promised within 10 days.

    Why it matters: MiniMax M3 combines a 1M-token context, frontier coding and agentic scores, and native image and video input in one open-weight model, with MSA cutting per-token compute at long context.

You are all caught up