Skip to content
  1. Hugging Face Blog69

    IBM releases LLMON preview models built on Granite 4.1 3B and 8B

    IBM released two experimental preview models, granite-4.1-3b-LLMON-preview and granite-4.1-8b-LLMON-preview, derived from Granite 4.1 base checkpoints and trained to consume and generate LLMON, an LLM-native markup language that marks instructions, data and requirements with reserved special-token delimiters. On the OPI benchmark the models avoid 47% more indirect prompt injection attacks than the best frontier model tested and 95% more than the best open-source model, while performing on par with Granite 4.1 Instruct on standard benchmarks. The release includes a GitHub toolkit with lossless JSON-to-LLMON converters, and the authors note the preview is for exploration, not production.

    Why it matters: IBM trained a preview model on Granite 4.1 that can read and write LLMON tags, using explicit instruction-data separation to reduce the indirect prompt injection success rate on the OPI benchmark to near zero while maintaining general capabilities.

  2. AWS Machine Learning Blog66

    AWS updates AgentCore runtime with 15x faster session starts and 4x more compute

    AWS announced updates to Amazon Bedrock AgentCore runtime, its managed compute layer for agents, with sessions now starting up to 15x faster, scaling to 4x more compute (up to 8 vCPUs and 32 GB, with container images up to 10 GB) and running up to 68% more efficiently, while each session stays in its own hardware-isolated Firecracker MicroVM. Sessions start in under 2 seconds regardless of image size or concurrency, idle agents scale to zero, and agents can mount and save work to a filesystem such as an Amazon S3 bucket with FUSE support so data stays inside the trust boundary. The runtime is available today in AWS Regions across North America, South America, Europe, and Asia Pacific.

    Why it matters: AgentCore runtime 的新版本把会话启动、算力上限和内存计费一起调整,为需要长时间运行的智能体提供了隔离与成本之间的新取舍。

  3. Google DeepMind90

    Google DeepMind releases Gemini 4 Hydrogen, a faster Gemini 4 model for coding and agentic workflows

    Google DeepMind introduced Gemini 4 Hydrogen, a Gemini 4 model built for fast everyday coding and agentic execution rather than the long-horizon reasoning of Gemini 4 Carbon and Argon. It scores 51 on the Artificial Analysis Intelligence Index at its default high thinking level versus 50 for Argon, reaches 54 at a new xhigh setting, and is priced flat at $1.50 per million input tokens and $7.50 per million output tokens across its 1 million-token context window. Google also launched Orchestrator in Google Antigravity, which switches between models like Carbon and Hydrogen within a session and reached near-Carbon task success on Terminal-Bench 4.0 while using 24% less quota and finishing 19% faster.

    Why it matters: Google's Gemini 4 Hydrogen targets fast everyday coding and agentic work, with flat $1.50/$7.50 per million token pricing across a 1M context window and a new Orchestrator that switches between Gemini 4 models.

  4. Google Blog · AI82

    Google Search upgrades globally to Gemini 4 Hydrogen

    Google Search has moved all users worldwide to Gemini 4 Hydrogen, which the company calls its biggest model upgrade to Search yet. The model improves intent understanding for multi-part and typo-heavy questions, adds deeper instruction following and tool calling, and strengthens query fan-out to surface links users might not otherwise find. Responses also become more visual, with more images, comparison tables and custom tools, across all supported AI Mode languages.

    Why it matters: Google Search's largest model upgrade to date, with Gemini 4 Hydrogen now handling multi-part questions, tool calling and query fan-out for all users globally.

  5. AWS Machine Learning Blog60

    AWS open-sources UAEF, a framework-agnostic evaluation system for AI agents

    AWS has open-sourced UAEF (Universal Agent Evaluation Framework), a framework-agnostic system that uses adapters to normalize agent traces from LangGraph, LangChain, Strands Agents, Amazon Bedrock AgentCore and Langfuse into one canonical AgentTrace, then scores them with 36 built-in metrics across 7 dimensions. Results are stored per experiment in Amazon DynamoDB and Amazon S3, so teams can compare agent versions against a baseline, flag regressions with a default 5 percent threshold, and generate statistical reports plus LLM-written insights. The post says customers across 12 organizations in telecom, healthcare and financial services used UAEF before release, and the Apache 2.0 code, Python library, CDK deployment and per-framework notebooks are in the awslabs/uaef GitHub repository.

    Why it matters: The AWS team has open-sourced UAEF, which uses adapters to unify agent trajectories from different frameworks into a single format, then scores them across 7 dimensions using 36 metrics, providing a reusable evaluation layer for comparing agent versions across frameworks.

  6. Replit Blog65

    Replit Agent adds Link and Visa purchasing plus Google Ads campaign creation

    Replit Agent now has two new jobs: buying business supplies through Link and Visa, and building Google Ads campaigns across Search, YouTube, Display and Discover. In the purchasing flow, a browser subagent navigates the merchant site and prepares checkout, then waits for the owner to approve the final total; shell access and general browsing are disabled during payment and approval checks are enforced in code. Agentic Commerce is available for Core and Pro users starting in the US with one-time purchases only, while Agentic Ads is available for Pro users worldwide.

    Why it matters: Replit Agent now handles purchasing and Google Ads campaigns, with code-enforced approval gates that show how agent spending limits can be designed.

  1. NVIDIA Newsroom88

    NVIDIA Announces CEO Transition as Jensen Huang Resigns, Colette Kress Named Interim CEO

    NVIDIA's board announced that Jensen Huang has resigned as President, CEO and board member effective immediately, with Executive Vice President and CFO Colette Kress serving as Interim CEO while the board searches for a permanent successor. The board also appointed Harvey C. Jones, former CEO and Executive Chairman of Synopsys, as its first-ever Chair of the Board, and said it expects operations, customer commitments and product roadmap to continue without interruption. NVIDIA said it will report third-quarter fiscal 2027 results on November 17 as previously scheduled.

    Why it matters: NVIDIA's board names CFO Colette Kress as interim CEO after Jensen Huang's immediate resignation, with Harvey Jones becoming first board chair.

  2. vLLM Blog64

    vLLM-Omni benchmarks MiniMax H3-Image on Vera Rubin: 0.87s 4K generation and 6,115 images/hour

    vLLM-Omni brought MiniMax H3-Image to NVIDIA Vera Rubin and measured 0.87-second median latency for native 4096×4096 text-to-image on four GPUs, plus 6,115 images/hour in a separate throughput configuration. H3-Image is an open-weight text-to-image and editing model that pairs a Qwen3-VL encoder with a 33.1B dense DiT and an image VAE, handling both tasks in six sampling steps with up to 16 reference images. The team reports MXFP8 DiT GEMMs, Ulysses SP4, AdaLN caching and a VAE decoding change that cut decode time from 2.635s to 0.213s, and lists recipes for AMD, Intel, Huawei Ascend and Moore Threads hardware.

    Why it matters: vLLM-Omni's benchmark shows MiniMax H3-Image running on Vera Rubin at subsecond 4K latency, with per-hardware configurations and a cost model for serving economics.

  3. vLLM Blog60

    vLLM adds day-0 support for Thinking Machines' Inkling 2 Small

    vLLM supports Thinking Machines' Inkling 2 Small on day 0, a multimodal text-and-vision MoE with 594B total and 17B active parameters and up to 1M tokens of context. The integration adds kernel fusion with PDL, sequence parallelism for prefill that cuts an 8K-token prefill step by 22% at TP4 and 26% at TP8, and a Gluon relative attention decode kernel that drops a batch-1 decode step at 100K context from 15.1 ms to 4.8 ms. vLLM reports up to 630 TPS/user at TP4 on GB200 with acceptance length 3.5, and also supports LoRA and RL via SkyRL.

    Why it matters: vLLM 在发布当天即支持 Inkling 2 Small,并给出内核融合、序列并行和 Gluon 解码内核的具体优化数据,可供部署大 MoE 模型的团队参考。

  4. vLLM Blog72

    vLLM serves DeepSeek-V4.1-Flash on Vera Rubin NVL72 at 58x GB300 NVL72 throughput

    vLLM reports serving DeepSeek-V4.1-Flash on a single NVIDIA Vera Rubin NVL72 rack at 1.7M tokens/s per GPU with 387 tokens/s per user, 58x the GB300 NVL72, peaking at 2.52M tokens/s and 1,810 tokens/s for a single user. The gains come from kernels rebuilt for Rubin's split memory domains and FP4 tensor cores, a specialized TP8 decode path, and rack-wide KV and Engram pools shared over NVLink. With prefixes pooled across the rack and Dynamo workload-aware routing, the prefix hit rate holds at 96.5-97% even at high concurrency.

    Why it matters: vLLM's third DeepSeek-V4.1-Flash post details how Rubin-specific kernels and rack-wide memory pooling lift throughput 58x over GB300 NVL72, offering a concrete reference for large-scale serving optimization.

  5. Google Blog · AI78

    Google launches Gemini Decisions API and Gemini Decision 1 model for fast closed-set decisions

    Google introduced the Gemini Decisions API, powered by the new Gemini Decision 1 model (gemini-decision-1) and available through the Gemini API in Google AI Studio. A single multimodal input of up to 256K tokens can be checked against up to 1,000 yes/no, multiple-choice and rubric-scoring questions in one forward pass, returning probabilities and confidence scores at 150-250 ms end-to-end latency for $0.10 per 1M input tokens with no output-token charges. Google says the model leads its benchmark suite with the lowest calibration error and is nearly 5x cheaper than Gemini 3.5 Flash-Lite with the Interactions API; internal uses include model routing in Gemini Notebook, wireframe generation in Stitch and adversarial-content checks for MCP tools in Search.

    Why it matters: Google's new endpoint scores up to 1,000 multimodal yes/no, choice and rubric questions in one pass at 150-250 ms, giving agent routing and policy checks a cheaper alternative to generative calls.

  6. Claude Blog78

    Anthropic launches Claude Meetings in beta for Google Meet on Team and Enterprise plans

    Anthropic released Claude Meetings in beta, letting Claude join Google Meet calls as a visible participant that answers questions in chat, builds docs and whiteboards live, and writes notes and action items. Each meeting gets a page in claude.ai with the transcript, notes and artifacts, and by default Claude stays out of calls with external guests unless an admin allows it. The beta is rolling out on Team and Enterprise plans, is unavailable to some organizations including ZDR, HIPAA-ready and CMEK setups, and notes, transcripts and in-call answers are free during the beta.

    Why it matters: Anthropic's beta launch shows how a meeting agent can draft docs, pull connected-tool data and write notes inside a live call, with default rules for excluding external guests.

  7. Claude Blog78

    Anthropic makes Claude Opus 5.5 the default model on Pro, Max, Ultra and Team plans

    Claude Opus 5.5 is now the default model in Claude on Pro, Max, Ultra and Team plans, and Anthropic recommends it as the daily driver for research, analysis and finished documents, decks and spreadsheets. Anthropic says Opus 5.5 at Medium effort matched or beat Opus 5 at High on its coding and knowledge-work evaluations, and in an internal merger-analysis test it finished in 63 minutes at half the cost of Opus 5 on the same task. The post also lists prompting changes for the new model, including dropping 'think hard' instructions, starting at Medium effort and attaching charts instead of retyping their values.

    Why it matters: Anthropic's own guide explains why Opus 5.5 is now the default for daily knowledge work and which prompting habits to drop for it.

  1. Google DeepMind72

    DeepMind releases AlphaGenome 2, a DNA model predicting variant effects in specific cell types

    Google DeepMind announced AlphaGenome 2, a next-generation DNA sequence model that predicts how DNA sequences and their variants affect specific human cell types. Trained on more than 107 million individual cell profiles across 68 tissues, the conditional model identified nearly twice as many expression-changing variants as the previous model, and on the TenK10K immune cell dataset it recovered 30% of causal variants versus 16% for the original AlphaGenome fine-tuned on single-cell data. It is available for non-commercial research via the AlphaGenome API and in private preview for commercial research.

    Why it matters: AlphaGenome 2 shifts from bulk-tissue averages to single-cell conditioning, roughly doubling causal variant recall on immune cell data, which matters for linking GWAS signals to specific cell types.

  2. OpenRouter Announcements65

    OpenRouter measures the context cost of MCP, CLI and skills on one GitHub task

    OpenRouter measured the same GitHub task across the GitHub MCP server, the gh CLI and a gh skill on Claude Sonnet 5.5, GPT-6 Luna and Gemini 3.8 Flash. On Sonnet 5.5 all three answered correctly, but the CLI used 1,421 input tokens, the skill 3,315 and the MCP server 59,417 with its 46 default tools, whose definitions alone add 19,436 tokens per request. Scoping the server to two tools cut the task to 23,228 tokens, capping results at 4,000 characters brought it to 5,357, and Tool Search cut the up-front cost of 46 tools to under 600 tokens, though it halved the whole-task cost on Sonnet 5.5 while raising it on Claude Haiku 5.5.

    Why it matters: OpenRouter's measured comparison shows how much context an MCP server, a CLI and a skill each consume on the same GitHub task, and where trimming tool results or deferring definitions changes the bill.

  3. OpenRouter Announcements60

    OpenRouter tests what fp8 and fp4 quantization do to LLM quality and price

    OpenRouter ran 280 exact-answer tasks against six endpoints of Qwen3.8 27B on October 20, 2026 and did not detect an accuracy difference between fp16, fp8 and fp4, with all six scoring between 98.3% and 99.2%. Across 1,455 endpoints, 59.5% report no precision at all and fp8 is the most common labeled format at 23.6%. Lower precision was cheaper for most models but not all, and provider choice moved price more than precision did, with the priciest same-precision endpoint a median 1.72 times the cheapest.

    Why it matters: OpenRouter measured fp8, fp4 and fp16 endpoints of one model across 240 exact-answer tasks and found no detectable accuracy gap, while price differences tracked the provider more than the precision.

  4. Microsoft Research75

    Microsoft researchers describe Lazarus, a backdoor that reprograms dormant neurons in AI agents

    Microsoft researchers have described Lazarus, a backdoor technique that reprograms fewer than 10 dormant neurons in an LLM so an agent built on it emits attacker commands when a hidden trigger appears, with no retraining required. The modified model still passes standard evaluations and behaves normally until the trigger, which can be as simple as a date change, and the agent then runs the downloaded code with whatever access it was given. The authors say detection requires diffing against the original weights, and Microsoft Foundry already ties open-weight models to their publishers and scans their containers, while red-teaming harnesses, agent-based weight scanning and signed models with tamper-evident provenance are in development.

    Why it matters: Microsoft researchers show that reprogramming fewer than 10 dormant neurons can backdoor an LLM agent without retraining, which makes weight provenance and integrity a practical security requirement.

  5. LangChain Blog60

    LangChain explains how Deep Agents manages context without keeping everything in the window

    LangChain details how its open source Deep Agents harness uses middleware to fight context rot on long agent runs. Tool results over roughly 20,000 tokens and user messages over 50,000 tokens are offloaded to files with only a preview shown, while summarization condenses older messages once usage hits 85% of the context window. Skills, subagents and a markdown long-term memory file keep the main agent's window small and let memory carry over across models and providers.

    Why it matters: LangChain explains how its open source Deep Agents harness uses middleware to offload, summarize and isolate context, offering a reusable pattern for agents on long tasks.

  6. MiniMax Blog75

    MiniMax releases H3-Image, an open-weight model generating 4K images in under 10 seconds

    MiniMax released H3-Image, an open-weight image generation model built on H3 that supports text-to-image, reference-based generation and image editing, and can produce a 4096 × 4096 image in under 10 seconds. The company says it handles up to 16 reference images, claims state-of-the-art prompt adherence among open-weight models, and reports speeds up to 5× mainstream alternatives. H3-Image is available via the MiniMax API Platform, MiniMax Code and Hailuo AI, priced at 50–70% of comparable offerings, with 50% off 4K-and-above requests during launch week.

    Why it matters: MiniMax releases open-weight H3-Image, claiming sub-10-second 4K generation and pricing at 50–70% of comparable mainstream offerings, giving developers a new open option for high-resolution image work.

  7. Google DeepMind88

    Google DeepMind releases Gemini 4 Carbon for agentic coding, cybersecurity and scientific reasoning

    Google DeepMind made Gemini 4 Carbon available to developers, enterprises, scientists and consumers, positioning it above Gemini 4 Argon for tasks that need deeper reasoning and more tokens. Carbon ranks #1 on CursorBench 4.0, Perplexity's WANDR and Zapier's AutomationBench at more than 2X lower cost per task than the next best external model, and is priced at $2 per million input tokens and $10 per million output tokens, the same introductory price as Argon. Google also previewed /swarm in Google Antigravity, which turns a single prompt into a coordinated team of agents, and reported that Carbon blocked 99% of attack trajectories in simulated cyberattack testing.

    Why it matters: Google's release notes detail how Gemini 4 Carbon trades higher token usage for deeper reasoning, ranking first on CursorBench 4.0, WANDR and AutomationBench at under half the per-task cost of the next external model.