Skip to content
#Deployment / engineering
November 12Thursday
  1. AWS Machine Learning Blog28

    Automating AWS Agent Registry updates with a push-based architecture

    AWS outlines an event-driven pipeline that keeps AWS Agent Registry records for MCP servers current without manual updates. AWS CloudTrail captures UpdateAgentRuntime API calls, Amazon EventBridge routes them across accounts, and a Lambda function queries the MCP server's tools via AgentCore Identity OAuth tokens, then diffs and updates the matching registry record. The sample updates existing records only and supports both single- and multi-account setups.

  2. TechCrunch · AI38

    Why the data center you dread might never even be built

    TechCrunch's Equity podcast discusses why many announced data center projects may never be built at all, even before local opposition, permitting delays and electricity shortages come into play. Hosts Rebecca Bellan and Tim De Chant are joined by Brent Nelson of Ascend Analytics to separate realistic projects from speculative ones amid billions of dollars in AI infrastructure investment.

  3. TechCrunch · AI38

    How backlash and red tape continue to slow data centers post-Blue Wave

    TechCrunch's Equity podcast discusses how local opposition, permitting delays, and power shortages are slowing the data center boom, with Ascend Analytics' Brent Nelson arguing the project pipeline is wildly inflated and only a fraction of announced AI infrastructure will actually be built. The episode also covers what a bubble burst would mean for developers with the wrong tenants, why Democrats should pursue permitting reform now, and why natural gas isn't the reliable fallback developers assume.

  4. Google Research58

    Google Research uses wearables to build CKM risk profiles and personalized coaching

    Google Research introduced an investigational framework that turns consumer wearable data into a coachable health age and simulates personalized 12-week what-if health trajectories. The SensorWM world model was pretrained on 2.28 million person-weeks of de-identified Fitbit data from roughly 100,000 users and forecasts 20 physiological markers under different step, sleep and cardio routines. In a blinded study, lifestyle coaches chose the counterfactual-grounded plan as best overall in 71.4% of evaluations, and physicians rated 99.2% of plans within safe exercise intensity limits; the authors note the models are research prototypes, not clinical diagnostic tools.

  5. Google Blog · AI78

    Google launches Gemini Decisions API and Gemini Decision 1 model for fast closed-set decisions

    Google introduced the Gemini Decisions API, powered by the new Gemini Decision 1 model (gemini-decision-1) and available through the Gemini API in Google AI Studio. A single multimodal input of up to 256K tokens can be checked against up to 1,000 yes/no, multiple-choice and rubric-scoring questions in one forward pass, returning probabilities and confidence scores at 150-250 ms end-to-end latency for $0.10 per 1M input tokens with no output-token charges. Google says the model leads its benchmark suite with the lowest calibration error and is nearly 5x cheaper than Gemini 3.5 Flash-Lite with the Interactions API; internal uses include model routing in Gemini Notebook, wireframe generation in Stitch and adversarial-content checks for MCP tools in Search.

    Why it matters: Google's new endpoint scores up to 1,000 multimodal yes/no, choice and rubric questions in one pass at 150-250 ms, giving agent routing and policy checks a cheaper alternative to generative calls.

  6. Simon Willison22

    LLM 0.37.2 fixes API key leak to third-party OpenAI-compatible endpoints

    Simon Willison released LLM 0.37.2 to fix a security issue reported by Daniel de Araujo in GHSA-v9h7-jj4g-f862 and GHSA-r639-rr7r-x72w. The bug could send a configured OpenAI API key to third-party OpenAI-compatible endpoints via extra-openai-models.yaml if the named api_key_name was never stored, or if a responses: true model ran with -o chat_completions 1.

  7. Amazon Science36

    Using Mathematics to Validate Network Configurations: AWS Tiros for Segmentation Checks

    AWS is using its automated-reasoning tool Tiros to statically validate network segmentation across all modeled paths, rather than relying on packet-based sampling. Tiros converts Cloud WAN configurations from route tables, attachments, and policy documents into logical propositions, then checks that no path exists between segments the policy declares off limits, with analyses run as often as every hour.

  8. Meta Engineering Blog40

    Meta Intelligent Delivery: ML System Allocating Compute for Ads Ranking

    Meta detailed Intelligent Delivery, an ML-driven system that allocates compute across its ads serving stack toward the system-wide optimum, contributing roughly 10% incremental ranking performance on top of model and system advancements from 2017 through the first half of 2026. Its Resource Core Model uses 6B sparse and 20M dense parameters to predict each request's marginal utility, and Meta says it improved identification of high-impact ad requests by about 20% in offline benchmarks. The system also relies on multi-layered allocation mechanisms and increasingly agentic AI to adapt as models and hardware change.

  9. Mastra Blog40

    Mastra Agents Private Model Gateways for Self-Hosted Models

    Mastra added private model gateways that let agents route requests to self-hosted open-weight models, referenced by a prefix like private/ollama/gpt-oss:20b. Self-hosting keeps sensitive data inside the network and replaces per-token costs with infrastructure costs, and setting AUTO_BLOCK_EXTERNAL_PROVIDERS=true hides external providers in Studio. The feature requires @mastra/core@1.82.0 or later.

  10. Claude Blog40

    Anthropic's Claude Tag guide for startups: top Slack channels and use cases

    Anthropic published a Claude Tag (beta) guide for startups, based on conversations with eight high-growth companies about where they deploy the Slack-based agent first. The guide covers five common setups — on-call triage, thread-to-PR, company brain, self-serve data, and reporting — plus a getting-started checklist. Cited results include a PR opened 21 minutes after a Slack mention and 134 pull requests merged from Slack threads at NavigateAI.

  11. Claude Blog56

    Anthropic opens private beta of self-hosted Claude Managed Agents

    Anthropic released self-hosted Claude Managed Agents in private beta, letting developers run the full agent service, including harness, sandboxes, credentials and session history, in their own cloud or on-premise environment. Model requests can go to Anthropic directly, to Amazon Bedrock, Google's Agent Platform or Microsoft Foundry, or through the customer's own gateway, and session history stays in the customer's database. The company says the design keeps the agent loop and vault secrets outside the sandbox, supports allowlists of permitted hosts, and exports a full record of each session over OpenTelemetry.

  12. Figma Blog42

    How 3D transforms and Figma's agent brought a launch video to life

    Figma has released 3D transforms in open beta, letting designers tilt, rotate, and arrange text, images, vectors, and frames in space, with a perspective effect on parent frames for shared spatial compositions. The non-destructive effects stay editable and can be combined with shaders, animated with Figma Motion, or explored via the Figma agent. Figma's Brand Studio used the tools, including an agent-built generative plugin, to produce the feature's launch video.

  13. Claude Blog31

    J.Crew launches Style Advisor AI stylist built with Claude Code

    J.Crew launched Style Advisor, an AI stylist on JCrew.com that recommends complete outfits rather than single products, available now for women's and men's styles in the U.S. J.Crew's team built it with Claude Code using multiple Claude models: Claude Fable 5.1 to plan the stylist reasoning, Claude Opus 5.5 for the prototype, Claude Sonnet 5.5 as the stylist in each conversation, and Claude Haiku 5.5 for quick tasks. Every recommendation is drawn from looks created by J.Crew's own stylists for catalog shoots.

November 11Wednesday
  1. MarkTechPost40

    Marktechpost AI Launches GPU Leaderboard and Deploy It Chrome Extension

    Marktechpost launched GPU Leaderboard, a free cloud GPU price comparison site for AI inference that ranks 201 live offers from 24 providers by $/GPU-hr. Its cost calculator prices a full run including idle time: an 8×H100, 72-hour job at 90% utilization ranges from $967.68 at Latitude to $3,545.28 at CoreWeave. The companion Deploy It Chrome extension estimates VRAM at FP16, INT8 and INT4 and shows the cheapest fitting GPUs on Hugging Face model pages and GitHub repos.

  2. Simon Willison78

    Anthropic IPO roadshow video details multi-chip Claude training and serving strategy

    Anthropic kicked off its IPO roadshow yesterday, and its roadshow video disclosed previously unreleased details about how the business works, including a section on compute strategy with co-founder Tom Brown. Brown said Anthropic trains and serves Claude across AWS Trainium, Google TPUs, NVIDIA GPUs and AMD GPUs, and that when the company began working with AMD GPUs this year, a system called Mythos got Claude running on AMD in three days with basically no human intervention, porting or writing almost 100% of the kernels. He also described compute multipliers as a second driver of compute advantage, saying each multiplier stacks on the ones before it and that Claude may eventually discover them entirely by itself.

    Why it matters: Anthropic's IPO roadshow video details its multi-chip training and serving strategy across four chip families, including a Claude-assisted AMD port completed in three days.

  3. ElevenLabs Blog25

    ElevenLabs Launches Partner Program to Speed Up Enterprise AI Agent Adoption

    ElevenLabs launched its Partner Program with enhanced commercial incentives, new certifications, joint go-to-market opportunities and dedicated technical support. The program covers 550+ active partners in 44 countries, and the partner ecosystem has generated $315 million in pipeline and over $52 million in partner-sourced and partner-influenced revenue this year. ElevenLabs aims for partners to earn $3 in services revenue for every $1 it generates, backed by forward-deployed engineers and a new certified partner directory.

  4. ElevenLabs Blog58

    ElevenLabs Summit NYC: Interaction Engine, ElevenAgents Memory and Routines, ElevenAI app, Partner Program and Marketplace

    At its New York Summit, ElevenLabs announced new models, agents and deployment options for its AI interaction layer, including the Interaction Engine that manages turn-taking and routes each part of a conversation to a cheaper or frontier LLM. ElevenAgents gains Memory, which builds a structured record of returning customers, and Routines, an automation layer for multi-step work before, during and after calls. ElevenLabs also previewed the ElevenAI workplace app with free early access opening today, launched a Partner Program now at more than 550 partners in 44 countries plus a McKinsey alliance, and introduced the ElevenLabs Marketplace; NVIDIA's Nemotron 3.5 Super VL is now available in ElevenAgents alongside 15 MW of new Vera Rubin compute capacity.

  5. ElevenLabs Blog40

    ElevenLabs Launches Marketplace for Enterprise-Ready AI Applications

    ElevenLabs launched the ElevenLabs Marketplace, a curated collection of industry-specific AI and voice applications built on its models by technology partners, with launch partners including Salesforce, IBM, NiCE, Twilio, and Zendesk. Enterprises can explore solutions across financial services, insurance, healthcare, telecommunications, retail, and government, and connect directly with the partners behind them. Starting next year, eligible partner solutions will be purchasable through existing ElevenLabs commitments.

  6. Modal Blog58

    Modal joins gVisor maintainers as Google donates the project to CNCF

    Modal is one of three companies, alongside Ant Group and Tines, joining gVisor's maintainers as Google donates the project and its trademarks to CNCF under a maintainer-led governance model. Modal says it launches upwards of 40 million gVisor containers a day and has contributed upstream since 2023, including nvproxy GPU support, an RDMA device proxy called rdmaproxy, and tmpfs and memory-allocator optimizations. The company says it is working on multi-GPU memory snapshots and GPUDirect Storage support for gVisor.

  7. ElevenLabs Blog58

    ElevenLabs and NVIDIA expand partnership to bring voice agents to enterprises and governments

    ElevenLabs and NVIDIA have expanded their collaboration across models, infrastructure and sovereign deployments, bringing NVIDIA Nemotron 3.5 Super VL into the ElevenAgents platform. ElevenLabs plans to add 15MW of NVIDIA Vera Rubin capacity on top of its existing Blackwell Ultra systems, and is powering a voice agent for Poland's Centralna e-Rejestracja appointment system on-premises using NVIDIA Confidential Computing. On the ElevenAgents customer-support benchmark, Nemotron 3.5 Super VL reached leading end-to-end task-completion accuracy at 70% lower cost than other leading open models, according to ElevenLabs.

  8. ElevenLabs Blog22

    How Enterprise Clients Are Putting ElevenLabs AI to Work

    ElevenLabs says enterprises now account for more than 55% of its revenue, with its technology in daily operations at five of the 10 largest tech companies, five of the 10 largest insurers and four of the 10 largest telecoms. At its NYC Summit, clients including Ramp, Customers Bank, Banco Inter, Clover Health and FOX Sports described using ElevenAgents and ElevenCreative for support agents, onboarding, multilingual service and an AI persona of commentator Colin Cowherd in the FOX Sports App.

  9. NVIDIA Blog22

    How AI Helps Recyclers Turn Mixed Waste Into Reusable Material

    NVIDIA highlights four Inception startups using AI and robotics to sort mixed waste at recycling plants. AIRECO's Jetson Orin NX pilot line tops 95% recognition accuracy and targets raising annual capacity from 18,000 to 48,000 tons while cutting operating costs by 85%, and EverestLabs has deployed about 150 vision-guided robots across North America and Australia.

  10. Vapi Blog58

    Vapi launches Agent Loop in early access, a self-improving harness for voice agents

    Vapi launched Agent Loop in early access, with GA planned for early next year, as a self-improving harness that builds a voice agent from a plain prompt, scores every call against a business goal, drafts fixes for the misses, tests them in simulations and ships them to a slice of live traffic before full rollout. The loop runs on Vapi primitives including Simulations and Traffic Splitting, available in the dashboard now, plus Goals, Call Health and Experiments, coming soon. Every Agent Loop agent is a real Vapi assistant, so engineers keep full dashboard and API access, and human approval is required before any change ships.

  11. vLLM Blog58

    vLLM adds encoder disaggregation for multimodal serving with EPD

    vLLM has expanded Encoder/Prefill/Decode (EPD) disaggregation for multimodal serving, adding metadata-only requests, a dedicated encoder execution path, remote embedding transfer via NIXL and Mooncake, cross-encoder output reuse, and orchestration through vLLM Router, SMG, and llm-d. Core capabilities including MiMo and XPU support ship in vLLM v0.32.0, while metadata-only support for DeepSeek V4.1 Flash is available on main via #62802. In a DeepSeek V4.1 Flash test on GB200, EPD delivered 6.6–9.5% higher per-GPU throughput and 44–47% lower P90 TTFT than an eight-GPU PD baseline at concurrency 64–128, but had lower per-GPU throughput at concurrency 16.

  12. OpenRouter Announcements65

    OpenRouter measures the context cost of MCP, CLI and skills on one GitHub task

    OpenRouter measured the same GitHub task across the GitHub MCP server, the gh CLI and a gh skill on Claude Sonnet 5.5, GPT-6 Luna and Gemini 3.8 Flash. On Sonnet 5.5 all three answered correctly, but the CLI used 1,421 input tokens, the skill 3,315 and the MCP server 59,417 with its 46 default tools, whose definitions alone add 19,436 tokens per request. Scoping the server to two tools cut the task to 23,228 tokens, capping results at 4,000 characters brought it to 5,357, and Tool Search cut the up-front cost of 46 tools to under 600 tokens, though it halved the whole-task cost on Sonnet 5.5 while raising it on Claude Haiku 5.5.

    Why it matters: OpenRouter's measured comparison shows how much context an MCP server, a CLI and a skill each consume on the same GitHub task, and where trimming tool results or deferring definitions changes the bill.

  13. OpenRouter Announcements58

    OpenRouter guide: fixing OpenAI and Claude 429 rate limit errors

    OpenRouter published a guide on handling 429 Too Many Requests errors from OpenAI, Anthropic and its own API, testing three fixes on a 60-prompt batch. The OpenAI Python SDK's default retries left 23 of 60 requests failed in 12 seconds, while a retry that waits for Retry-After or X-RateLimit-Reset completed all 60 in 89 to 92 seconds in Python and 106 to 218 seconds in TypeScript. A models fallback finished all 60 in 13 seconds for $0.000066, and with provider failover on, all 150 pinned-provider requests succeeded where up to 32 failed with fallbacks off.

  14. OpenRouter Announcements60

    OpenRouter tests what fp8 and fp4 quantization do to LLM quality and price

    OpenRouter ran 280 exact-answer tasks against six endpoints of Qwen3.8 27B on October 20, 2026 and did not detect an accuracy difference between fp16, fp8 and fp4, with all six scoring between 98.3% and 99.2%. Across 1,455 endpoints, 59.5% report no precision at all and fp8 is the most common labeled format at 23.6%. Lower precision was cheaper for most models but not all, and provider choice moved price more than precision did, with the priciest same-precision endpoint a median 1.72 times the cheapest.

    Why it matters: OpenRouter measured fp8, fp4 and fp16 endpoints of one model across 240 exact-answer tasks and found no detectable accuracy gap, while price differences tracked the provider more than the precision.

  16. LangChain Blog58

    LangChain explains retrieval techniques for AI agent context engineering

    LangChain published a blog post on how retrieval design shapes context engineering for AI agents, using a competitive analysis agent built on its Deep Agents harness as the example. The post covers three failure modes, inefficient searching, loading too much context at once, and irrelevant or stale results, and pairs each with techniques such as glob and grep filesystem tools, paging through large files with read_file offsets, offloading oversized tool results to files, and delegating reading to subagents under a retrieve, offload, delegate pattern. It also warns that retrieved text is data rather than instructions and can carry prompt injection, so outputs should be checked against cited sources.

  17. LangChain Blog60

    LangChain explains how Deep Agents manages context without keeping everything in the window

    LangChain details how its open source Deep Agents harness uses middleware to fight context rot on long agent runs. Tool results over roughly 20,000 tokens and user messages over 50,000 tokens are offloaded to files with only a preview shown, while summarization condenses older messages once usage hits 85% of the context window. Skills, subagents and a markdown long-term memory file keep the main agent's window small and let memory carry over across models and providers.

    Why it matters: LangChain explains how its open source Deep Agents harness uses middleware to offload, summarize and isolate context, offering a reusable pattern for agents on long tasks.

  18. Latent Space55

    Designing for Agents: Resend CEO Zeno Rocha on How Agents Choose an Email API

    Resend co-founder and CEO Zeno Rocha joined the Latent Space podcast to explain how the email API is designed to be picked by coding agents, citing an AEO study in which Claude Code chose Resend first in 64 of 102 email recommendations. Resend's earlier wedge was React Email, a template tool developers could use with any provider, so some Resend code was already in the repo before they switched.

  20. Meta Engineering Blog58

    Meta details how Your Algorithm turns natural-language preferences into Facebook Feed and Reels recommendations

    Meta published an engineering overview of Your algorithm, a suite of AI tools that lets Facebook users state in natural language what they want to see in Feed and Reels, with a single editable page listing Interested In and Not Interested In topics. Each change is validated by a smaller LLM, enriched with embeddings and search keywords, and saved to a shared store that both Feed and Reels read, while a fine-tuned LLM reranker removes content matching newly added Not Interested In topics. Meta says a supplementary tail load and client-side cache invalidation make changes take effect faster, and that a separate LLM judge grades outputs such as the Lately Summary before launch.

  21. Meta Engineering Blog58

    Meta explains TLX, a hardware-native GPU compiler extension to Triton for production ML

    Meta detailed TLX (Triton Low-Level Extensions), an extension to Triton that adds explicit warp-group and cluster-level orchestration while keeping Triton's tensor programming model. TLX is already running in production across Meta, with 20-25% end-to-end MFU on thousands of NVIDIA Blackwell GPUs for GEM training, up to two-thirds lower compute-intensive net latency for RecSys inference, and a distributed grouped GEMM kernel deployed in large-scale LLM pretraining. Meta says TLX targets NVIDIA Hopper and Blackwell plus AMD Mi300 and Mi350x, and is working on more architectures, automatic warp-group inference and a torch.compile backend.

  22. NVIDIA Blog60

    NVIDIA Contributes OpenShell Agent Runtime to CNCF and Adds DSX Kubernetes Tools

    NVIDIA is contributing OpenShell, its open source runtime for securing and governing autonomous agents, to the Cloud Native Computing Foundation as a Sandbox project, and is also contributing to Google-led Agent Substrate. NVIDIA announced three new DSX AI Factory Platform components: NVIDIA Kubernetes Engine and NVIDIA Kubernetes Recipes, now in public preview, and NVIDIA Snapshot, which restores checkpointed replicas in seconds without model reload or warmup. Crusoe tested GLM-5.3 on Crusoe Cloud and cut workload ready time from roughly eight minutes to 31 seconds, while Saturn Cloud reduced vLLM startup from between two and 8.5 minutes to six and 34 seconds.

    Why it matters: NVIDIA contributes its agent security runtime OpenShell to CNCF and adds Kubernetes tooling for GPU AI factories, with early Snapshot results cutting inference startup from minutes to seconds.

  23. Mastra Blog38

    Mastra Forward: Mastra launches AI engineering service with forward-deployed engineers and agent factory

    Mastra launched Mastra Forward, an AI engineering service that pairs a named forward-deployed engineer with Mastra Factory, an agent swarm installed in the customer's repo. The annual engagement costs less than one senior AI hire and includes an Enterprise license with hosted, self-hosted, or BYOC deployment plus a Trace Intelligence pool. Mastra says its factory produces 750+ PRs per week.

  24. Mastra Blog58

    Mastra adds MCP Tasks for background long-running tool calls

    Mastra now supports tasks in MCPServer and MCPClient, letting long-running tool calls run in the background while the agent keeps responding to users. The server returns a task ID immediately, and the client polls for status values working, input_required, completed, failed or cancelled, with a notification sent to the agent when the task finishes. Tools can be set to always, auto (after a 2-second syncWindowMs default) or off, and tasks can still call suspend() for human input; the feature requires @mastra/mcp@2.7.0 and @mastra/core@1.81.0 or later and remains experimental.

November 10Tuesday
  1. Google AI · DEV58

    Google explains how it ships Agent Skills like products with CI gates and an AI review agent

    Google Agent Skills now hosts over 170 skills from teams across Google and has passed 21,000 GitHub stars, up from 15,000, and its maintainers describe the pipeline every change must clear. Each pull request passes six automated gates, including structural conformance, linters, semantic versioning, evaluation suite validation, link checks and an AI review agent, before a human subject matter expert approves it. The post also shares lessons such as atomic evaluation expectations, generated index files and running cheap deterministic checks before expensive LLM checks.

  2. The Pragmatic Engineer22

    Software Correctness & Supply Chain Security: A Conversation with Sean Allen

    The Pragmatic Engineer interviews Sean Allen, a distinguished engineer at Antithesis and core contributor to the Pony language, on software correctness and supply chain security. Allen argues that strong type systems in the ML language family catch more errors at compile time than ALGOL-family languages, and that manual testing is the worst way to ensure correctness. He also says supply chain attacks have no single simple fix, since robustly defended languages like 'E' are unpopular while popular languages assume a trustworthy ecosystem.

  3. LiveKit Blog40

    LiveKit Portal for ROS 2 released: bridging ROS graphs over WebRTC

    LiveKit released LiveKit Portal for ROS 2, a standalone ROS 2 node that connects a ROS graph to a LiveKit room so ROS and non-ROS participants can exchange topics, service calls, and video over WebRTC without exposing DDS across networks. It supports four data paths—topics via DataTracks, services via RPC, images as VideoTracks, and direct video sources—with YAML rules for direction, rate limits, and schema encoding. A demo offloads stereo SLAM and scene reconstruction from a Jetson Orin Nano rover to a desktop RTX 5090.