Skip to content
#Deployment / engineering
November 6Friday
  1. Sierra Blog58

    Sierra acquires Anon to add browser-based agent authentication and navigation

    Sierra has acquired Anon, a startup that built infrastructure letting enterprise AI agents sign in, navigate pages and fill out forms on websites that have no API. Anon raised more than $13M and shipped a product used by hundreds of customers, and its team will now help Sierra's agents complete steps that require logging into a site or working through a browser portal. Founder Daniel Mason says better models and harnesses have made browser agents far more reliable, and Sierra's Horizon agents are pursuing longer-running goals such as originating a loan or getting prior authorization for a healthcare procedure.

November 5Thursday
  1. The Pragmatic Engineer22

    Scaling Slack and GitHub: Maude Lemaire on Backend Performance and Database Sharding

    Maude Lemaire, principal engineer and author of "Refactoring at Scale," shares an insider view of scaling Slack and GitHub on The Pragmatic Engineer podcast. She spent nearly eight years leading Slack's backend performance infrastructure team, then joined GitHub in 2024 to tackle database scaling, and most recently worked on performance at Cursor, including time to first token. She explains Slack's 23-custom-emoji limit to avoid thundering herds, how load testing 500,000 WebSocket connections the naive way would have cost $150,000 per run, and why GitHub's Active Record abstraction and scatter queries capped it at 16 database shards.

  2. Mistral AI69

    Mistral expands Studio with managed agents, workflows and apps alongside Mistral Large 4 (Le Chonk)

    Mistral expanded its enterprise AI platform Studio with managed agents and apps, plus new workflow, enterprise context, agent observability and evaluation capabilities, running on the Mistral Large 4 (Le Chonk) model. Developers can build multi-step agents with skills, sandboxes, subagents and hooks, and deploy to Studio with one command through the new Mistral MCP server. Mistral says customers including ABANCA, BNP Paribas, Capgemini and TCS already use Studio in production, with deployments available in the cloud, VPC or on-premises.

    Why it matters: Mistral expands Studio with managed agents, workflows and apps, showing how enterprises can keep deployment and data control in their own environments.

  3. Zyphra Research36

    ZYFA: Fast and Accurate FP8 Attention Kernels on AMD MI355X

    Zyphra Research released ZYFA, BF16 and FP8 causal prefill attention kernels for AMD's MI355X (CDNA4, gfx950) supporting head dimension 128 and DeepSeek-V2's MLA shape. On activations from Mistral-7B, Qwen3-8B and DeepSeek-V2-Lite at 16K tokens, ZYFA's FP8 kernels reach 1.16–1.76× AITER's throughput, and on Gaussian inputs at 32K tokens 1.26–1.37× at head dimension 128 and 1.99× at the MLA shape. FP8 error is 62–78% lower than AITER's at head dimension 128.

  4. inclusionAI Repositories38

    ASpec: A High-Throughput Training Framework for Speculative Decoding Draft Models

    ASpec is a high-throughput training framework for speculative decoding draft models, built from the TorchSpec codebase with optimized attention, fused kernels and selective head/loss computation. On a Qwen3-8B 4K run, Draft-only training reaches 15,256.44 input tokens/s on one GPU, 1.96× TorchSpec, while the 8-GPU online steady window hits 77,721.37 tokens/s, 2.28× TorchSpec. It supports DSpark, DFlash, EAGLE3/4 and native MTP drafts, with Qwen3-8B and Ling tiny quickstarts.

  5. Waymo Blog38

    How the Waymo Driver Handles Severe Winter Weather

    Waymo is readying its fleet for severe winter weather, including a historic El Niño season, by expanding the 6th-generation Waymo Driver's cold-weather capabilities. The system combines cameras, radar and lidar with built-in heaters and micro-wipers, measures real-time traction at each wheel, and uses snow tires, while vehicles act as mobile weather stations sharing road data across the fleet. Waymo says it will slow, limit or pause service when conditions exceed its Safety Framework boundaries, and is running closed-course testing and heavy-snowfall data collection in Alaska this season.

  6. MIT Technology Review · AI67

    Texas Democrats' midterm wins put the state's AI data center buildout at risk

    Democrats won Texas's Senate and governor races and took control of the state House for the first time in 24 years, after making data centers a central campaign issue. Governor-elect Gina Hinojosa pushed for a full moratorium, and outgoing governor Greg Abbott had already directed a state regulator on September 21 to halt data center permits.

  7. Mastra Blog38

    Mastra Launches Custom Harness Program with Embedded Forward-Deployed Engineers

    Mastra launched the Custom Harness Program, in which forward-deployed engineers embed with customer teams to co-build tailored agent harnesses. The program includes observability, evals, custom MCP, human-in-the-loop workflows, auth and RBAC, plus early access to the Mastra Enterprise Platform. Mastra cites Workday, which moved off Amazon Bedrock Agents in 31 days, cut 3,000 lines of code and lowered vector-storage costs by 98%.

November 4Wednesday
  1. vLLM Blog73

    Buoyant releases Kinference, an open source inference control plane for vLLM and Kubernetes

    Buoyant announced Kinference, an Apache v2 open source control plane that routes OpenAI- and Anthropic-compatible inference traffic to vLLM workers on Kubernetes, adding token rate limiting, per-tenant usage and cost tracking, KV-cache-aware load balancing, and YAML inference policies. In the project's public benchmarks, Kinference cut median time-to-first-token by 95% and median end-to-end latency by 45% versus standard Kubernetes service load balancing on one workload, and served 7.4x the goodput on shared-prefix and about 3.5x on multiturn in a capacity test. Policies can route simpler prompts to cheaper models, burst overflow to providers such as Bedrock and Databricks, or keep PII-tagged requests inside the cluster, and per-tenant metrics cover token rates, TTFT, ITL and cached versus uncached prompt tokens.

    Why it matters: Buoyant's Kinference adds KV-cache-aware load balancing and YAML inference policies on top of vLLM, with benchmarks claiming large TTFT and goodput gains over standard Kubernetes service routing.

  2. LiveKit Blog22

    Clerk AI Uses LiveKit to Power Enterprise Voice Agents at Scale

    Clerk AI is running enterprise voice and messaging agents on LiveKit's open-source framework and global edge network, handling over 1,000 concurrent voice sessions without pre-provisioning. Agents respond in under 500ms and support 30+ languages natively, with ScreenSense call screening at 97% accuracy and TrueReach voicemail detection above 98%. The platform keeps full control over STT, LLM, and TTS providers and holds SOC 2 Type II certification with built-in TCPA compliance.

  3. SemiAnalysis65

    SemiAnalysis: SpaceX will become the world's largest AI cloud, with ~13GW targeted for 2027

    SemiAnalysis reports that SpaceX now has 3.6GW of datacenter capacity under construction across multiple sites and has raised its 2027 estimate to roughly 13GW, up from the 10GW figure it gave on its first earnings call. The firm says it has already identified more than 9GW of feasible capacity and argues SpaceX may be the fastest datacenter builder in the world, citing Colossus 2 build times of 91 days for 210MW and a new Mississippi site targeted at about 4 months. It also flags a likely datacenter at the TeraFab chip fab site in Texas and a BESS deployment at Colossus 2 approaching 6GWh.

  4. Meta Engineering Blog34

    Meta F3 Lightning Accelerates Ads ML Feature Releases ~3.6x

    Meta introduced F3 Lightning, an infrastructure layer on top of its Facebook Feature Framework (F3) that decouples feature releases from shared execution, so each of the 20,000+ ads ranking features is compiled, validated, deployed, and rolled back independently. Comparable extraction features now reach production ~3.6x faster than prior F3 with no increase in infrastructure compute cost.

  5. Preferred Networks News18

    Preferred Networks to Exhibit MN-Core Series at SC26

    Preferred Networks will exhibit its MN-Core series at SC26, the international high-performance computing conference held November 15–20 in Chicago, with booth demonstrations running November 17–19. At booth 4606, the company will show a structural model and mockup of its in-development MN-Core L1000 inference AI chip, its future plans for the MN-Core L series, a live demo on the MN-Core 2 Devkit, and R&D on ultra-high-efficiency AI computing infrastructure.

  6. Figma Blog58

    Figma opens code layers to all users in open beta with agent-driven prototyping workflow

    Figma's code layers feature is now in open beta for 100% of users, letting teams build and compare code-backed prototypes directly on the Figma canvas. The walkthrough shows a designer cloning a GitHub repository into a code layer, prompting the Figma agent to generate three delivery-address variations side by side, and refining one in the full-screen code editor. Extract designs turns screens or recorded flows into editable design layers that can be sent back to the prototype with Update code layer, and the agent can merge two teammates' code layers into one combined experience.

November 3Tuesday
  1. OpenAI Alignment Blog60

    OpenAI details training activation classifiers for safety and alignment

    OpenAI describes training activation classifiers, or probes, that read a model's internal residual stream activations to flag misaligned or policy-violating assistant completions, and says it has deployed them on internal and external traffic of its most capable models starting from GPT-5.6. The probes use an Attention probe architecture with MLP plus QV-attention and an exponential moving average, are trained on up to 1M messages labeled by reasoning-model judges, and run in streaming fashion on the inference engine so a completion can be blocked mid-turn. OpenAI reports excellent probe transfer across many post-training stages but more limited transfer across pre-training checkpoints, and says probes were overall more robust to jailbreaks than content-based classifiers in its red-teaming.

    Why it matters: OpenAI details how activation probes on internal model activations serve as a streaming safety layer, including their limits on transfer across checkpoints and retraining needs.

  2. Sierra Blog42

    Sierra Redesigns Agent Studio Around Ghostwriter

    Sierra has redesigned Agent Studio around Ghostwriter, its always-on agent for building agents, so investigating a problem, editing a journey, and testing a fix now happen in one conversation. Ghostwriter follows you across journeys, simulations, and dashboards, and each session keeps changes and test results together until a teammate reviews and merges them. Agent Studio also groups related agents into a single project and adds line-by-line diffs, Preview Chat, Simulations, and release governance with required approvals and controlled rollouts.

  3. Newcomer58

    Startups Push to Turn GPU Compute Into a Tradable Commodity

    Several startups, including Ornn, Silicon Data, Architect and Liquid Compute, are building futures markets, price indexes and brokerage services to standardize GPU compute pricing. Ornn is raising a new triple-tranche round at a valuation of around $1 billion, with Thrive Capital and General Catalyst in talks to participate, after a $33 million seed round led by a16z crypto in June. None of the companies has secured financial regulatory approval yet, and CME's planned listing of futures tied to Silicon Data's H100 and B200 GPU rental indexes has slipped past its October 5 target.

  4. Google Developers Blog58

    Google benchmarks cheap classifiers to route Gemini models by cost per task

    Google ran a 50-question auto-graded coding-agent benchmark testing whether a lightweight classifier, TypeSafe's Jev, can route each task to the cheapest Gemini configuration that still answers correctly. A frozen regex and prompt-length heuristic scored 93.8% on the 16 development questions but dropped 23.2 points to 70.6% on 34 held-out tasks, while Jev reached 96.0% across the full suite. The strongest no-router setup, Gemini 3.8 Flash on low thinking, solved all 50 tasks, and a Jev router sending tasks to Flash-Lite first and escalating flagged ones also solved all 50 while reducing cost and response time; capping maxOutputTokens at 300 saved nothing on easy tasks and broke 7 of 25 hard ones.

November 2Monday
  1. Zyphra Research58

    Zyphra introduces ZHA hierarchical attention, a sparse method with subquadratic routing

    Zyphra introduced Zyphra Hierarchical Attention (ZHA), a sparse attention method that builds a tree of compressed KV-cache summaries and routes queries top-down through it, giving subquadratic complexity with suitable top-p thresholds. Existing pretrained models can be adapted via a short KL-distillation phase using only a few billion tokens; on Qwen3.6-35B-A3B, ZHA adds 81,920 trainable parameters, about 0.00024% of the base model. On RULER-13 at 256K tokens the wide-tree model scored 96.2% versus 96.0% for dense attention, and the deep six-level tree scored 63.4% on LongBench v2 versus 58.0% for dense while attending to about 1.1% of the KV cache; a GPU roofline model projects 32-35x speedup over dense attention at 10M tokens.

  2. Ai2 · Allen Institute for AI32

    How Olmo 3 earned Nextcloud's highest ethical AI rating

    Ai2's Olmo 3 received Nextcloud's highest Ethical AI rating, green, which requires open-source training and inference software, a self-hostable trained model, and publicly available training data. Nextcloud bundles Olmo 3 with its llm2 local LLM backend, and the 7B variant was chosen so users without 16 or 32 GB of VRAM still get a good out-of-the-box local experience.

  3. SemiAnalysis58

    SemiAnalysis releases GDPx benchmark for frontier agentic capabilities across high-value domains

    SemiAnalysis released GDPx, a benchmark covering chip design, cybersecurity, biology, finance, legal, quant trading, RSI, hardware design, materials science, alignment and software engineering, built with 14 specialized RL environment partners. Even the best model scores just 12%, with Opus 5.5 winning quant trading, hardware and chip design, Gemini 4 Carbon leading biology and software engineering, and GPT-6 Astra topping RSI and materials science. Every task runs in a realistic simulated environment, such as a ~4,000-file private equity deal room or live multi-service cyber ranges, unlike OpenAI's GDPval, which SemiAnalysis argues spoon-feeds context and lacks environments.

  4. SemiAnalysis58

    SemiAnalysis: Datacenter Backlash Turns Bipartisan as Midterms Put 2028 Buildout at Risk

    SemiAnalysis argues the 2027 US datacenter boom is largely locked in, with about three-quarters of the 33.8 GW due across its top 20 states already under construction, while the real election risk sits in 2028, when its model projects 62.2 GW of US net additions, most not yet started. It tracks 13 states holding 43.5 GW, or 70% of expected national capacity, and finds nine of 20 midterm nominees want a pause on new construction while 11 want conditions, split roughly evenly by party. The biggest near-term risk is a prolonged permitting freeze at Texas' TCEQ, since Texas alone adds close to 30% of US GW in 2028.

  5. Anthropic Research70

    Anthropic releases FlashProve, an open-source zkSNARK system for provable LLM inference

    Anthropic released FlashProve, an open-source prototype that uses zkSNARKs to prove a response came from a committed model without revealing its weights. On Llama 4 Maverick (400B-parameter MoE, 4-bit weights), a single H100 generates proofs at about 110 tokens/second with ~19 MB proofs per 1,024-token request, roughly 70-95x the GPU time vLLM needs for the same work. The release includes executable prover and verifier code, a C++ fast verifier, a Lean verifier with machine-checked completeness, soundness and zero-knowledge statements, and a technical report, all under Apache 2.0.

    Why it matters: Anthropic's FlashProve shows zkSNARK-based proofs of inference are becoming practical for a 400B-parameter MoE model, with open code and Lean-checked security claims.

October 30Friday
  1. Google DeepMind58

    Google DeepMind expands PlanAssist AI planning tool to 12 more English councils

    Google DeepMind is expanding PlanAssist, its Gemini-built AI planning tool, to 12 additional local planning authorities in England, bringing the total to 15. In pilots across Barnet, Camden, and Dorset since June, the tool cut the average time officers spent on householder assessment tasks by up to 58%, and more than 70% of its generated reports were approved with no edits.

  2. Waymo Blog58

    Toyota and Waymo to Test Autonomous bZ4X Fleet in Japan in 2027

    Toyota and Waymo announced the next phase of their autonomous driving collaboration, with initial operations to test and validate an autonomous Toyota bZ4X fleet in Japan in 2027, followed by planned deployment to the United Kingdom and other Waymo-serviced markets. Toyota will build the vehicles at its Takaoka plant in Toyota City, Aichi Prefecture, assembling the base vehicle and integrating Waymo's AV hardware under one roof. The companies describe the partnership as a milestone for Japan's first fully autonomous ride-hailing service using high-volume, domestically manufactured vehicles.

  3. Amazon Science38

    Speeding up LLMs for travel applications: Medusa plus knowledge distillation

    Combining knowledge distillation with the Medusa framework lets a 1.1B-parameter TinyLlama student match the quality of its 70B-parameter Llama-3.1 teacher while running 10 to 20 times as fast at less than one-third the cost. Working with Booking.com on AI Trip Planner, Smart Filters and accommodation description generation, the pipeline closed over 90% of the quality gap and added 2 to 3.6x further speedup from Medusa heads.

  4. Meta Engineering Blog58

    Meta details production deployment of Catching JiTTests with human-on-the-loop review

    Meta has moved Catching JiTTests, its LLM-based just-in-time test generation approach, from research prototype into production infrastructure, and published the results in the FSE 2026 paper "Just-in-Time Catching Test Generation at Meta." The system runs overnight on spare capacity, targets risky diffs, generates tests through dodgy-diff and intent-aware workflows, and filters false positives with an LLM-as-Judge ensemble plus a rule-based RubFake assessor before reaching engineers. As of writing, 589 engineers (64% of outreach) engaged with the results, which showed a 60% true-positive rate, and in the first half of 2026 the system caught 74 serious privacy bugs at the diff stage and lowered privacy SEVs by 20%.

  5. Google Developers Blog12

    DevFest 2026 Returns: 800+ Community Events Across 115 Countries

    DevFest, Google's community-led developer event series hosted by Google Developer Groups, returns from October 1 through December 31, 2026, with 800+ events across 115 countries expected to draw almost 1 million attendees. Sessions and workshops cover Google AI technologies plus Google Cloud, Android and Web tracks, framed around building, securing and scaling in the agentic era. Events are hosted in local languages by grassroots organizers, with speakers including Google Developer Experts and Google engineers.

October 29Thursday
  1. inclusionAI Models34

    inclusionAI Releases Ling-3.0-flash-Sante-fp8, an FP8-Quantized Healthcare Model

    inclusionAI released Ling-3.0-flash-Sante-fp8, an FP8-quantized version of its healthcare-specialized Ling-3.0-flash-Sante model, keeping 124B total and 5.1B active parameters per token. It matches the BF16 checkpoint's 73.9 average across healthcare benchmarks while cutting weight memory for FP8-capable hardware. The research-only model supports 256K-token contexts and defaults to thinking mode with tool calling.

  2. Meta Engineering Blog40

    Meta Andromeda: Meta's Next-Gen Ads Retrieval Engine Hits 1B Ads per Second

    Meta detailed the next generation of Andromeda, its personalized ads retrieval engine, which scores over one billion ads per second in production — a 100x throughput lift over the 2024 system. The new architecture brings LLM-inspired mixture-of-experts to retrieval, approaching ranking-level model performance at roughly 300x fewer inference-time FLOPs, with over 10 billion ads per second on a single NVIDIA GH200 GPU. Since 2025, Andromeda has delivered a 2.4% increase in conversions on Facebook.

  3. Replit Blog55

    Replit details the security architecture behind its Agent Habitat for agent work

    Replit published the architecture behind Agent Habitat, the offering that gives agents access to company knowledge and systems inside boundaries the company controls. The post sets out four principles: least authority for agents, containment of failures, accountable production changes, and governable delegated work. Replit says its existing microVM isolation prevented exploitation of recently disclosed Linux kernel vulnerabilities, and that connector credentials stay outside the agent's context, with a credential broker authorizing each request before retrieving secrets from a vault.

  4. Preferred Networks News40

    Zenrin Group and Preferred Networks Form Business and Capital Alliance to Fuse Geospatial Data with AI

    Zenrin, Zenrin DataCom and Preferred Networks have signed a business and capital alliance, with the Zenrin companies subscribing to a PFN third-party allotment. The partners will combine continuously updated geospatial data, including historical change records, with PFN's generative AI, physical AI and 3D spatial recognition technology to build AI models that understand and predict real-world change. Initial focus areas include public sector, real estate, retail and distribution, targeting demand forecasting, store site selection and urban planning, disaster prevention and logistics simulation.

October 28Wednesday
  1. The Pragmatic Engineer58

    AI SRE explained: how AI incident agents change on-call and whether they work

    The Pragmatic Engineer interviewed Rootly, incident.io and ResolveAI about AI SRE tools, which mostly speed up incident investigation inside Slack rather than act autonomously. Deploy frequency has roughly doubled in a year at many companies, and Rootly data shows pages up with out-of-hours pages nearly doubling, while vendors rebuild investigation agents around knowledge graphs, memory and verifier agents. In-house examples include OpenAI's Sevbot, Stripe's investigation agent (about 3 minutes for a simple run, 14 for a deep one) and Google's ProdAgent in Gemini CLI, which suggests tools via MCP and does not write code.

  2. Meta Engineering Blog34

    Meta PrivacyLib: Privacy Controls at the Data Access Boundary

    Meta detailed PrivacyLib, a common library embedded in the clients of hundreds of its data and processing systems that enforces privacy requirements at the point of data access, performing billions of checks per second. Systems integrate once, and new privacy capabilities ship as plug-in modules, replacing per-system implementations that could take months. An Agent Observability module tracks internal AI agent data access by carrying agent context to PrivacyLib.

October 27Tuesday
  1. Replit Blog75

    Replit Cloud Agents now let non-engineers contribute to company codebases

    Replit launched Cloud Agents for existing repositories, letting anyone on a team describe a change in plain language and have the agent open a tested pull request in GitHub or GitLab, available to all Pro and Enterprise customers. The agent runs each change in isolated cloud sandboxes, clicks through the running app, and attaches screenshots and video to the PR, while shared environments give every contributor a preconfigured setup that updates from the main branch. Replit also introduced early-access self-improving workspace memory, which turns review comments into team skills that engineers approve, and a Slack integration that lets users mention @Replit in a thread to start a change.

    Why it matters: Replit 把 Cloud Agents 接入企业既有代码库，让非工程人员以带测试视频的 PR 形式提交改动，展示了 AI 编码工具向团队协作流程延伸的一种路径。

  2. Sakana AI Blog40

    Sakana AI Opens Early Access for Sakana API Platform for Enterprises

    Sakana AI has opened an early access program for its Sakana API Platform, giving enterprise customers API access to its LLMs with organization- and workspace-level management of members and usage costs. The OpenAI-compatible API requires only an endpoint change, and Sakana Fugu and Fugu Ultra are available first, with Sakana Namazu and Fugu Max to follow. Features include role-based access control, CSV audit logs, budget limits, invoice payment, MSA and DPA, and a commitment not to train on customer inputs.

  3. Google Developers Blog34

    Building Conversational Commerce with Multi-Agent Swarms on GCP: A Working Prototype

    Google Cloud developers built HappyDelivery, a working prototype of conversational commerce using LangGraph, Gemini, FastAPI and Google Cloud, following an earlier three-layer blueprint of Ingress, Memory and Cognition. The Ingress layer validates platform-specific webhook signatures for WhatsApp, RCS, Apple Messages and SMS, normalizes payloads into a common schema and offloads them to Pub/Sub, returning HTTP 200 in roughly 300ms. The post walks through the code, state machine, deterministic financial tools and an automated verification suite.

  4. Google Developers Blog58

    Google A2UI adds swappable inference formats, with Express cutting latency up to 3x

    Google released swappable inference formats for A2UI, its agent-optimized protocol for generative UI, letting agents generate an intermediate format that SDK compilers turn into validated A2UI messages. The new default, A2UI Express, uses up to 3x fewer tokens than Direct JSON for the same UI and cuts latency up to 3x, and it ships in the Python (a2ui-agent-sdk 0.9.0), TypeScript (@a2ui/agent) and Dart SDKs. Google also showed decision models such as TypeSafe's Jev choosing among predefined layouts, which it says can reduce latency up to 80x; in the Apparite example, screens were complete in 0.8 to 1.7 s across 11 prompts.