Skip to content
Only First-party#Deployment / engineering
October 22Thursday
  1. Google Developers Blog58

    Google Cloud API Gateway adds streaming support in Public Preview

    Google Cloud API Gateway now supports streaming in Public Preview, letting SSE, chunked HTTP, WebSocket and gRPC streaming endpoints sit behind the same gateway and policies as existing APIs. Streaming is enabled with a single --enable-streaming flag at gateway creation, requires no changes to the API spec, and keeps API key enforcement, JWT validation, service account auth and Cloud Logging and Monitoring working as before. Gateways also get a deterministic default hostname of GATEWAY_ID-PROJECT_NUMBER.REGION.gateway.dev, and streams can stay open for up to one hour.

October 21Wednesday
  1. Modal Blog58

    Modal releases Dojo, a library for production-grade LLM training

    Modal released Modal Dojo, a training library that provides building blocks, tuned default recipes and an observability dashboard for production-grade LLM post-training. It builds on open-source frameworks Miles and Slime, supports models from half a billion to multi-trillion parameters, and exposes an API and CLI that agents can drive to launch and debug runs. Modal says Axiom Bio used it to scale to 64k-context DeepSeek V4.1 Flash runs on 64 B300s, and Afterquery trains Kimi and DeepSeek at 256k context length.

  2. LiveKit Blog25

    How Acuity Health Uses LiveKit Voice Agents to Automate Patient Access

    Acuity Health rebuilt its patient-access voice agents on LiveKit after a low-code platform proved too rigid and opaque, and now 80% of calls are fully contained by AI agents. Agents run on LiveKit Inference with the Gemma 4 31B model, most bookings finish in under a minute, and 81% of booking calls end with a "thank you." LiveKit Simulations tests each change against patient profiles before release, and one prompt review cut roughly 24% of words while still passing the same scenarios.

  3. Google Developers Blog58

    Google Agents CLI 1.8.0 ships Extension System and first-party LangChain extension

    Google's Agents CLI now includes an Extension System, introduced in v1.5.0, that lets developers override or add commands without forking the tool, and v1.8.0 ships a first-party LangChain extension. The LangChain template scaffolds a project with no google-adk dependency that deploys to Cloud Run through the same code path as an ADK project, while six ADK-coupled commands such as playground, run and eval generate are replaced or cleanly refused. Extensions are distributed as directories in Git repositories with a lockfile pinning an exact commit SHA, and the system is marked experimental in v1.8.0.

October 20Tuesday
  1. Sakana AI Blog15

    Sakana AI Engineer Open House 2026: Company Outlines AI Sovereignty Strategy and Five Engineering Roles

    Sakana AI held its second Engineer Open House on October 5, 2026, covering five engineering roles including Applied Research Engineer, Forward Deployed Engineer, Software Engineer, Solution Engineer and Cybersecurity Engineer. CEO David Ha outlined an "AI sovereignty" strategy built on pre-training, post-training with Namazu and orchestration with Fugu, after expanding its portfolio to Sakana Chat, Marlin, Fugu and Translate in the past six months. The event also detailed work with Japanese financial institutions and defense projects, including research with the Ministry of Defense's Information Headquarters and the Defense Innovation Science and Technology Institute.

  2. Mistral AI82

    Mistral releases Voxtral 3 speech models and voice agent SDK

    Mistral released Voxtral 3, a family of speech-to-text and text-to-speech models plus a voice agent SDK built on LiveKit that streams listening, reasoning, tool calling and speaking in one pipeline. Voxtral Small Transcribe 3 covers 50+ languages with diarization and context biasing, Voxtral Mini TTS 3 supports 35+ languages and 50+ dialects, and the stack is available through Mistral's EU-hosted API or self-deployment. Pricing starts at $0.0035/min for batch transcription and $13 per 1M characters for TTS.

    Why it matters: Mistral's Voxtral 3 pairs multilingual speech models with a LiveKit-based voice agent SDK, giving teams a sovereign-deployable option for real-time voice agents.

  3. Zyphra Research58

    Zyphra Inference Wave 2 brings custom HIP MoE and sparse-attention kernels to MI355X serving

    Zyphra released the second wave of its Zyphra Optimization Engine (ZOE) for AMD Instinct MI355X GPUs, adding four custom HIP kernels for MoE and sparse attention into its production forks of vLLM and SGLang. 40x). 3 checkpoint stays within 3 points of FP8 on four reasoning benchmarks but decodes faster only at high concurrency.

  4. Waymo Blog58

    Waymo to begin laying groundwork for autonomous ride-hailing in Madrid region, first riders targeted for 2027

    Waymo announced it is laying the groundwork for its fully autonomous ride-hailing service in Spain, starting with the Region of Madrid, with the aim of welcoming its first riders in 2027. Electric Jaguar I-PACE vehicles will appear on regional streets in the coming days, beginning with manual driving before technical validation by locally trained autonomous specialists. Waymo cites over 20 million completed trips and data from more than 400 million fully autonomous kilometres showing 95% fewer crashes involving serious injury or worse than human drivers in cities where it operates.

  5. Google Developers Blog60

    Google 将 TorchTitan 接入 TorchTPU，并发布 TPU 模型优化手册

    Google released a TPU fork of Meta's TorchTitan that runs PyTorch training on Cloud TPUs through TorchTPU's native torch.device("tpu") backend, with TPU-native kernels and a step-by-step optimization playbook. On TPU v7x (Ironwood), Llama 3 405B holds about 57% MFU from 128 to 1,024 chips, Qwen3 235B reaches 32.42% MFU on one 1,024-chip slice, and FLUX.1 reaches 19.4% MFU on 1,024 chips at 93% weak-scaling efficiency. The fork is at https://github.com/google-pytorch/torchtitan/, and a Transformers modeling backend plus an agent onboarding skill extend the same trainer to other checkpoints.

    Why it matters: Google 与 Meta 合作把 TorchTitan 移植到 TPU，并给出从 FLUX.1 到 Qwen3 235B 的逐级调优路径与 MFU 数字，可作为 PyTorch 团队评估 TPU 训练可行性的参考。

October 19Monday
  1. Modal Blog58

    Modal benchmarks NVIDIA Vera CPU: up to 2x sandbox throughput under load

    Modal benchmarked NVIDIA's new Arm-compatible Vera CPU server and measured up to double the task throughput of an equivalent x86 GNR machine, with per-task latency equal to or sometimes lower. The results come from Agentless Agent Bench, 50 Terminal-Bench oracle solutions and verifiers stripped of network calls and run in concurrent Docker containers. Modal attributes the gain to Vera holding its pace as concurrent containers accumulate, which it links to high memory bandwidth, and says supporting Arm would require changes across its infrastructure and image build system.

  2. Modal Blog38

    How Legora runs 2,000 parallel agent evals on Modal Sandboxes

    Legora now runs each of its legal agent evals inside a separate Modal Sandbox, booting its full application pinned to a specific commit so every run reflects the exact product version. A typical experiment is 100 cases, 4 harness variants, and 5 trials each — 2,000 runs in parallel — with Modal Volumes snapshotting document, database, and permission state. Legora also moved from gVisor to Modal VM Sandboxes, removing its Docker networking and FUSE workarounds, and cut agent cost by 30% via smarter compaction and custom tool search.

October 16Friday
  1. Modal Blog36

    Modal explains how it built a fast filesystem stack for VM Sandboxes

    Modal detailed how it evolved its filesystem stack to back VM Sandboxes, routing guest requests through virtio-fs and virtiofsd onto its ImageFS lazy-loading filesystem. The first version booted fast but ran slow: recursive chown went from four seconds to over a minute, and pnpm and bun installs were about three times slower. Microbenchmarks showed chown at 9.87 s over virtio-fs versus 2.31 s on gVisor and 1.58 s on ImageFS.

  2. Replit Blog40

    Replit Brings Your Own Cloud (BYOC) to Its Platform

    Replit is introducing Bring Your Own Cloud (BYOC) options that let enterprises run the Replit platform and published apps inside their own Microsoft Azure, Google Cloud, or Amazon Web Services tenant. Full BYOC, in private preview, deploys Replit's cells and agent harness in the customer's cloud, while BYOC for Published Apps, in early access, hosts published projects there with Replit managing the platform. Image Exports instead give teams a Docker image, Terraform file, and SBOM to self-host Replit-built apps.

  3. OpenClaw Blog22

    How PJ Helps Small Businesses Adopt and Own OpenClaw

    PJ, an engineer-turned-pest-control owner in Ocala, Florida, now consults for small businesses—roofing, pool and automotive contractors among them—setting up OpenClaw and teaching them to run it themselves. His clients want a tool they own outright rather than feeding company data into rented software, and one client, 66-year-old admin Donna, uses her OpenClaw daily.

  4. LiveKit Blog38

    How to Build a Production-Ready AI Voice Agent

    LiveKit's guide distills lessons from solution architects and forward deployed engineers on taking AI voice agents from demo to production, organized around three questions: whether the agent is smart and natural enough, whether its performance is observable, and whether it scales reliably and cost-efficiently. It recommends measuring the first turn separately, since one company found roughly 3 out of 4 calls ended at the greeting step, and notes clients moving from GPT-4.1 to Gemma 4 31B on LiveKit Inference saved 300–500ms at p50.

October 15Thursday
  1. Anthropic · Claude.dev62

    How the Claude Code team does code review

    The Claude Code team describes its layered code review flow, in which most reading is done by machines and human attention is reserved for risk-based approval. From June to September, merged pull requests to the Claude Code codebase more than doubled while the share that had to be reverted fell by more than 40 percent. The process stacks verification before the PR, required CI, Claude review, security review, risk-tiered human approval and a merge queue with flags and fast rollback, and the team turned past incidents into a daily eval set for the reviewer.

    Why it matters: Anthropic's Claude Code team details how it moved most code reading to automated layers while merged PRs doubled and reverts fell over 40 percent, offering a transferable review model for agent-heavy teams.

  2. Modal Blog34

    Augment Your LiveKit Agent with Modal GPUs

    Modal explains how to run LiveKit Agents with open-weights or custom models on its serverless GPUs, using BitHuman's open-weights Expression Video Avatar voiced by Qwen3-TTS to clone Charles Frye. The setup exposes the avatar container's /launch endpoint via a Modal Server and uses Sticky Sessions to keep WebSocket clients on the same container, with GPU snapshots hiding cold starts.

  3. Modal Blog78

    Meta's Muse Spark Open weights released and available on Modal Auto Endpoints

    Meta released the weights for Muse Spark Open, and Modal now serves the model through its Auto Endpoints with per-token billing. The model targets agentic coding and long-horizon tasks, with native multimodal understanding, a 1M-token context window, multi-step planning, sequential tool use and failure recovery. Meta reports 76.4 on Terminal-Bench 2.1 with the Terminus 2 agent and 60 on DeepSWE 1.1 using its preferred harness at xhigh reasoning effort.

    Why it matters: Meta's open-weight Muse Spark Open is now served on Modal, giving teams a per-token way to try an agentic coding model with a 1M-token context window.

October 14Wednesday
  1. GitHub Blog · AI & ML38

    GitHub's secret detection model: finding more secrets with less noise

    GitHub trained a fine-tuned ModernBERT classifier to replace its previous LLM-based pipeline for generic secret detection, improving owner-weighted alert precision by 11.5% and cutting median post-push scan execution time by 86%. The two-stage pipeline uses regex candidate generation followed by context-aware classification, which also lowered serving cost by more than 98% versus remote LLM calls. The efficiency gain made it practical to extend generic secret detection to push protection, returning results before changes are pushed.

  2. Modal Blog71

    Modal crosses $1B annualized run rate and raises $750M Series D at $15.75B valuation

    Modal crossed $1B in annualized run rate and raised a $750M Series D led by Accel at a $15.75B post-money valuation, with all existing investors participating. The company says usage has tripled since its Series C five months ago and grown more than 15x year-over-year, and that its Sandboxes product alone is at a $300M run rate with close to 3 billion sandboxes spun up. Modal also describes rebuilding its own file system, container runtime, scheduler and networking on a capacity pool spanning 20+ clouds, and points to recent launches in multi-node training, Modal servers and generally available VMs for Sandboxes.

    Why it matters: Modal's post explains why AI workloads pushed it to rebuild its own file system, container runtime and scheduler across 20+ clouds, a concrete view of how the AI infrastructure stack is diverging from the cloud stack.

October 13Tuesday
  1. LiveKit Blog18

    Troubleshooting LiveKit Egress: Common Errors and Fixes

    LiveKit published a troubleshooting guide for Egress, covering common errors such as the 412 "start signal not received" from templates that never call START_RECORDING, 404 participant or track not found within 30 seconds, and 400 upload failures from invalid S3/GCP/Azure credentials. It also addresses layout, webhook, and self-hosted Egress issues, and notes the guidance applies to both the current StartEgress API and the deprecated source-specific APIs.

  2. Modal Blog58

    Modal tests mixed-precision, mixed-accelerator RL samplers on Qwen3.6-35B-A3B

    Modal trained Qwen3.6-35B-A3B on agentic coding with samplers spread across six accelerator types (B200, B300, H100, H200, A100, RTX PRO 6000) at NVFP4, FP8 and BF16 precision, feeding one BF16 trainer on B200. Plain GRPO collapsed on both mixed and homogeneous samplers, but adding masked importance sampling plus score centering, with or without top-p mask replay, trained stably to the end and reached SWE-bench Pro V2 pass@4 on par with homogeneous samplers, at roughly 15% lower sampler cost per update. The mixed samplers ran with an average sampler-trainer KL 4.7x that of the homogeneous setup, and the authors argue stability depends on keeping the mismatch bounded rather than low.

  3. Amazon Science75

    Amazon Web Services researchers propose priming to convert pretrained Transformers into hybrid state space models without full retraining

    Amazon Web Services researchers introduce priming, a method that reuses pretrained Transformer weights to cut the pretraining cost of hybrid state space architectures by more than 99%, using under 0.5% of the source model's pretraining token budget. In controlled comparisons, Gated KalmaNet outperformed Gated DeltaNet and Mamba-2, and a 32B GKA-based hybrid matched its source Transformer on reasoning benchmarks while decoding up to twice as quickly at 128,000 tokens of context. The team released 8B and 32B primed hybrid models, training code, Triton kernels, and a vLLM serving plugin under the Apache 2.0 License.

    Why it matters: Amazon Web Services researchers show that reusing pretrained Transformer weights can cut hybrid architecture pretraining cost by over 99%, making controlled comparisons of state space layers practical.

  4. Apple Newsroom58

    Apple introduces HomeView, a $299 smart home display with Siri AI

    Apple introduced Apple HomeView, a 7-inch Liquid Retina smart home display that combines entertainment, FaceTime calls, home monitoring and hands-free automation, priced at $299 in the U.S. The device recognizes users by face to surface their personal content and runs Siri AI, a new more conversational version of Siri that can draw on personal context when paired with an Apple Intelligence-enabled iPhone or iPad. Pre-orders opened October 13 in Australia, Canada, India, New Zealand, the UK and the U.S., with availability starting Friday, November 13; Apple says HomeView is not for sale in the European Union because Siri AI is currently unavailable in iOS there.

October 12Monday
  2. Descript Changelog22

    Descript October 2026 Roundup: Drive-Wide Search, Async Recording Requests, and ElevenLabs v4 Voice Clones

    Descript's October 12, 2026 release adds a search bar across your entire drive, with a full results page and Underlord file-finding. Enterprise drives can now send async recording requests so guests record on their own schedule, and AI Speech moves to ElevenLabs v4 for more accurate voice clones. Paid plans also default to MiniMax H3 Max Turbo for AI video generation.

  3. Modal Blog40

    Modal launches Endpoint Candidates to evaluate and promote inference endpoints

    Modal has released Endpoint Candidates, generally available for all workspaces, letting users stage alternative deployments for Dedicated Endpoints that mirror a sample of production traffic while Modal runs the infrastructure. Users can inspect latency and throughput metrics, run benchmarks, and test output quality via each Candidate's own URL, then promote it to production from the dashboard. Mirrored requests are best-effort and billed at standard Modal compute pricing.

October 9Friday
  1. LiveKit Blog34

    Serve AI uses LiveKit Agent Simulations to rebuild its voice agent on a single prompt

    Serve AI rebuilt its phone agent for a $150M pest control customer on LiveKit, collapsing a 224-node Retell flow graph into a single prompt and validating it with Agent Simulations. About 100 real production calls were converted into simulation scenarios, reaching a 98% pass rate over 10–15 iterations before cutover, with median turn latency of 1.3 seconds against a 1.5 second ceiling. The first migration took one week with no rollback, and containment rose 15%, which Serve estimates saves the customer an additional $320,000 a year.

  2. LiveKit Blog58

    LiveKit launches Agent Simulations for testing voice agents

    LiveKit has made Agent Simulations generally available for all LiveKit Cloud projects, a repeatable way to test voice agents at the task level rather than turn by turn. An LLM-driven simulated user plays out each scenario, including backchannels and interruptions in audio mode, and an LLM judge returns a pass/fail verdict with a reason; a CLI can generate scenarios from the agent's own prompts and tools. Text runs are the default and cheap enough for every pull request, while audio runs cover the full pipeline and are better suited to nightly or pre-release schedules. Simulations are free through October, though they call the real agent's LLM, STT and TTS at normal rates.

October 8Thursday
  1. Anthropic · Claude.dev62

    Anthropic walks through building scheduled agent automations with Claude Managed Agents

    Anthropic published a reference implementation for Claude Managed Agents (beta) that reads Slack channels and GitHub pull requests on a cron schedule, tracks changes since the last run via per-source bookmarks, and posts a brief to Slack. The walkthrough covers vault-held credentials, read-only access and a per-run spending cap, plus rules for reporting a failed source as unreadable rather than a quiet day and confirming a Slack post before updating bookmarks and the ledger. A Claude Code command with the claude-api skill configures the agent from the article's guidance.

    Why it matters: Anthropic shares a reference implementation for scheduled Claude Managed Agents that read Slack and GitHub, with concrete rules for bookmarks, failed reads and post confirmation.

  2. Zyphra Research36

    Zyphra Research: Expert Coupling Cuts MoE Pretraining Communication

    Zyphra Research shows MoE routing is highly structured, with co-selected experts correlated within a layer and a token's expert choices predicting later-layer routing. Exploiting this via correlated expert placement and token shuffling cuts all-to-all communication time up to 2.63× and improves end-to-end training step time up to 1.41× in Megatron-LM experiments on MI300X GPUs, without changing architecture or routing decisions.

  4. Goodfire Research71

    Goodfire trains and deploys probe-based cyber misuse monitors on Kimi K3 and GLM 5.3

    3 and deployed them on a production inference stack, where a cheap probe filters turns and only suspicious exchanges reach an LLM judge. 5% benign-session interruption rate, costs $65 per million turns without judge reasoning and $185 with it, and adds no measurable throughput loss inside SGLang.

    Why it matters: Goodfire shows a probe-plus-judge cascade can monitor agentic cyber misuse at roughly 50x lower cost with no measurable throughput loss, a concrete recipe for serving open models safely.

October 6Tuesday
  1. Anthropic · Claude.dev72

    Claude Code cloud sessions: a field guide to running tasks on separate VMs

    Addy Osmani walks through Claude Code cloud sessions, where each task runs on a fresh Anthropic-managed VM with the repository cloned onto its own branch, and cloud sessions are included in Pro, Max, Team and Enterprise plans at no extra compute charge. In a four-session test on a sample Node repository, three sessions started within 16 seconds of each other finished 87 seconds after the first began, and the flaky-test session ran the suite 40 times with zero failures. The guide covers setup scripts, network levels, GitHub connection paths and seven workflows suited to cloud sessions, while noting that local sessions remain the better fit for tasks needing local data, VPN services, GPUs or Zero Data Retention.

    Why it matters: A hands-on field guide to Claude Code cloud sessions, showing how per-task VMs enable parallel work and where local sessions still fit better.

  2. LiveKit Blog38

    Retell vs. Vapi vs. LiveKit: A Developer Comparison for Voice AI Agents

    LiveKit published a developer-focused comparison of Retell, Vapi and LiveKit for building voice AI agents, framing the choice around four questions: who iterates on the agent after launch, what happens when needs fall outside defaults, whether it must run beyond phone calls, and cost at scale. Retell is a managed platform with a visual editor, Vapi a developer-oriented managed platform configured via API and dashboard, and LiveKit an Apache 2.0 open source framework with self-hosting. Estimated all-in cost per minute runs about $0.070–$0.310 for Retell, $0.070–$0.116 for Vapi and $0.037–$0.099 for LiveKit.

  3. Figma Blog50

    Figma agent exits beta with guidelines, cross-platform context, and multiplayer agent following

    The Figma agent is out of beta with better instruction-following and long-task handling, winning over 60% of human-graded evals with professional designers. New capabilities let library owners upload markdown guidelines, pull context from FigJam, Figma Slides, and Figma Design, and follow collaborators' agents on the canvas. Uber's design systems team now publishes documentation that once took multiple people months in a single afternoon.

October 5Monday
  1. Modal Blog35

    TypeSafe AI scales Jev to trillions of tokens in three days on Modal

    TypeSafe AI used Modal's serverless platform to train and deploy Jev, its first System One Model, and served over one trillion tokens within three days of launch. Jev is not an autoregressive LLM: it takes state and questions as input and outputs typed, structured values with probabilities in parallel, targeting low-latency workloads. A week after launching, it topped OpenRouter's leaderboard for 1K-10K token contexts, handling 15.1% of requests.

October 2Friday
  1. OpenClaw Blog40

    Tencent AIG Joins ClawScan to Strengthen ClawHub Skill and Plugin Security Review

    Tencent's AI-Infra-Guard (AIG) has been integrated into ClawScan, the open-source command-line tool powering security review on ClawHub, so every uploaded skill and plugin now passes through AIG. ClawScan runs AIG and NVIDIA's SkillSpector independently, with an AI judge making the final assessment. On a fixed 556-case subset of SkillTrustBench, ClawScan matched 86.9% of benchmark labels and correctly classified 98.6% of malicious cases.

October 1Thursday
  1. Modal Blog58

    Modal Clusters 正式可用，通过 @modal.clustered 一行代码获取多节点 RDMA 集群

    Modal announced that Modal Clusters are generally available to all workspaces, letting users request multi-node clusters through the single decorator @modal.clustered. The clusters provide InfiniBand RDMA communication at up to 6.4 Tbps, automatically configured for PyTorch and NCCL, with clusters starting within seconds and billed by the second. Modal also describes a new gang scheduler that places N nodes at once and RDMA support built into the gVisor runtime, with Decagon, 1x and Runway cited as users for trillion-parameter fine-tuning, world model pre-training and multi-node video inference.