Skip to content
Only Products
July 27Monday
  1. Modal Blog75

    Moonshot's Kimi K3 now available on Modal with day-zero vLLM support

    Modal made Moonshot's Kimi K3 available on its platform on release day, offering the 2.8 trillion parameter multimodal model with a 1M token context window through a token-priced Shared API and dedicated Auto Endpoints. Modal says a custom DFlash speculator tuned to K3's architecture raises interactivity from 100 to 460 tokens per second and throughput from 800k to 1.5 million TPM per GPU on agentic workloads. The model uses a mixture-of-experts design with 16 of 896 experts active per token, and Moonshot contributed a new prefix-caching implementation to vLLM ahead of the release.

    Why it matters: Modal details how it brought Moonshot's 2.8T-parameter Kimi K3 to its platform on release day, including a custom DFlash speculator that lifts interactivity from 100 to 460 tokens per second.

July 21Tuesday
  2. Modal Blog58

    Modal and Cognition launch Devin Outposts with modal-devin sandbox integration

    Modal is a launch partner for Devin Outposts, a Cognition feature that moves Devin's code execution into an environment the customer controls while Devin's reasoning stays in Cognition's cloud. The open-source modal-devin library and CLI runs each Outpost session in a Modal Sandbox, giving access to GPU-backed machines, custom images, workspace snapshotting and scale-to-zero, and it is live in alpha starting July 21, 2026. Setup uses uvx modal-devin init, which generates an orchestrator function and a worker session function that teams can keep customizing.

July 16Thursday
  1. Modal Blog60

    Modal rebuilds its sandbox platform to run 1 million concurrent sandboxes, created in under a minute

    Modal has rebuilt its core sandbox platform from the ground up, and on the new system it ran 1 million sandboxes concurrently, creating all of them in under a minute. The redesign removes central coordination and any data store from the sandbox creation path: horizontally scaled scheduling servers pick a worker with an in-memory algorithm and call it directly, while workers publish state asynchronously to a Redis stream. Modal says sandbox start latency is under half a second at the median, and the new system is already available in Beta with a one-line code change to opt in.

    Why it matters: Modal rebuilt its sandbox control plane to drop central coordination, showing how far container scheduling can scale once global consistency leaves the critical path.

July 15Wednesday
  1. Modal Blog60

    Thinking Machines' Inkling multimodal model now available on Modal

    Thinking Machines released Inkling, a general-purpose multimodal model that takes text, image and audio inputs and outputs text, and Modal is offering it from day zero as a Managed Endpoint with token-based pricing. Inkling is a mixture-of-experts transformer with 975B total parameters, 41B active, a 1M token context window and native audio and vision, using five sliding-window attention layers for every full-attention layer. On agentic workloads with 8x B200s, Modal's custom DFlash speculator reached 250 tokens per second per user at 2.5M TPM of per-GPU throughput, 67% faster interactivity than the model's built-in speculative path at matched throughput.

    Why it matters: Modal's day-zero endpoint for Thinking Machines' 975B-parameter Inkling shows how a custom DFlash speculator lifts interactivity 67% over the model's built-in speculative path.

June 30Tuesday
  1. Modal Blog66

    Anthropic launches Claude Science with Modal as scalable compute backend

    Anthropic launched Claude Science on June 30, an AI workbench where life sciences researchers run computational workloads directly inside a conversation with Claude. Modal integrates as the compute backend: workloads needing GPUs or many concurrent CPUs route automatically to Modal sandboxes from a researcher's connected workspace, while default execution stays sandboxed on the local machine. Modal cites fan-out virtual screening across hundreds of containers, per-step GPU access for models like ESMFold2, shared Modal Volumes storage and reproducible Modal Images, and commits up to $100,000 in compute for Anthropic's AI for Science Claude Science Cohort at $500–$2,000 per project, with applications open through July 15, 2026.

    Why it matters: Modal's post explains how Claude Science routes GPU and parallel workloads to Modal sandboxes, with concrete life-science examples and a compute grant for academic labs.

June 25Thursday
  1. Modal Blog55

    Modal launches serverless Servers for low-latency HTTP, WebSocket and gRPC traffic

    Modal launched Servers, a regionalized autoscaling pool of HTTP server replicas for HTTP, WebSocket and gRPC traffic aimed at latency-sensitive workloads such as LLM inference for interactive agents. Modal says it cut p50 latency from 39ms to 6ms by keeping control-plane lookups and queueing off the request path, so clients get a 503 when no replica is available and must handle load shedding in the application. The routing layer runs on AWS EKS with Envoy at the edge and Modal's in-house Rust proxy fprs, built on Cloudflare's pingora, handling domain association and load balancing, with config read from Spanner and cached in memory.

June 24Wednesday
  1. Modal Blog58

    Modal launches Auto Endpoints, citing speculative decoding for state-of-the-art inference latency

    Modal is launching Modal Auto Endpoints, which bring Modal's infrastructure scalability to state-of-the-art inference performance with a single click while keeping control of the code. Modal says the main latency win comes from speculative decoding with custom DFlash speculator models, which cut about 100ms of end-to-end latency in a Decagon Voice case study, roughly 40% of server-side decode latency, making it over 60ms faster than the fastest proprietary alternative. Modal also released open source DFlash speculator models with Z Lab and SGLang, including one for Qwen 3.5 397B-A17B that improves on MTP by over 50%.

June 23Tuesday
  1. Modal Blog60

    Modal launches Auto Endpoints for self-serve, OpenAI API-compatible LLM inference

    Modal launched Auto Endpoints, a self-serve service that deploys production-grade LLM inference as an OpenAI API-compatible endpoint backed by a Modal App the user can see and control. Each supported model ships with a starting deployment tuned from Modal's own benchmarking, using engines like SGLang and the DFlash speculative decoding drafter from Z Lab, and users can inspect GPU choices, engine flags and inference metrics such as TTFT, ITL and speculative decoding acceptance length. Modal also released Modal Servers from beta for regionalized routing with 5ms overhead, and said it generates endpoint deployments with an internal agentic system still monitored by human engineers.

    Why it matters: Modal's Auto Endpoints expose the serving stack, engine metrics and benchmark recipes that managed inference providers keep hidden, giving teams a self-serve path to owning open-model inference.

June 22Monday
  1. Modal Blog36

    Modal explains why sandbox "started" ≠ "ready" and how warm pools cut perceived startup latency

    Modal argues that container scheduling and boot time, which most sandbox benchmarks measure as time to interactive, is the smallest part of what users actually wait through; application-level setup after the container starts often takes multiple seconds. Modal is making Readiness Probes generally available to signal when a sandbox has finished initializing, and recommends warm sandbox pools built on modal.Queue plus Directory Snapshots to move setup off the user's critical path.

June 19Friday
  1. Modal Blog60

    Modal releases DFlash speculators for Qwen 3.5 and 3.6, claiming 5-20% extra speedup

    Modal released a set of DFlash draft models for the Qwen series on Hugging Face, including Qwen 3.6 35B-A3B-DFlash and Qwen 3.5 variants from 4B to 122B-A10B, plus a DFlash speculator for Qwen 3.5 397B-A17B built with SGLang. The company says the new drafters add 5-20% speedup over existing DFlash baselines and can run Qwen 3.5 122B-A10B at over 1000 tok/s at concurrency 1 on a B200 node, versus 250 tok/s without speculation. The post argues speculative decoding delivers 2x-3x gains where kernel optimization yields small percentage points, and presents a roofline model for estimating speedup from acceptance length.

    Why it matters: Modal explains why it bets on speculative decoding and releases DFlash draft models for the Qwen series, with measured speedups and a roofline model for estimating gains.

June 15Monday
  1. Modal Blog34

    Modal Product Updates: VM Sandboxes, Regional Routing, RBAC and More

    Modal shipped a batch of platform updates, including alpha VM Sandboxes that run a real Linux kernel to support Docker containers, eBPF, systemd and cgroups. Functions can now route through US West, EU West or Asia Pacific South instead of the default US East region, and RBAC is available to all Team and Enterprise plans. Sandbox readiness probes are now GA, and the Python SDK 1.5.0 and JS/Go SDK 0.8.0 set a 30-day default snapshot TTL.

June 11Thursday
  1. Factory62

    Factory rolls out automated security review in Droid

    Factory is rolling out automated security review in Droid, which runs a STRIDE-based security review alongside standard code review on every non-draft PR and posts findings with severity, a CWE reference, an explanation and a suggested fix as inline comments on the diff. The company says Droid's security review has been run across production codebases and surfaced findings that went through responsible disclosure, including CVE-2026-42876 in external-secrets and workos/workos-node#1578. Droid builds a lightweight threat model of the changed surface, scans for vulnerabilities such as OWASP Top 10 and OWASP LLM Top 10 issues, then validates each candidate finding against the diff to filter false positives before posting one deduplicated summary per PR.

    Why it matters: Factory's Droid now runs a STRIDE-based security review on every non-draft PR, and the post shows real CVEs it surfaced in production codebases.

May 27Wednesday
  1. MiniMax Blog72

    MiniMax upgrades Agent as Mavis and launches Agent Teams for long-running tasks

    MiniMax upgraded MiniMax Agent under the new name Mavis and launched Agent Teams, which let multiple role-specific Agents run in parallel on the desktop for long, complex tasks. The system uses Leader, Worker and Verifier roles with a state-machine Team Engine that cycles tasks through producing, verifying and done, and it merges TokenPlan and Agent Plan into one subscription spanning CLI, API and Agent across M2.7, music, video and voice. MiniMax says the Agent will be open-sourced soon, expected alongside the MiniMax M3 model, while the desktop app is already available.

    Why it matters: MiniMax explains the design tradeoffs behind its Leader-Worker-Verifier Agent Team, including handoff, sharing and aggregation costs, offering a concrete reference for building multi-Agent runtimes.

  2. Modal Blog38

    Modal opens Role-Based Access Control to all Team and Enterprise users

    Modal is making Role-Based Access Control (RBAC) available to all users on Team and Enterprise plans, built around Environments as enforceable security boundaries. Restricted Environments make workspace members read-only by default, with only explicitly granted users or agents able to deploy and manage resources, and RBAC ties into Audit Logs for a full record of who did what and when.

May 19Tuesday
  1. Modal Blog55

    Modal launches first-class Sandboxes integration with Claude Managed Agents

    Modal announced a first-class integration between Modal Sandboxes and Anthropic's Claude Managed Agents, letting all tool calls run in a self-hosted Modal Sandbox while Anthropic's managed agent loop handles session state. Modal cites fast cold starts on custom images, snapshot and volume persistence, burst pricing with no idle costs, short-lived connect tokens, and upwards of 100,000 concurrent sandboxes per customer. The company also published two reference examples, a CLI agent and a Slack bot, on the same Modal plus Managed Agents backbone.

April 30Thursday
  1. OpenAI Developers Blog47

    OpenAI Developers plugin for ChatGPT and Codex

    OpenAI released a Developers plugin that gives ChatGPT and Codex access to the OpenAI API Platform and API setup guidance, with adaptations for Claude Code and Cursor bundling portable developer skills and the public OpenAI Docs MCP server. It covers API key setup, Agents SDK app building, API migration to the Responses API, and troubleshooting common API failures.

April 23Thursday
  1. Factory55

    Factory launches Automated QA skill that tests apps like a real user and reports in PRs

    Factory released an Automated QA skill that drives apps the way a real user would, filling forms, typing into terminals and calling endpoints, then posts a structured report with screenshots, terminal snapshots and API traces as a single comment on each pull request. The skill runs on every push via Droid, can be configured as an optional CI check triggered by a PR label, comment command or manual dispatch, and is also available locally through /qa in any Droid session. Setup uses /install-qa, and the feature is available today in all Factory plans.

April 16Thursday
  1. OpenAI Developers Blog60

    OpenAI Codex app update extends to tools, apps and automations

    OpenAI published an overview of new Codex app updates aimed at working across tools, apps, automations and other developer workflows. The material is a short summary only, so specific features, versions and availability details are not described.

    Why it matters: OpenAI outlines Codex app updates that extend the coding agent across tools, apps and automations, showing how its scope is widening beyond code generation.

April 15Wednesday
  1. Vapi Blog50

    Vapi Launches Vapi Monitoring for Production Voice Agents

    Vapi released Vapi Monitoring, a monitoring product that lets teams create customizable monitors for voice agents and get alerted when thresholds are hit. It covers effectiveness and compliance monitoring for Enterprise subscriptions, plus technical and infrastructure monitoring, and surfaces issues with affected call counts and recommended fixes.

April 14Tuesday
  1. Modal Blog40

    Modal Autoscaling Autoresearch: Elastic GPUs for AI Research Agents

    Modal demonstrates running autoresearch agents on elastic GPUs: given Modal Skills, Claude Code ran 113 experiments over 238 GPU-hours on OpenAI's Parameter Golf challenge, finishing core training runs 5x faster than a single workstation while using a fraction of a dedicated cluster's resources. Agents provision GPUs via API calls, scaling from one to dozens of H100s and back to zero automatically.

April 7Tuesday
  1. Modal Blog22

    Modal Product Updates: RTX Pro 6000 Blackwell, Command K, Sandbox FS API

    Modal now offers NVIDIA's RTX Pro 6000 Blackwell with 96GB of VRAM and strong fp4/fp8 throughput, available via a single line of code for inference and fine-tuning workloads. The update also adds a dashboard Command Palette (CMD+K), a revamped Sandbox Filesystem API in beta supporting reads up to 5GB and streaming in both directions, and CLI log commands with historical fetching.

April 1Wednesday
  1. Vapi Blog18

    Vapi Launches Enhanced Security Mode for Enterprise Voice AI Audio Privacy

    Vapi released Enhanced Security Mode, an audio privacy layer it calls the quietest and most secure ever deployed in an enterprise voice AI platform, designed to prevent AI agent speech from being overheard in open spaces. The company says its entire audio pipeline was re-engineered to invert signal-presence optimizations without adding latency artifacts. Early access covered healthcare, benefits administration, and post-acute care organizations, and the feature is available now.

March 20Friday
  1. Vapi Blog38

    Vapi Webinar Answers Top Questions on Composer Voice Agent Builder

    Vapi hosted a webinar in which Principal Product Manager Nick Robin demoed Composer, its in-product assistant for building voice agents without code, producing a working inbound customer service agent within a 30-minute demo. Composer writes system prompts, provisions phone numbers, sets scheduling and flags its own errors for approval. It is currently in alpha and supports both inbound and outbound assistants, CRM and calendar integrations, and editing of existing agents by assistant ID.

March 4Wednesday
  1. Modal Blog22

    Modal Product Updates: Directory Snapshots, GLM-5 Endpoint and Billing API

    Modal added Directory Snapshots for Sandboxes, letting users snapshot a single directory and mount it into a new Sandbox independently of the base image. Modal also released a free public GLM-5 endpoint with Z.ai through the end of April, compatible with OpenCode, Claude Code, OpenClaw and the Vercel AI SDK. The modal billing report CLI and modal.billing.workspace_billing_report API are now generally available for Team and Enterprise workspaces.

February 25Wednesday
  1. Vapi Blog35

    Vapi Ships Skills and MCP Connector So Coding Agents Can Build Voice Agents

    Vapi released Vapi Skills, a repo following the Agent Skills standard, plus a Model Context Protocol connector that gives coding agents live access to Vapi's documentation. One install command loads step-by-step instructions with exact API schemas for workflows like create-assistant, create-tool, create-call, and setup-webhook, and the skill pack runs on Claude Code, Cursor, VS Code Copilot, and Gemini CLI.

February 24Tuesday
  1. Modal Blog55

    Modal launches Directory Snapshots in public beta for Sandbox project state

    Modal launched Directory Snapshots in public beta, letting users snapshot a specific directory inside a running Sandbox and mount it into another Sandbox independently of the base image and the rest of the filesystem. The feature targets coding agents and vibe coding platforms that need to preserve project state across sandbox restarts, and Modal says it enables separating system dependencies from application code, pre-warming sandbox pools, and faster pre-loading of key files. Directory Snapshots persist for 30 days after last use and mount instantly, with contents prioritized for pre-loading on Modal's lazy-loading container filesystem.

February 11Wednesday
  1. Vapi Blog55

    Vapi launches Composer, an in-dashboard AI assistant that builds voice agents

    Vapi shipped Composer, an AI assistant inside the Vapi Dashboard that builds voice agents from a description, writing the prompt, configuring settings, provisioning phone numbers, building tools and setting up integrations. Composer can also pull call logs to explain a failed call and apply a fix, and generate custom code tools that run on Vapi's infrastructure for integrations such as HubSpot. It is available now in Alpha with no setup or onboarding flow.

  2. Modal Blog78

    Modal 上线 GLM-5 免费端点并发布自部署与前端接入指南

    Modal 推出 GLM-5 的免费 OpenAI API 兼容端点，可用至 4 月底，限单个并发请求，同时发布在单节点 8 张 B200 上用 SGLang 部署的可复现代码。

    Why it matters: Modal 为 Z.ai 的 GLM-5 提供免费 OpenAI 兼容端点，并给出在 OpenCode、OpenClaw、Claude Code 和 Vercel AI SDK 中接入的具体配置。

February 2Monday
  1. OpenAI Developers Blog62

    OpenAI introduces the Codex app

    OpenAI introduced the Codex app, a dedicated app for its Codex coding agent, in an official developers blog post. The post is an intro walkthrough covering the app and its core workflows, with the full video hosted on YouTube.

    Why it matters: OpenAI's official walkthrough shows how the Codex app structures core coding workflows, useful for developers weighing it against existing coding agents.

January 28Wednesday
  1. Modal Blog22

    Modal Product Updates: AWS & GCP Marketplace Availability, Sandbox Observability, and Client Updates

    Modal is now purchasable through AWS and Google Cloud Marketplaces, letting enterprise customers apply existing cloud spend commitments to Modal usage. The platform also shipped Sandbox UI updates with clearer resource and region details plus a new execution timeline, and client 1.3.1 adds Python 3.14 support including experimental free-threaded Python (3.14t) in Modal containers.

January 20Tuesday
  1. Factory58

    Factory launches Agent Readiness to score how well codebases support AI coding agents

    Factory launched Agent Readiness, which evaluates how well a codebase supports autonomous development across eight technical pillars and five maturity levels, runnable via /readiness-report in Droid, an organization dashboard, or an API. Each criterion is binary and a level unlocks only when 80% of its criteria and all prior levels pass; grounding each evaluation on the repository's previous report cut score variance from an average of 7% to 0.6% across 9 benchmark repositories over six weeks. Reports can trigger an agent that opens a pull request to fix failing criteria such as missing AGENTS.md, linter configuration, or pre-commit hooks.

January 6Tuesday
  1. OpenAI Developers Blog42

    OpenAI Launches Docs MCP Server for Developer Documentation

    OpenAI released a public Model Context Protocol (MCP) server that gives agents read-only access to developer documentation across developers.openai.com, platform.openai.com, and learn.chatgpt.com. The server is documentation-only and does not call the OpenAI API on the user's behalf. Developers can add it to Codex via the CLI or IDE extension with a single shared configuration, and pair it with the OpenAI Docs Skill for citation-backed answers.

December 23, 2025Tuesday
  1. Replit Blog70

    Replit launches in-ChatGPT app building via @replit and Replit Agent

    Replit is now available inside ChatGPT, letting users tag @replit in any message to have Replit Agent create, update and deploy Replit Apps directly in the conversation. Build progress and an interactive preview appear in-chat, and each request such as adding dark mode or a payment form updates the app instantly, with apps stored in the user's Replit account for later publishing. The integration requires a ChatGPT account (Free, Plus, Pro or Teams) and a Replit account, works where the ChatGPT App Store is available, and consumes Replit Agent credits.

    Why it matters: Replit's ChatGPT integration lets users describe an app in chat and have Replit Agent build, preview and deploy it without leaving the conversation.

December 17, 2025Wednesday
  1. Vapi Blog38

    Vapi Voices Beta Launches at $0.0025/min for High-Volume Voice AI

    Vapi released Vapi Voices Beta, a family of voice models built for high-volume, cost-sensitive voice AI use cases, priced at $0.0025 per minute with latency optimized for conversational responsiveness. The models appear in the existing voice dropdown alongside providers like ElevenLabs, PlayHT and Deepgram, so teams can route high-volume, low-stakes flows such as appointment reminders and routing menus to them with zero integration changes. Vapi says it is gating general availability on what beta usage reveals about use cases, latency under real load and whether the savings matter.

December 2, 2025Tuesday
  1. Modal Blog42

    Modal adds Day 0 support for Mistral 3 with GPU snapshotting for 10x faster cold starts

    Modal now offers Day 0 support for Mistral 3, letting developers deploy the open model family on serverless GPUs without managing infrastructure. On the 3B Ministral 3 model, Modal's GPU snapshotting feature cut median cold start time from about 118s to about 12s, nearly a 10x reduction. Ministral 3 comes in 3B, 8B, and 14B sizes and performs competitively with the Qwen 3-VL series on benchmarks.

November 20, 2025Thursday
  1. Vapi Blog42

    Vapi adds structured outputs to extract schema-validated data from voice AI calls

    Vapi now supports structured outputs for all voice AI assistants, ensuring every call returns data that matches a developer-defined JSON schema. Schemas are enforced at runtime using provider-native capabilities from OpenAI, Anthropic, Gemini and others, and can be reused across multiple assistants. Extracted data arrives in call completion webhooks and the REST API.

  2. Replit Blog42

    Replit launches Fast Mode for quicker, cheaper Agent edits

    Replit launched Fast Mode, a faster way to direct its Agent to make small, precise changes. It runs on an efficient agentic model that is significantly more affordable than Build mode and optimized to finish requests in the fewest steps, aimed at quick fixes, visual iterations and small features. Fast Mode is available to all Replit users starting today and is activated via the lightning bolt icon.

October 31, 2025Friday
  1. Modal Blog22

    Modal updates Volumes v2, JavaScript and Go SDKs to beta

    Modal has released Volumes v2 in open beta for all apps, with a filesystem rebuilt for higher throughput, faster random access, and true high-concurrency writes from hundreds of containers, plus no cap on stored files. Its JavaScript/TypeScript and Go SDKs also entered beta at v0.5, adding a unified Client object and support for Sandboxes, Functions, Images, and Volumes.

October 30, 2025Thursday
  1. Modal Blog38

    Modal and Datalab: Deploy Marker and Surya Document Intelligence in Under 5 Minutes

    Modal has partnered with Datalab to let developers deploy the Marker document-parsing model and Surya OCR toolkit on Modal GPUs in under five minutes. Marker is a sub-billion-parameter model supporting over 90 languages, and running it on Modal reaches about 2.2 pages per second per container, roughly 10x the 0.22 pages per second on an M4 Mac using Apple MPS. Datalab's tools stay free for research, personal use, and startups under $2M in funding or revenue, with commercial licensing available.