Vapi released Vapi Skills, a repo following the Agent Skills standard, plus a Model Context Protocol connector that gives coding agents live access to Vapi's documentation. One install command loads step-by-step instructions with exact API schemas for workflows like create-assistant, create-tool, create-call, and setup-webhook, and the skill pack runs on Claude Code, Cursor, VS Code Copilot, and Gemini CLI.
OpenAI released a Codex prompting guide for developers calling the Codex-tuned gpt-5.3-codex model directly through the API, recommending medium reasoning effort for interactive coding and high or xhigh for the hardest tasks. The guide covers migrating an existing harness to the open-source codex-cli, including the standard Codex-Max prompt, the apply_patch, shell_command and update_plan tools, and first-class compaction via /compact in the Responses API for multi-hour sessions. It also describes the new phase field, supported only on gpt-5.3-codex, which marks assistant items as commentary or final_answer and must be preserved in history to avoid performance degradation.
Why it matters: OpenAI's official guide details how to tune prompts, tools and compaction for gpt-5.3-codex, giving teams a concrete migration path for their own coding agents.
Modal, a cloud infrastructure platform for data- and compute-intensive AI workloads, highlights research from Hazy Research, Scaling Intelligence, and IRIS that used its GPU fleet to speed up AI research. The KernelBench project, led by Scaling Intelligence's Anne Ouyang, Simon Guo, and Will Hu, provides a 250-problem benchmark and research environment for automated GPU kernel generation, using Modal for consistent, scalable benchmarking across hardware from L40s to Blackwell systems.
OpenClaw agents can now make and receive phone calls through Vapi's AgentSkills-compatible skills, installed in about five minutes via the npx skills CLI or by asking the agent directly. The Vapi pipeline targets sub-500ms voice responses and supports mid-call tool calling, with eight skills covering assistants, calls, phone numbers, tools, squads, webhooks and workflows.
Modal launched Directory Snapshots in public beta, letting users snapshot a specific directory inside a running Sandbox and mount it into another Sandbox independently of the base image and the rest of the filesystem. The feature targets coding agents and vibe coding platforms that need to preserve project state across sandbox restarts, and Modal says it enables separating system dependencies from application code, pre-warming sandbox pools, and faster pre-loading of key files. Directory Snapshots persist for 30 days after last use and mount instantly, with contents prioritized for pre-loading on Modal's lazy-loading container filesystem.
Ramp built Ramp Inspect, an internal background coding agent running on Modal Sandboxes, and it now starts roughly half of all merged pull requests across Ramp's frontend and backend repos. Each session boots a full-stack environment with Postgres, Redis, Temporal and RabbitMQ in seconds, because a Modal cron job clones repos and saves filesystem snapshots every 30 minutes. Modal Functions, Dicts and Queues handle snapshot builds, session locks and prompt routing, letting Inspect support multiplayer sessions and hundreds of concurrent sessions without one affecting another.
Vapi shipped Composer, an AI assistant inside the Vapi Dashboard that builds voice agents from a description, writing the prompt, configuring settings, provisioning phone numbers, building tools and setting up integrations. Composer can also pull call logs to explain a failed call and apply a fix, and generate custom code tools that run on Vapi's infrastructure for integrations such as HubSpot. It is available now in Alpha with no setup or onboarding flow.
Modal 推出 GLM-5 的免费 OpenAI API 兼容端点，可用至 4 月底，限单个并发请求，同时发布在单节点 8 张 B200 上用 SGLang 部署的可复现代码。
Why it matters: Modal 为 Z.ai 的 GLM-5 提供免费 OpenAI 兼容端点，并给出在 OpenCode、OpenClaw、Claude Code 和 Vercel AI SDK 中接入的具体配置。
OpenAI introduced the Codex app, a dedicated app for its Codex coding agent, in an official developers blog post. The post is an intro walkthrough covering the app and its core workflows, with the full video hosted on YouTube.
Why it matters: OpenAI's official walkthrough shows how the Codex app structures core coding workflows, useful for developers weighing it against existing coding agents.
Modal is now purchasable through AWS and Google Cloud Marketplaces, letting enterprise customers apply existing cloud spend commitments to Modal usage. The platform also shipped Sandbox UI updates with clearer resource and region details plus a new execution timeline, and client 1.3.1 adds Python 3.14 support including experimental free-threaded Python (3.14t) in Modal containers.
Factory launched Agent Readiness, which evaluates how well a codebase supports autonomous development across eight technical pillars and five maturity levels, runnable via /readiness-report in Droid, an organization dashboard, or an API. Each criterion is binary and a level unlocks only when 80% of its criteria and all prior levels pass; grounding each evaluation on the repository's previous report cut score variance from an average of 7% to 0.6% across 9 benchmark repositories over six weeks. Reports can trigger an agent that opens a pull request to fix failing criteria such as missing AGENTS.md, linter configuration, or pre-commit hooks.
Chai Discovery is using Modal to run its machine learning drug discovery pipelines, from protein embeddings and multiple sequence alignments to antibody design. Modal Volumes downloads and indexes datasets reaching hundreds of gigabytes once, then shares them across machines, while elastic GPU scaling spins up hundreds of GPUs in minutes. Chai says the same setup now carries research workflows into production without rewriting infrastructure.
OpenAI released a public Model Context Protocol (MCP) server that gives agents read-only access to developer documentation across developers.openai.com, platform.openai.com, and learn.chatgpt.com. The server is documentation-only and does not call the OpenAI API on the user's behalf. Developers can add it to Codex via the CLI or IDE extension with a single shared configuration, and pair it with the OpenAI Docs Skill for citation-backed answers.
Modal has scaled its multi-cloud GPU worker pool past 20,000 concurrent GPUs and launched over four million cloud instances in the last couple years, and is now sharing the reliability system behind it. The post covers instance type testing and selection, machine image preparation and boot checks, passive and active GPU healthchecking, and observability and support. It reports hyperscaler differences such as Cloud A's 99.6% boot success and Cloud C's H100s running above 90ºC in 2025.
Replit is now available inside ChatGPT, letting users tag @replit in any message to have Replit Agent create, update and deploy Replit Apps directly in the conversation. Build progress and an interactive preview appear in-chat, and each request such as adding dark mode or a payment form updates the app instantly, with apps stored in the user's Replit account for later publishing. The integration requires a ChatGPT account (Free, Plus, Pro or Teams) and a Replit account, works where the ChatGPT App Store is available, and consumes Replit Agent credits.
Why it matters: Replit's ChatGPT integration lets users describe an app in chat and have Replit Agent build, preview and deploy it without leaving the conversation.
Vapi released Vapi Voices Beta, a family of voice models built for high-volume, cost-sensitive voice AI use cases, priced at $0.0025 per minute with latency optimized for conversational responsiveness. The models appear in the existing voice dropdown alongside providers like ElevenLabs, PlayHT and Deepgram, so teams can route high-volume, low-stakes flows such as appointment reminders and routing menus to them with zero integration changes. Vapi says it is gating general availability on what beta usage reveals about use cases, latency under real load and whether the savings matter.
Modal now offers Day 0 support for Mistral 3, letting developers deploy the open model family on serverless GPUs without managing infrastructure. On the 3B Ministral 3 model, Modal's GPU snapshotting feature cut median cold start time from about 118s to about 12s, nearly a 10x reduction. Ministral 3 comes in 3B, 8B, and 14B sizes and performs competitively with the Qwen 3-VL series on benchmarks.
Modal argues that the same developer-experience principles that help humans—tight feedback loops, programmatic access via CLI/SDK/API, actionable error messages, and consistent code-adjacent examples—also make coding agents faster. Because agents iterate by generating, running, and observing code, vague errors or UI-only config stall them, so designing for agents means applying the same principles rather than reinventing them.
Vapi now supports structured outputs for all voice AI assistants, ensuring every call returns data that matches a developer-defined JSON schema. Schemas are enforced at runtime using provider-native capabilities from OpenAI, Anthropic, Gemini and others, and can be reused across multiple assistants. Extracted data arrives in call completion webhooks and the REST API.
Replit launched Fast Mode, a faster way to direct its Agent to make small, precise changes. It runs on an efficient agentic model that is significantly more affordable than Build mode and optimized to finish requests in the fewest steps, aimed at quick fixes, visual iterations and small features. Fast Mode is available to all Replit users starting today and is activated via the lightning bolt icon.
Reducto migrated inference workloads for its 30+ document-processing models to Modal, cutting P90 latency by 3x. GPU memory snapshotting reduced cold boots by 83%, from ~70s to ~12s, while per-customer autoscaling pools isolate traffic spikes. In a load test, Reducto scaled its ingestion pipeline to over 1,000 GPUs in under an hour to demonstrate 100k pages per minute.
OpenAI's GPT-5.1 adds consistent personality presets — Default, Professional, Friendly, Candid, Quirky, Efficient, Nerdy, and Cynical — plus a more conversational GPT-5.1 Instant and fast adaptive reasoning that gives simple questions quick replies while complex ones get more thinking. Vapi says the model went live on its platform last week alongside OpenAI's announcement, letting voice agents adopt brand-consistent tones without prompt rewrites.
Modal's blog explains how host overhead—gaps where the GPU sits idle waiting for the CPU to prepare work—shows up as low GPU kernel utilization in AI inference. At 50% host overhead, GPU inference costs are 2x what they could be. The post details fixes used in production open source inference engines, including constructing tensors on-device instead of transferring them and reducing unnecessary CUDA kernel launches.
Decagon and Modal partnered to build Decagon Voice 2.0, cutting latency by 65% while improving intent recognition and response quality. Decagon fine-tuned compact open-source models with SFT and RL to surpass larger frontier models, while Modal trained a custom EAGLE3 draft model with 38% higher accept lengths and re-engineered SGLang with an async speculative decoding scheduler, boosting throughput up to 12%.
Vapi founder recounts how the company staged VapiCon, billed as the first Voice AI summit, drawing 850 attendees and voice AI leaders from OpenAI, Deepgram and Assembly AI into one room. Vapi spent about $500,000 on the event and made roughly $400,000 back, with the founder citing partnerships and enterprise deals as the real return. The company has now launched a VapiCon Video Library of every session and panel.
Modal's Ben Shababo walks through building a conversational voice bot on Modal with the open source Pipecat framework and open weights models, reaching a median voice-to-voice latency of about one second when the client and containers are geographically close. The pipeline uses NVIDIA parakeet-tdt-0.6b-v3 for STT, Qwen3-4B-Instruct-2507 served with vLLM, KokoroTTS for speech output, and ChromaDB with all-minilm-l6-v2 for RAG over Modal's docs. Modal Tunnels bypass the input plane for low-latency WebSocket and HTTP links to the STT, TTS and vLLM services, while a FunctionCall tied to each conversation session recovers autoscaling, and pinning services to nearby regions cuts network latency.
Modal has released Volumes v2 in open beta for all apps, with a filesystem rebuilt for higher throughput, faster random access, and true high-concurrency writes from hundreds of containers, plus no cap on stored files. Its JavaScript/TypeScript and Go SDKs also entered beta at v0.5, adding a unified Client object and support for Sandboxes, Functions, Images, and Volumes.
Modal has partnered with Datalab to let developers deploy the Marker document-parsing model and Surya OCR toolkit on Modal GPUs in under five minutes. Marker is a sub-billion-parameter model supporting over 90 languages, and running it on Modal reaches about 2.2 pages per second per container, roughly 10x the 0.22 pages per second on an M4 Mac using Apple MPS. Datalab's tools stay free for research, personal use, and startups under $2M in funding or revenue, with commercial licensing available.
Vapi is giving its community free, unrestricted access to Cartesia's newly launched Sonic-3 TTS model through its managed API key from October 28 through November 2. Sonic-3 adds emotion and laughter tags, fine-grained speed and volume controls, and support for 27 new languages. Vapi recommends starting with the Kira and Ariana voices for low-latency, natural-sounding agents.
Modal has raised more than $80M in a Series B round led by Lux Capital, bringing its post-money valuation to $1.1B and total funding to $111M. The AI infrastructure provider offers Inference, Sandboxes, Batch and Training products, with sub-second container startup times and usage-based serverless pricing. Meta used Modal to spin up thousands of concurrent sandboxed environments for reinforcement learning with its Code World Models.
Modal engineers read the released Flash Attention 4 source code and reverse-engineered how the Blackwell-optimized attention kernel works, since no official technical report exists yet. The write-up traces a tile through the kernel's warp-specialized asynchronous pipeline and details two math tricks: a cubic-polynomial software exponential that can replace SFU-based exponentiation, and a smarter online softmax rescaling rule that Tri Dao said cuts corrections by a factor of 10. FA4 is reported to be roughly 20% faster than Nvidia's closed-source cudnn attention kernels, and a backwards version was not yet available at the time of writing.
Why it matters: Modal engineers read the released Flash Attention 4 source and explain its warp-specialized pipeline and two math tricks, offering a transferable view of where CUDA kernel design is heading.
Justin Dignelli has joined Modal as VP of Sales, after advising the AI compute platform on its next stage of growth and investing in its Series A. Modal is already generating high eight figures in revenue across thousands of customers, and Dignelli plans to build a GTM organization to scale it further.
Modal built Modal Vibe, an open-source demo vibe coding platform on Modal Sandboxes that scales from 0 to 1,000 AI-coded apps in about five minutes. A load test creating 1,000 apps, each in its own Sandbox, took roughly 300 seconds, with the AI API as the rate-limiting step. Modal says the Team Plan can run 1,000 concurrent Sandboxes, enough for over one million sessions per month.
Modal shipped product updates including Modal Notebooks for cloud-based Python experimentation with up to 8 B200 GPUs, plus an optional idle_timeout parameter for modal.Sandbox.create(). The client also added a startup_timeout parameter to @app.function() and @app.cls() decorators and a new API pattern for imperative management of Modal resource types. Modal Notebooks have since been shut down, though existing notebooks can still be downloaded as .ipynb files.
Modal detailed the engineering behind Modal Notebooks, its cloud Jupyter notebook that boots GPUs and custom images in seconds with real-time collaboration. Kernels run inside Modal Sandboxes, with a modal-kernelshim daemon translating Jupyter ZeroMQ messages into HTTP calls tunneled through Modal's control plane. A lazy-loading Rust FUSE container filesystem fetches file contents on demand through a tiered cache, avoiding the image-unpacking latency that can approach a minute for an 8 GB Python/ML image.
Modal Notebooks is now generally available to all Modal customers after a limited beta last month. The collaborative notebook environment runs on a GPU-enabled Python kernel that reaches a ready state in under 5 seconds on arbitrary container images and hardware up to 256 vCPUs and 8 H100/B200 GPUs, with auto-idle shutdown, shared Volumes and Secrets, and real-time multi-cursor editing. Modal says over 5,000 accounts ran 200,000 code cells during the August beta, and upcoming features include memory snapshots, one-click export to Modal Apps, and scheduled runs.
Zencastr moved its podcast transcription workloads to Modal's GPU platform, scaling to 1,500 concurrent GPUs within minutes to process hundreds of years of audio in just a few days. The shift from self-managed Kubernetes GPU nodes to Modal's scale-to-zero infrastructure cut idle GPU costs and removed driver and dependency management overhead. All core ML workloads now run on Modal, including transcription, speaker counting, laughter detection, and audio quality scoring.
Modal added GPU memory snapshots in alpha, cutting cold boots for GPU workloads by 10x by skipping steps like Torch compilation, enabled via the enable_gpu_snapshot option. The update also brings Modal Notebooks in beta for running Python in the browser, Service Tokens for workspace managers, and browser-generated UIs for deployed Functions.
Modal announced GPU memory snapshots in alpha, extending its existing checkpoint/restore system to capture GPU vRAM, CUDA kernels, streams and contexts so GPU workloads restore from a frozen state instead of rebuilding CUDA state after boot.
Why it matters: Modal adds GPU state to its memory snapshots, cutting cold boots for torch.compile and vLLM workloads by up to 10x and making scale-to-zero more practical.
An AI code sandbox is an isolated environment that executes LLM-generated code at runtime, containing the blast radius of errors or injected vulnerabilities. Modern implementations run on VMs or containers, often using secure runtimes like gVisor to intercept syscalls and shield the host. Most companies choose managed sandbox services over building their own with Kubernetes, since cold starts and scaling to millions of concurrent sessions are costly to handle.