llama.cpp has released v1.0.0, and ggml has also released v1.0.0. Going forward, both projects will indicate incompatible changes to the public C API and ABI through major version number changes. The project team states that as local AI and privacy needs grow and downstream applications increase, stable library interfaces have become critical, and the boundaries for breaking changes will be stricter in the future.
Dyania Health's Synapsis AI clinical reasoning engine reads every note, report and lab result in a patient's record, connecting findings years apart to flag which patients need attention and why, with each signal traceable to its source. It runs on NVIDIA-accelerated computing inside a health system's own firewall, so patient data never leaves the hospital. Cleveland Clinic used it to review records of more than 7,800 aortic valve replacement patients from 2005 to 2021 and build a predictive model of valve deterioration and reintervention risk at three, five and ten years.
Modal now bills Sandboxes by active resource use instead of fixed reservations, letting each Sandbox burst past its default 0.125-core and 128 MiB request and pay only for what it uses each second. In a 20-minute coding agent example, bursting cost 8.4¢ per Sandbox-hour versus 20.0¢ for a fixed reservation, a 58% saving. CPU can burst up to 16 cores above request by default, with memory uncapped unless a limit is set.
Factory launched the Cyber Defense Network, an ecosystem of cybersecurity companies whose findings flow into Security Factory so Factory Droids can investigate vulnerabilities, implement code changes and validate fixes through testing. Founding partners include Snyk, Palo Alto Networks, Semgrep, Cogent, Casco, DepthFirst and Detail. The workflow covers signals from partner tools, triage of reachable vulnerabilities, and continuous remediation that produces fixes ready for engineering teams to review and merge, while organizations keep their existing security tools and workflows.
Databricks details how credential-driven attacks unfold on its platform and how verbose audit logs plus Genie can detect the behavioral shift after a stolen PAT, session cookie, or service-principal credential is used. The post maps adversary activity into six stages, from initial login through environment reconnaissance, and covers response steps and controls that limit what a stolen credential can reach.
Bright Machines now gives customers live, governed dashboards of factory data from air-gapped plants without opening any inbound access. It captures PostgreSQL changes at the edge with Debezium, writes them as Apache Iceberg, pushes them out over one auditable outbound path, and reads them in place in Databricks via Unity Catalog federation. The first customer-visible dashboard went live about two months after kickoff, with committed rows queryable in one to two minutes and dashboards refreshing every ten minutes.
Amazon announced the public availability of SGLang-Neuron, an out-of-tree plugin that runs SGLang on AWS Trainium through an AWS Deep Learning Container, released by RadixArk with Annapurna Labs. Users keep the same SGLang server interface and generation APIs, while the plugin supplies Trainium-specific models, attention, MoE and a graph runner built on native PyTorch and NKI kernels compiled with torch.compile. It also supports PD disaggregation, transferring the prefill KV cache to a decode server via NIXL over EFA, and the walkthrough serves openai/gpt-oss-120b on a Trainium3 EC2 instance with the pytorch-inference-sglang-neuronx container.
Natera built SWARM, an agentic AI system for lab operations, on Amazon Bedrock AgentCore, cutting first response time by about 130x and automating 96.2 percent of support tickets. The system pairs a swarm-agent that drafts diagnostic reports before engineers open a ticket with a swarm-hive for real-time engineer interaction, both sharing one skill library. It addresses over 65 daily Jira tickets across three queues that previously averaged 17.4 hours for first response.
Databricks responds to four common misreadings of LTAP, the Lakebase architecture that keeps one governed copy of operational data serving both Postgres and analytics without CDC. The post argues LTAP is not replication: layers in front of the lake are caches, not a second database with its own catalog. It also says heap pages and Parquet are two lossless encodings of the same rows, so point lookups and scans each read the layout fast for them.
AWS shows how to track and cap Amazon Bedrock generative AI spend per IAM principal using only native features: Bedrock automatically records the IAM user or role on every inference request, and those tags become cost allocation tags readable in Cost Explorer or CUR 2.0 exports. An AWS Budget scoped to Bedrock and filtered to one identity or tag value can attach a budget action that applies a Deny IAM policy once a threshold is crossed, with no application code for the common case.
Amazon Bedrock's cache duration, service tier, reasoning effort, and maxTokens settings can change inference cost without altering the model or prompt. A 5-minute cache write on Claude Sonnet 5 and Claude Opus 5 costs 1.25x the input rate, a 1-hour write costs 2x, and cache reads cost 0.1x; Flex tier requests to unsupported models fail with a ValidationException.
Constellation, the largest US nuclear fleet operator, is building a governed Enterprise Data Platform on Databricks to give the business one shared meaning for its data. The platform uses Unity Catalog for lineage, fine-grained access and a single permission model, plus Data Vault modeling for critical reusable entities. Early use cases include a nuclear engineering assistant built with Databricks Genie and outage planning.
Eclipse Aerospace is using Databricks PySpark custom data sources to ingest nearly 20 years of proprietary flight data, over 3TB spanning more than a million flight hours, without always-on dedicated compute. The Rust-backed Python package delivered twice the benchmarked performance of a similar PyArrow-based pure-Python data source and nearly 20x that of a native Python implementation without Arrow. The API, introduced in Apache Spark 4.0 and available in Databricks Runtime 15.4 LTS, replaces the prior Lambda-to-Avro pipeline.
AWS announced updates to Amazon Bedrock AgentCore runtime, its managed compute layer for agents, with sessions now starting up to 15x faster, scaling to 4x more compute (up to 8 vCPUs and 32 GB, with container images up to 10 GB) and running up to 68% more efficiently, while each session stays in its own hardware-isolated Firecracker MicroVM. Sessions start in under 2 seconds regardless of image size or concurrency, idle agents scale to zero, and agents can mount and save work to a filesystem such as an Amazon S3 bucket with FUSE support so data stays inside the trust boundary. The runtime is available today in AWS Regions across North America, South America, Europe, and Asia Pacific.
A self-service LLM gateway built on Amazon Bedrock Application Inference Profiles and LiteLLM running on AWS Fargate exposes Bedrock foundation models behind an OpenAI-compatible API, giving developers a single base URL and per-user key. The setup adds per-user spend controls, per-model quota isolation, and CloudWatch RPM/TPM observability, with Langfuse for prompt-level telemetry. Self-service key issuance requires LiteLLM Enterprise, since the free tier is limited to five users.
This AWS post argues that Amazon Bedrock spend should be judged by cost per task rather than cost per token, since tokenizer efficiency, output verbosity, agentic loop count and reasoning overhead can make a lower-priced model cost more. A worked example shows a model with 2x the list price finishing 65% cheaper per task, and the post adds caching, routing and output constraints plus a five-dimension scorecard for measuring agent ROI against human baselines.
Databricks announced that Genie Migrate is now generally available, letting companies move their data workloads to the Databricks Lakehouse with less manual effort. The tool targets teams racing to build AI agents and applications on top of lakehouse data.
LangChain argues companies must own their intelligence rather than rely on generic models, controlling three layers: the model, the harness, and the context. It says owning the agent system, plus the economics, quality and risk around it, is what turns AI into lasting advantage.
H6.ai automates accounts payable on top of customers' existing ERPs, using a dedicated Lakebase Postgres database per customer as its system of record. Because invoice data keeps changing, the team uses Lakebase copy-on-write branches to freeze snapshots of customer databases and run each regression test on its own short-lived branch, so the live database is never written to. Each run is judged by deterministic assertions plus a panel of AI judges from different model providers.
Databricks introduced Lakehouse//RT, a real-time analytics engine that runs high-concurrency workloads directly on lakehouse data and is now available in beta. The company says it delivers sub-100 millisecond latency at 12,000 queries per second, adds capacity one node at a time, and avoids a separate serving layer; customers Aurasell, VisionHeight and nOps report 6x to 10x lower infrastructure costs after migrating from multi-cluster setups, Apache Pinot and Apache Druid.
Amazon Bedrock AgentCore Evaluations now lets teams run AWS built-in evaluators alongside managed DeepEval and AutoEval metrics, plus custom evaluators derived from either. The built-in catalog spans 15 evaluators across response quality, goal completion, tool use, skills and safety, with three trajectory checks for expected tool paths. DeepEval adds multi-turn metrics such as ConversationCompleteness and KnowledgeRetention, while AutoEval contributes specialized signals including security.
The Web Search API in Amazon Bedrock AgentCore is now available, giving agents current web results through a single SigV4-signed API call served from a web index Amazon operates. A walkthrough builds a daily dependency watch as a LangGraph graph that researches npm, PyPI, and container base images in parallel, with date windows, blocklists, and search budgets enforced in code. In testing, the three branches finished in 36 seconds versus 99 seconds run sequentially.
Moonshot AI's Kimi K3.1 Pro Highspeed is now available on Amazon Bedrock, a post-trained version of Kimi K3 with the same 3T-class open-weight architecture and 1-million-token context window, trained with more post-training compute for long-horizon agentic work and fewer factual errors. Moonshot AI reports 2–3 times the output speed of Kimi K3.1 Pro, and existing Kimi K3 users can switch by changing the model ID. The post shows Chat Completions, Responses and Converse API calls, the Flex tier at half the Standard price, explicit prompt caching with prompt_cache_breakpoint, and connecting the model to the OpenCode coding agent.
Amazon SageMaker AI bidirectional streaming now supports usage-based metering, letting model providers report actual consumption to AWS Marketplace software charges while endpoint infrastructure fees still apply. Deepgram is the launch partner, bringing usage-based Speech-to-Text and Text-to-Speech billing to AWS Marketplace. The design adds a companion WebSocket metadata stream, capped at one message per second and 512 bytes, so providers can send incremental metering records during live sessions.
AWS has open-sourced UAEF (Universal Agent Evaluation Framework), a framework-agnostic system that uses adapters to normalize agent traces from LangGraph, LangChain, Strands Agents, Amazon Bedrock AgentCore and Langfuse into one canonical AgentTrace, then scores them with 36 built-in metrics across 7 dimensions. Results are stored per experiment in Amazon DynamoDB and Amazon S3, so teams can compare agent versions against a baseline, flag regressions with a default 5 percent threshold, and generate statistical reports plus LLM-written insights. The post says customers across 12 organizations in telecom, healthcare and financial services used UAEF before release, and the Apache 2.0 code, Python library, CDK deployment and per-framework notebooks are in the awslabs/uaef GitHub repository.
Why it matters: The AWS team has open-sourced UAEF, which uses adapters to unify agent trajectories from different frameworks into a single format, then scores them across 7 dimensions using 36 metrics, providing a reusable evaluation layer for comparing agent versions across frameworks.
AWS Quick introduces AI-PDLC, a framework of six specialized agents—led by an Orchestrator covering Discovery, Prioritize, Working Backwards, Spec Generator, and Designer—that turns scattered enterprise signals from Slack, Jira, Salesforce and SharePoint into a traceable prototype_spec.md. Every phase requires human approval, and the spec can be handed to coding agents like Kiro or Claude Code via the open Agent Client Protocol (ACP).
AWS has published a catalog of 23 production-ready, open source generative AI assets from its Generative AI Innovation Center, now part of AWS Frontier AI Engineering & Services. The building blocks cover RAG pipelines, document processors, agent scaffolding and evaluation frameworks, and AWS says they can cut development from months to weeks. DoorDash reported a 50x increase in testing capacity and Ricoh a 7-fold throughput increase after building on the assets.
DXC Technology built the model substrate for its DXC OASIS IT-operations harness on Amazon Bedrock, reaching Anthropic Claude, Amazon Nova, Meta Llama and open-weight models through one managed interface. Amazon Bedrock Guardrails apply content filtering, PII redaction and denied-topic policies uniformly across every model, while AWS PrivateLink keeps inference traffic inside the customer VPC. DXC OASIS has been generally available since March 2026 and cut resolution time by 95% on average across 56 measured use cases.
AWS introduces the Agent Development Lifecycle (Agent DLC), a framework with one lifecycle, two loops, and a single explicit standard for judging every agent change. It addresses three agent properties that break conventional CI/CD: non-determinism, prompts as source code, and independently moving dependencies. A reference HR policy assistant shows chunk-level retrieval precision of 1.00 across all three test questions while fact-level precision fell to 0.09 and retrieval coverage hit 0.00 on one question.
AWS shows how to give a shared AI agent per-user document access on Amazon Bedrock Managed Knowledge Base by exposing search as MCP tools through AgentCore Gateway. A request interceptor injects the verified user's email from the Cognito JWT into userContext, and ACL awareness returns only documents that user may view. A Cedar policy in AgentCore and a resource-based policy on the knowledge base add secondary defenses against spoofed or unauthorized searches.
AWS published a reference architecture in which a LangChain-based enterprise orchestrator on Amazon ECS calls a Strands Agents-based compliance SaaS agent on Amazon Bedrock AgentCore over the A2A protocol, with the two sides in separate AWS accounts and no shared secrets. Each side authenticates with tokens from its own Amazon Cognito user pool, and the SaaS agent calls back to an enterprise context agent for account metadata, so the agents act as peers rather than client and server. The system deploys from three Jupyter notebooks that provision five CloudFormation stacks and run an end-to-end test plus seven trust boundary checks.
AWS added a knowledge base migration guide to the amazon-bedrock skill in the Agent Toolkit for AWS, letting a coding agent plan a move from a customer-managed knowledge base to Amazon Bedrock Managed Knowledge Base. The agent starts with read-only discovery and a line-by-line reviewed plan, then creates the new knowledge base and data sources alongside the original or writes a migrated IaC template. Managed Knowledge Base raises default quotas to 200 data sources per knowledge base and 10,000 knowledge bases per account per Region, and adds agentic retrieval, AgentCore Gateway integration, and resource-based policies.
Databricks has made its Genie app for Slack generally available, letting users ask data questions via DM or @mention and get answers in the thread, grounded in Unity Catalog permissions. Every answer cites its sources, and through MCP connectors Genie can draft document, ticket and record changes for approval before running them.
Block built Buzz, an open source collaboration workspace where employees and AI agents work together in group discussions, focused conversations and one-on-one exchanges, and uses Databricks Unity Gateway as the model access layer. Employees can create agents, pick the model or coding harness behind each one, and select Databricks as their inference provider to reach frontier models from OpenAI, Anthropic and Google plus select open-weight models through a single integration. Block engineers are also experimenting with multi-agent setups where a more capable model coordinates agents running smaller, more efficient models, and have built an internal approach to benchmarking these agent teams.
Warhammer 40,000: Dawn of War IV, developed by KING Art Games and published by Deep Silver, is coming to GeForce NOW when it launches on Steam Thursday, Dec. 3. The real-time strategy game features more than 70 campaign missions playable solo or in co-op, plus The Last Stand, Skirmish and multiplayer modes. NVIDIA DLSS 5 with 3D-Guided Neural Rendering is also coming to War Thunder in mid-November and Where Winds Meet on Monday, Nov. 23.
LangChain's internal GTM Agent generated 1,540 sales artifacts over 12 weeks, saving reps 337 hours on documents like account plans and proposal decks. 47% of deals with a sent artifact advanced to a later stage, versus 16% of matched deals without one, and 46% of artifacts were followed by a customer call within 14 days. The agent runs on the Deep Agents harness, whose sandbox, skills, memory, and scheduled runs are available in Managed Deep Agents.
AWS shows Java teams how to build autonomous AI agents using Spring AI and Amazon Bedrock's AgentCore, with a spring-ai-agentcore integration. Two reference systems are detailed: a single-agent travel assistant with tool calling and memory, and a multi-agent intelligent document processing platform with five specialist agents, a rules engine, and alerting. The stack requires JDK 21, Spring Boot 4.1 with Spring AI 2.0, and deploys via AgentCore runtime on ARM64 containers.
LiveKit released the LiveKit Cloud API in open beta, letting coding agents create and configure projects, manage members and webhooks, and pull transcripts, logs, traces and recordings from agent calls. The API is a REST API that runs signed in as the user, with short-lived tokens checked against project roles and sensitive actions limited to project admins. In a test on LiveKit's docs assistant, a coding agent read 4,321 sessions from the past week and returned a ranked list of 8 issues after about 30 minutes. Session data requires Agent Observability, which is off by default for projects created through the API, and API requests are free but rate limited by plan.
OpenRouter published a break-even analysis showing when self-hosting an open-weight LLM costs less than calling it through an API, using per-provider prices as of October 8, 2026. At those prices, Qwen3.8 27B on one rented RTX 3090 at $0.50 an hour breaks even at 6 to 12% load, while DeepSeek V4.1 Flash on four H200s never beats the cheapest zero-data-retention endpoint. The post also notes that provider.zdr and the EU and US domains cover most privacy needs without self-hosting, and recommends running a steady base load locally while sending peaks to the API.
vLLM supports Thinking Machines' Inkling 2 Small on day 0, a multimodal text-and-vision MoE with 594B total and 17B active parameters and up to 1M tokens of context. The integration adds kernel fusion with PDL, sequence parallelism for prefill that cuts an 8K-token prefill step by 22% at TP4 and 26% at TP8, and a Gluon relative attention decode kernel that drops a batch-1 decode step at 100K context from 15.1 ms to 4.8 ms. vLLM reports up to 630 TPS/user at TP4 on GB200 with acceptance length 3.5, and also supports LoRA and RL via SkyRL.