Skip to content
TodayNovember 13Friday45 items
  1. inclusionAI Models34

    inclusionAI Releases Duo-1.0-distill-quant FP8 Weights for Full-Duplex Interaction

    inclusionAI released Duo-1.0-distill-quant, FP8-quantized four-step distilled Realization weights for the Duo 1.0 full-duplex multimodal world model. The weights overlay onto the inclusionAI/Duo-1.0-causal-base bundle, which supplies the shared Intent, codecs, speech models and Realization backbone, and require a runtime supporting the packaged ModelOpt FP8 format. The weights were initialized from MiniMax H3 and then trained by the Duo team.

  2. inclusionAI Models40

    inclusionAI Releases Duo-1.0-distill Four-Step Distilled Weights for Duo 1.0

    inclusionAI has released Duo-1.0-distill, the four-step distilled Realization weights for Duo 1.0, a full-duplex multimodal world model for real-time audio-visual interaction. The weights ship as a PyTorch Distributed Checkpoint overlay on the inclusionAI/Duo-1.0-causal-base bundle, using an Euler sampler with 4 steps and flow shift 5.0. The weights were initialized from MiniMax H3 and then trained by the Duo team.

  3. inclusionAI Models38

    SingVL-4B GGUF Released: GGUF Build of Sing VL S1 4B Multimodal Decision Model on Qwen3.5

    Sing VL S1, a 4B-parameter multimodal decision model built on Qwen3.5, now has a GGUF release for llama.cpp CPU inference. It ships in BF16 (8.42 GB), Q8_0 (4.48 GB) and Q4_K_M (2.71 GB) decoders plus a shared F16 vision projector, with a default 4096-token context. GGUF validation covers 9 examples and 11 questions; full public scores for the GGUF variants are still pending.

  4. ElevenLabs Blog18

    7 customer service skills every human and AI agent needs

    ElevenLabs outlines seven customer service skills — communication, problem-solving, conflict resolution, empathy, adaptability, personalization and product knowledge — that both human and AI support agents need. It cites a Zendesk study finding over 50% of customers switched to competitors after one bad experience, and a Gartner forecast that at least 70% of customers will start their journey with an AI interface by 2028. The guide stresses evaluating conversational metrics during training and after deployment, plus seamless handoff to humans for de-escalation.

  5. Modal Blog40

    Modal Sandboxes adopt burst pricing, cutting costs 58% versus reservations

    Modal now bills Sandboxes by active resource use instead of fixed reservations, letting each Sandbox burst past its default 0.125-core and 128 MiB request and pay only for what it uses each second. In a 20-minute coding agent example, bursting cost 8.4¢ per Sandbox-hour versus 20.0¢ for a fixed reservation, a 58% saving. CPU can burst up to 16 cores above request by default, with memory uncapped unless a limit is set.

  6. Factory55

    Factory launches Cyber Defense Network linking security tools to Security Factory

    Factory launched the Cyber Defense Network, an ecosystem of cybersecurity companies whose findings flow into Security Factory so Factory Droids can investigate vulnerabilities, implement code changes and validate fixes through testing. Founding partners include Snyk, Palo Alto Networks, Semgrep, Cogent, Casco, DepthFirst and Detail. The workflow covers signals from partner tools, triage of reachable vulnerabilities, and continuous remediation that produces fixes ready for engineering teams to review and merge, while organizations keep their existing security tools and workflows.

  7. Databricks Blog36

    Detecting credential-driven attacks on Databricks with verbose audit logs and Genie

    Databricks details how credential-driven attacks unfold on its platform and how verbose audit logs plus Genie can detect the behavioral shift after a stolen PAT, session cookie, or service-principal credential is used. The post maps adversary activity into six stages, from initial login through environment reconnaissance, and covers response steps and controls that limit what a stolen credential can reach.

  8. Databricks Blog36

    Bright Machines uses Debezium and Iceberg to give customers live dashboards from air-gapped factories

    Bright Machines now gives customers live, governed dashboards of factory data from air-gapped plants without opening any inbound access. It captures PostgreSQL changes at the edge with Debezium, writes them as Apache Iceberg, pushes them out over one auditable outbound path, and reads them in place in Databricks via Unity Catalog federation. The first customer-visible dashboard went live about two months after kickoff, with committed rows queryable in one to two minutes and dashboards refreshing every ten minutes.

  9. OpenRouter Announcements58

    OpenRouter tests 11 rerankers on a 274-question RAG benchmark

    OpenRouter benchmarked 11 rerankers on a 274-question synthetic RAG dataset and found that reranking the top 30 vector-search candidates with voyageai/rerank-3-lite raised precision@1 from 81.0% to 97.1% at about $0.10 per 1,000 queries. The guide recommends retrieving roughly 30 chunks, reranking them, and sending only the top 3 to the LLM, which in its test lifted answer accuracy to 99.3% while cutting answering cost from $0.22 to $0.16 per 1,000 questions. It also flags failure modes: omitting the input_type parameter cost 7 to 12 points of precision@1, and cohere/rerank-v3.5 silently ignores content beyond its 4,096-token limit.

  10. AWS Machine Learning Blog58

    AWS releases SGLang-Neuron, enabling deployment of frontier models on Trainium with the existing SGLang interface

    Amazon announced the public availability of SGLang-Neuron, an out-of-tree plugin that runs SGLang on AWS Trainium through an AWS Deep Learning Container, released by RadixArk with Annapurna Labs. Users keep the same SGLang server interface and generation APIs, while the plugin supplies Trainium-specific models, attention, MoE and a graph runner built on native PyTorch and NKI kernels compiled with torch.compile. It also supports PD disaggregation, transferring the prefill KV cache to a decode server via NIXL over EFA, and the walkthrough serves openai/gpt-oss-120b on a Trainium3 EC2 instance with the pytorch-inference-sglang-neuronx container.

  11. GitHub Blog · AI & ML58

    GitHub guide explains how to build agent skills that run across Claude Code, Cursor and Copilot

    GitHub published a practical guide to agent skills, versioned directories centered on a SKILL.md file that describe when and how to perform a repeatable task. The guide uses two examples, Proof Agent for adversarial verification of AI-generated code and Data Forge for a multi-skill data pipeline, to show how skills share a project manifest, reuse one execution path, and place human approval at each phase. It also describes a packaging script that generates client-specific files for Claude Code, Cursor and GitHub Copilot from a single skills source.

  12. AWS Machine Learning Blog40

    How Natera built SWARM, an agentic AI system for lab ops on Amazon Bedrock AgentCore

    Natera built SWARM, an agentic AI system for lab operations, on Amazon Bedrock AgentCore, cutting first response time by about 130x and automating 96.2 percent of support tickets. The system pairs a swarm-agent that drafts diagnostic reports before engineers open a ticket with a swarm-hive for real-time engineer interaction, both sharing one skill library. It addresses over 65 daily Jira tickets across three queues that previously averaged 17.4 hours for first response.

  13. Microsoft Research22

    Microsoft Research Focus Edition #98: AI Translation, KLS Conjecture Proof, and Faster Coding Agents

    Microsoft Research Focus Edition #98 highlights AI advances bringing universal translation closer to reality and a new proof resolving the 31-year-old KLS conjecture in high-dimensional geometry. The edition also covers CompactionBench and APEC, which cut coding-agent context compaction costs by up to 25.4% and execution time by 9.6%, plus the Latent Core Tokenizer, which improved tokenization across 104 languages.

  14. Databricks Blog30

    Databricks Debunks Four LTAP Myths About Lakebase Architecture

    Databricks responds to four common misreadings of LTAP, the Lakebase architecture that keeps one governed copy of operational data serving both Postgres and analytics without CDC. The post argues LTAP is not replication: layers in front of the lake are caches, not a second database with its own catalog. It also says heap pages and Parquet are two lossless encodings of the same rows, so point lookups and scans each read the layout fast for them.

  15. AWS Machine Learning Blog38

    Tokenomics at Scale: Tracking and Capping Amazon Bedrock Spend per IAM Principal with CUR 2.0 and AWS Budgets

    AWS shows how to track and cap Amazon Bedrock generative AI spend per IAM principal using only native features: Bedrock automatically records the IAM user or role on every inference request, and those tags become cost allocation tags readable in Cost Explorer or CUR 2.0 exports. An AWS Budget scoped to Bedrock and filtered to one identity or tag value can attach a budget action that applies a Deny IAM policy once a threshold is crossed, with no application code for the common case.

  16. AWS Machine Learning Blog36

    Four Amazon Bedrock inference choices that affect cost

    Amazon Bedrock's cache duration, service tier, reasoning effort, and maxTokens settings can change inference cost without altering the model or prompt. A 5-minute cache write on Claude Sonnet 5 and Claude Opus 5 costs 1.25x the input rate, a 1-hour write costs 2x, and cache reads cost 0.1x; Flex tier requests to unsupported models fail with a ValidationException.

  17. Hugging Face Blog69

    IBM releases LLMON preview models built on Granite 4.1 3B and 8B

    IBM released two experimental preview models, granite-4.1-3b-LLMON-preview and granite-4.1-8b-LLMON-preview, derived from Granite 4.1 base checkpoints and trained to consume and generate LLMON, an LLM-native markup language that marks instructions, data and requirements with reserved special-token delimiters. On the OPI benchmark the models avoid 47% more indirect prompt injection attacks than the best frontier model tested and 95% more than the best open-source model, while performing on par with Granite 4.1 Instruct on standard benchmarks. The release includes a GitHub toolkit with lossless JSON-to-LLMON converters, and the authors note the preview is for exploration, not production.

    Why it matters: IBM trained a preview model on Granite 4.1 that can read and write LLMON tags, using explicit instruction-data separation to reduce the indirect prompt injection success rate on the OPI benchmark to near zero while maintaining general capabilities.

  18. LangChain Blog45

    What Is Eval-Driven Development? How to Improve AI Agents

    LangChain explains eval-driven development (EDD), a three-step process for building AI agents: define what good looks like, write the eval before you build, and compare results after each change. Because agents are non-deterministic, evals score runs across a dataset of examples and can use LLM-as-a-judge, with real agent runs in LangSmith as a source of test inputs.

  19. Databricks Blog22

    How Constellation is building a governed data foundation on Databricks

    Constellation, the largest US nuclear fleet operator, is building a governed Enterprise Data Platform on Databricks to give the business one shared meaning for its data. The platform uses Unity Catalog for lineage, fine-grained access and a single permission model, plus Data Vault modeling for critical reusable entities. Early use cases include a nuclear engineering assistant built with Databricks Genie and outage planning.

  20. Databricks Blog25

    Eclipse Aerospace uses Databricks PySpark custom data sources for flight-data ingestion

    Eclipse Aerospace is using Databricks PySpark custom data sources to ingest nearly 20 years of proprietary flight data, over 3TB spanning more than a million flight hours, without always-on dedicated compute. The Rust-backed Python package delivered twice the benchmarked performance of a similar PyArrow-based pure-Python data source and nearly 20x that of a native Python implementation without Arrow. The API, introduced in Apache Spark 4.0 and available in Databricks Runtime 15.4 LTS, replaces the prior Lambda-to-Avro pipeline.

  21. AWS Machine Learning Blog66

    AWS updates AgentCore runtime with 15x faster session starts and 4x more compute

    AWS announced updates to Amazon Bedrock AgentCore runtime, its managed compute layer for agents, with sessions now starting up to 15x faster, scaling to 4x more compute (up to 8 vCPUs and 32 GB, with container images up to 10 GB) and running up to 68% more efficiently, while each session stays in its own hardware-isolated Firecracker MicroVM. Sessions start in under 2 seconds regardless of image size or concurrency, idle agents scale to zero, and agents can mount and save work to a filesystem such as an Amazon S3 bucket with FUSE support so data stays inside the trust boundary. The runtime is available today in AWS Regions across North America, South America, Europe, and Asia Pacific.

    Why it matters: AgentCore runtime 的新版本把会话启动、算力上限和内存计费一起调整,为需要长时间运行的智能体提供了隔离与成本之间的新取舍。

  22. AWS Machine Learning Blog34

    Building a self-service LLM gateway with Amazon Bedrock and LiteLLM

    A self-service LLM gateway built on Amazon Bedrock Application Inference Profiles and LiteLLM running on AWS Fargate exposes Bedrock foundation models behind an OpenAI-compatible API, giving developers a single base URL and per-user key. The setup adds per-user spend controls, per-model quota isolation, and CloudWatch RPM/TPM observability, with Langfuse for prompt-level telemetry. Self-service key issuance requires LiteLLM Enterprise, since the free tier is limited to five users.

  23. Google DeepMind90

    Google DeepMind releases Gemini 4 Hydrogen, a faster Gemini 4 model for coding and agentic workflows

    Google DeepMind introduced Gemini 4 Hydrogen, a Gemini 4 model built for fast everyday coding and agentic execution rather than the long-horizon reasoning of Gemini 4 Carbon and Argon. It scores 51 on the Artificial Analysis Intelligence Index at its default high thinking level versus 50 for Argon, reaches 54 at a new xhigh setting, and is priced flat at $1.50 per million input tokens and $7.50 per million output tokens across its 1 million-token context window. Google also launched Orchestrator in Google Antigravity, which switches between models like Carbon and Hydrogen within a session and reached near-Carbon task success on Terminal-Bench 4.0 while using 24% less quota and finishing 19% faster.

    Why it matters: Google's Gemini 4 Hydrogen targets fast everyday coding and agentic work, with flat $1.50/$7.50 per million token pricing across a 1M context window and a new Orchestrator that switches between Gemini 4 models.

  24. AWS Machine Learning Blog34

    Optimizing cost per task and proving agent ROI on Amazon Bedrock

    This AWS post argues that Amazon Bedrock spend should be judged by cost per task rather than cost per token, since tokenizer efficiency, output verbosity, agentic loop count and reasoning overhead can make a lower-priced model cost more. A worked example shows a model with 2x the list price finishing 65% cheaper per task, and the post adds caching, routing and output constraints plus a five-dimension scorecard for measuring agent ROI against human baselines.

  25. Google Blog · AI82

    Google Search upgrades globally to Gemini 4 Hydrogen

    Google Search has moved all users worldwide to Gemini 4 Hydrogen, which the company calls its biggest model upgrade to Search yet. The model improves intent understanding for multi-part and typo-heavy questions, adds deeper instruction following and tool calling, and strengthens query fan-out to surface links users might not otherwise find. Responses also become more visual, with more images, comparison tables and custom tools, across all supported AI Mode languages.

    Why it matters: Google Search's largest model upgrade to date, with Gemini 4 Hydrogen now handling multi-part questions, tool calling and query fan-out for all users globally.

  26. Databricks Blog22

    How H6.ai builds AI-powered financial automation with Lakebase Postgres

    H6.ai automates accounts payable on top of customers' existing ERPs, using a dedicated Lakebase Postgres database per customer as its system of record. Because invoice data keeps changing, the team uses Lakebase copy-on-write branches to freeze snapshots of customer databases and run each regression test on its own short-lived branch, so the live database is never written to. Each run is judged by deterministic assertions plus a panel of AI judges from different model providers.

  27. Databricks Blog58

    Databricks launches Lakehouse//RT to serve real-time analytics without proportional cost growth

    Databricks introduced Lakehouse//RT, a real-time analytics engine that runs high-concurrency workloads directly on lakehouse data and is now available in beta. The company says it delivers sub-100 millisecond latency at 12,000 queries per second, adds capacity one node at a time, and avoids a separate serving layer; customers Aurasell, VisionHeight and nOps report 6x to 10x lower infrastructure costs after migrating from multi-cluster setups, Apache Pinot and Apache Druid.

  28. AWS Machine Learning Blog38

    Amazon Bedrock AgentCore Evaluations: Built-in, DeepEval and AutoEval evaluators

    Amazon Bedrock AgentCore Evaluations now lets teams run AWS built-in evaluators alongside managed DeepEval and AutoEval metrics, plus custom evaluators derived from either. The built-in catalog spans 15 evaluators across response quality, goal completion, tool use, skills and safety, with three trajectory checks for expected tool paths. DeepEval adds multi-turn metrics such as ConversationCompleteness and KnowledgeRetention, while AutoEval contributes specialized signals including security.

  29. AWS Machine Learning Blog36

    Building a Daily Dependency Watcher with LangGraph and Amazon Bedrock AgentCore Web Search

    The Web Search API in Amazon Bedrock AgentCore is now available, giving agents current web results through a single SigV4-signed API call served from a web index Amazon operates. A walkthrough builds a daily dependency watch as a LangGraph graph that researches npm, PyPI, and container base images in parallel, with date windows, blocklists, and search budgets enforced in code. In testing, the three branches finished in 36 seconds versus 99 seconds run sequentially.

  30. AWS Machine Learning Blog58

    Moonshot AI's Kimi K3.1 Pro Highspeed launches on Amazon Bedrock

    Moonshot AI's Kimi K3.1 Pro Highspeed is now available on Amazon Bedrock, a post-trained version of Kimi K3 with the same 3T-class open-weight architecture and 1-million-token context window, trained with more post-training compute for long-horizon agentic work and fewer factual errors. Moonshot AI reports 2–3 times the output speed of Kimi K3.1 Pro, and existing Kimi K3 users can switch by changing the model ID. The post shows Chat Completions, Responses and Converse API calls, the Flex tier at half the Standard price, explicit prompt caching with prompt_cache_breakpoint, and connecting the model to the OpenCode coding agent.

  31. AWS Machine Learning Blog33

    Amazon SageMaker AI bidirectional streaming gains usage-based pricing, Deepgram as launch partner

    Amazon SageMaker AI bidirectional streaming now supports usage-based metering, letting model providers report actual consumption to AWS Marketplace software charges while endpoint infrastructure fees still apply. Deepgram is the launch partner, bringing usage-based Speech-to-Text and Text-to-Speech billing to AWS Marketplace. The design adds a companion WebSocket metadata stream, capped at one message per second and 512 bytes, so providers can send incremental metering records during live sessions.

  32. AWS Machine Learning Blog60

    AWS open-sources UAEF, a framework-agnostic evaluation system for AI agents

    AWS has open-sourced UAEF (Universal Agent Evaluation Framework), a framework-agnostic system that uses adapters to normalize agent traces from LangGraph, LangChain, Strands Agents, Amazon Bedrock AgentCore and Langfuse into one canonical AgentTrace, then scores them with 36 built-in metrics across 7 dimensions. Results are stored per experiment in Amazon DynamoDB and Amazon S3, so teams can compare agent versions against a baseline, flag regressions with a default 5 percent threshold, and generate statistical reports plus LLM-written insights. The post says customers across 12 organizations in telecom, healthcare and financial services used UAEF before release, and the Apache 2.0 code, Python library, CDK deployment and per-framework notebooks are in the awslabs/uaef GitHub repository.

    Why it matters: The AWS team has open-sourced UAEF, which uses adapters to unify agent trajectories from different frameworks into a single format, then scores them across 7 dimensions using 36 metrics, providing a reusable evaluation layer for comparing agent versions across frameworks.

  33. AWS Machine Learning Blog36

    AWS Quick AI-PDLC: Six Agents for AI-Driven Product Development

    AWS Quick introduces AI-PDLC, a framework of six specialized agents—led by an Orchestrator covering Discovery, Prioritize, Working Backwards, Spec Generator, and Designer—that turns scattered enterprise signals from Slack, Jira, Salesforce and SharePoint into a traceable prototype_spec.md. Every phase requires human approval, and the spec can be handed to coding agents like Kiro or Claude Code via the open Agent Client Protocol (ACP).

  34. AWS Machine Learning Blog40

    AWS opens catalog of 23 reusable generative AI assets from its Innovation Center

    AWS has published a catalog of 23 production-ready, open source generative AI assets from its Generative AI Innovation Center, now part of AWS Frontier AI Engineering & Services. The building blocks cover RAG pipelines, document processors, agent scaffolding and evaluation frameworks, and AWS says they can cut development from months to weeks. DoorDash reported a 50x increase in testing capacity and Ricoh a 7-fold throughput increase after building on the assets.

  35. AWS Machine Learning Blog38

    How DXC Technology built a multi-model AI substrate on Amazon Bedrock

    DXC Technology built the model substrate for its DXC OASIS IT-operations harness on Amazon Bedrock, reaching Anthropic Claude, Amazon Nova, Meta Llama and open-weight models through one managed interface. Amazon Bedrock Guardrails apply content filtering, PII redaction and denied-topic policies uniformly across every model, while AWS PrivateLink keeps inference traffic inside the customer VPC. DXC OASIS has been generally available since March 2026 and cut resolution time by 95% on average across 56 measured use cases.