Skip to content
Only Products
TodayNovember 13Friday53 items
  1. MarkTechPost58

    Google releases TPU Sync, an open-source KV cache transfer library for Cloud TPUs

    Google Cloud has released TPU Sync, an Apache-2.0 C++ library that moves KV caches and model weights across TPU HBM, pinned host DRAM, shared storage and the data center network. In internal July 2026 tests on TPU v7x, Google reports over 90% lower KV transfer overhead, with Qwen3 235B median KV transfer latency dropping from several seconds to about 230 ms and average TTFT falling 60% for 235B and 90% for 480B at low concurrency. The library integrates with PyTorch via TorchTPU and with JAX, serving as the KV connector in vLLM-TorchTPU and the P/D transfer backend in SGLang-TorchTPU, though the README says it is not yet recommended for general use.

  2. Hacker News · AI36

    Agent-brain: A Notes-Agnostic Second-Brain Operating Model for AI Coding Agents

    Agent-brain is a personal operating model for AI coding agents such as Claude Code, OpenCode, Codex and Antigravity CLI, built on a second-brain structure of journal, WIP, memory and tasks that works over any folder of notes, with Obsidian optional. Runtime config and memory like CLAUDE.md and AGENTS.md are kept in a git-tracked brain and symlinked into each runtime, so setup travels across machines. Install runs via curl and dry-runs by default, with a session lifecycle driven by the brain skill.

  5. Hacker News · AI58

    Witness launches a voice-anchored evidence recorder for AI coding agents

    Witness is a voice-anchored evidence recorder that links each spoken comment to the clicks, requests, console errors, DOM mutations and rrweb replay of that moment, then hands the bundle to an AI coding agent. It runs as a CLI (npm i -g witness-recorder, Node 18+) that opens a managed Edge/Chrome browser, and it exposes the session through a stdio MCP server with tools such as list_segments, events_around and get_dom_state for agents like Claude Code, Cursor and Devin. Recordings stay local in .witness/sessions, password fields are masked and body capture can be disabled with WIT_NO_BODIES=1.

  6. Hacker News · AI37

    Wonderchat: A Zendesk Alternative with Flat Pricing and Unlimited Seats

    Wonderchat launched a helpdesk with live chat, a unified inbox for email and SMS, and a help center coming in a couple of weeks, priced at one flat rate with unlimited seats. Customers pay only for AI replies and resolutions, while human agents answering tickets cost nothing extra. The AI agent drafts replies from internal SOPs and runs on a user-selectable model via its own retrieval engine built for knowledge bases of 10,000+ documents.

  8. Hacker News · AI71

    Google Cloud launches Gemini for healthcare in preview for payers and providers

    Google Cloud announced Gemini for healthcare, a purpose-built industry solution that extends the Gemini agent introduced last month at Gemini at Work, and it is available in preview in the U.S. starting today. The offering combines reusable skills for clinical and administrative tasks, connectors to EHR, claims and care management systems such as Epic, Oracle Health and InterSystems FHIR, a partner ecosystem, and a governed platform built to support HIPAA compliance with audit logging and verifiable citations. Google says clinical data, prompts and outputs stay in the organization's governed environment and are never used to train or fine-tune its foundation models.

  9. Hacker News · AI58

    ChatPanel Releases Chap: Generating Meeting Notes from Live Captions, Supporting Any LLM or Agent

    ChatPanel launched Chap, a browser, desktop and terminal meeting assistant that turns live captions from Zoom, Meet, Teams and Webex into running notes, decisions and action items without a bot joining the call. It runs on the user's machine with no ChatPanel server in the path, anonymizes emails, phones, cards and keys before requests leave the browser, and lets users switch mid-conversation between an in-browser WebGPU model, Ollama or LM Studio, 20+ cloud APIs, and agents such as Claude Code, Codex, GitHub Copilot and Antigravity. Free covers the first 10 notes and 10 meetings; Pro is a limited-offer $49 one-time purchase or $42 per year.

  10. Hacker News · AI58

    Uber Open-Sources Michelangelo ML Platform, Says It Has Been Validated Across 400+ Projects and 20,000 Monthly Training Jobs

    Uber has open-sourced Michelangelo, its ML platform proven at Uber scale with 400+ active ML projects, 20K+ model training jobs per month, 5K+ models in production and 45M+ real-time predictions per second at peak. The release covers feature management, distributed model training, deployment and monitoring, with feature management, evaluation and monitoring marked coming soon. A Python API built on Uniflow lets users define distributed training tasks and end-to-end workflows, such as a Ray-based XGBoost training pipeline, in a few lines of code.

  11. Hacker News · AI38

    Show HN: FloxoLab AI Crawler Access Checker Tests 14 AI Crawlers

    A developer has launched the FloxoLab AI Crawler Access Checker, a free tool that tests whether 14 AI crawlers can actually read a given page. It reads robots.txt per RFC 9309, re-requests the URL with each crawler's user agent, and compares status codes and headers against a normal browser request, returning a verdict per crawler. The tool is free with no account and limited to 8 checks per 10 minutes.

  13. Hacker News · AI58

    Zipzi launches open-source Live2D Cubism Editor alternative with AI agent co-editing

    Zipzi released an alpha open-source 2D modeling and animation editor positioned as an alternative to Live2D Cubism Editor, built in Rust with GPUI for macOS and Windows. A Python SDK (CPython 3.14) lets a coding agent inspect meshes, render wireframe overlays, and apply edits in the same document as the user, with shared undo history. The project is in early development with no stable release, and the SDK is MIT-licensed while editor components use GPL-3.0-only.

  14. Hacker News · AI48

    Loose Ends: A liveness check for unused code AI agents leave behind

    Loose Ends is a new CLI tool that checks whether code added or touched in a change is still reachable from a real entry point, flagging orphaned additions, newly orphaned code, and replaced implementations left in place. It builds a liveness graph across TypeScript, JavaScript, Python, and Java, and reports only what the change did, so existing dead code never blocks a pull request. Installable via npm, it requires Node.js 20 or newer and git.

  15. Hacker News · AI21

    AI Math Kit: A Browser Popup for Exploring Open Math Problems with AI

    AI Math Kit is a browser extension popup that bundles 217 open math problems, 242 plain-language digests of AI and formal-math breakthroughs, and prompt templates for honest AI exploration. The problem bank covers number theory, calculus, and cross-field mysteries, while the breakthrough page includes precise scope notes and paper pointers. A free tier offers browsing; Pro unlocks full explanations and dedicated prompts, with preferences and payment status cached locally.

  16. Modal Blog40

    Modal Sandboxes adopt burst pricing, cutting costs 58% versus reservations

    Modal now bills Sandboxes by active resource use instead of fixed reservations, letting each Sandbox burst past its default 0.125-core and 128 MiB request and pay only for what it uses each second. In a 20-minute coding agent example, bursting cost 8.4¢ per Sandbox-hour versus 20.0¢ for a fixed reservation, a 58% saving. CPU can burst up to 16 cores above request by default, with memory uncapped unless a limit is set.

  17. Factory55

    Factory launches Cyber Defense Network linking security tools to Security Factory

    Factory launched the Cyber Defense Network, an ecosystem of cybersecurity companies whose findings flow into Security Factory so Factory Droids can investigate vulnerabilities, implement code changes and validate fixes through testing. Founding partners include Snyk, Palo Alto Networks, Semgrep, Cogent, Casco, DepthFirst and Detail. The workflow covers signals from partner tools, triage of reachable vulnerabilities, and continuous remediation that produces fixes ready for engineering teams to review and merge, while organizations keep their existing security tools and workflows.

  18. Hacker News · AI15

    Umo: An AI CMO That Audits, Plans and Executes Marketing

    Umo is an AI CMO positioned as a company's first marketing hire, learning a product, audience and market to guide marketing decisions. Its live audit feature takes a website and socials and returns a breakdown of ICP, positioning, competitors and opportunities, while strategy and execution are listed as coming soon and in development. Platform agents for TikTok, Instagram and Reddit are also in development, and a waitlist offers a founding member discount.

  19. Hacker News · AI38

    LessonFolk: Open-Source AI Tutor That Teaches AI via MCP

    LessonFolk is a free, open-source AI tutor that teaches AI topics through the AI chat app you already use, connected via MCP. It offers 15 courses, from an hour-long AI Foundations track to Context Engineering for Long-Running Agents, with a short level check and progress tracking. Courses and code are open source, and users can download or delete their data anytime.

  20. Hacker News · AI38

    NEAR AI Gateway: Use Private AI Models in Claude Code, Codex and OpenCode

    NEAR AI Gateway lets Claude Code, Codex and OpenCode route their AI requests through NEAR AI's private models, with each call's model, tokens and cost logged locally on the Mac. Traces are redacted on-device before sharing, and users review every trace before deciding what leaves the machine. Accepted traces earn NEAR AI Cloud inference credits; the macOS 14+ app is version 1.0.7 at 119 MB.

  21. Hacker News · AI71

    InferSSD runs 800B-class LLMs on consumer hardware by keeping expert weights on NVMe

    InferSSD, an open-source inference runtime built on llama.cpp, runs 763B-class DeepSeek-V4.1-Flash-1017 and 816B-class Muse-Spark-Open on consumer machines by keeping routed expert weights on NVMe storage while attention, shared layers and the KV cache stay in RAM or VRAM. On an RTX 5090 with 32 GB RAM and 32 GB VRAM it reports 164.5 tokens/s prefill and 7.27 tokens/s decode for DeepSeek at a 4K prompt tier, versus 8.06 and 0.867 tokens/s for llama.cpp on the same system. The article also estimates that heavy daily use could mean roughly 85 TB of host reads per day and lays out a conditional SSD wear model, noting the figures are assumptions to test rather than a promised drive lifespan.

  23. Hacker News · AI76

    AgentRun Open-Source Release: Adding Self-Improvement and Durable Execution to Existing Agent Harnesses

    Parcha Labs has open-sourced AgentRun, an agent platform that layers self-improvement, durable execution, and a console on top of Claude Code, Codex, OpenCode, and pi, under the Apache-2.0 license.

    Why it matters: AgentRun layers self-improvement, durable execution, and a console on top of existing harnesses such as Claude Code and Codex, and provides a concrete case where code review costs dropped from $6,451 per month to 18 cents per run.

  24. Hacker News · AI68

    World Labs opens Atlas world model to everyone

    World Labs has opened Atlas, its next-generation world model, to everyone, letting users generate and reconstruct explorable 3D worlds. Atlas Build starts from photos or generated images, where Viewfinder reconstructs the scene and allows camera movement, while Chisel blocks out scene structure and updates every camera view. Worlds can be converted from splats into meshes with real geometry for use in games, simulations, Blender and other 3D tools, and Atlas capabilities are also available through developer APIs.

  25. Hacker News · AI38

    OwnOwl v0.2: On-Device LLM Chat App for iPhone Test Build

    OwnOwl released a v0.2 test build of its iPhone app that runs a large language model entirely on-device, with no internet used for chatting. The update speeds up first replies by warming up on load and caching each conversation, adds longer default answers with a Continue button, and lets the app remember user-confirmed facts. It requires an iPhone with 6 GB of RAM or more and iOS 17 or newer, with model downloads of about 6 GB (GigaChat), 9 GB (Ling), or 14 GB (Gemma).

  26. Hacker News · AI58

    CanyonOS 0.2 launches as open-source tool to find, observe and scale agents

    CanyonOS 0.2 is the first public release of an open-source, model-agnostic tool for finding, observing and scaling agents that slow down workflows. It runs on Docker or Kubernetes, works with any provider offering an OpenAI-compatible API, exports OpenTelemetry-compatible traces and metrics to tools such as Datadog, Grafana, Prometheus, Langfuse and Arize Phoenix, and adds cost and queue time per agent. The project is AGPL-3.0 licensed, requires agents to be rewritten into plain Python with one file per agent, and its FAQ states it has not yet run at large production scale.

  28. Hacker News · AI58

    Stay-in-sight launches open-source outbound email tool with 64 MCP tools for AI agents

    Stay-in-sight released an MIT-licensed outbound email system that runs on Cloudflare Workers and D1, sending cold outreach, newsletters and drip series from the user's own Gmail and SES mailboxes. It ships 64 MCP tools plus a REST API so agents like Claude Code and Cursor can import contacts, schedule sends and answer replies, and the project claims deployment in about 30 minutes with hosting free at low volume or $5/mo on Workers Paid.

  29. Hacker News · AI58

    Relate launches an open-source embedded graph database for AI agents

    Relate is an open-source embedded graph database for AI agents that runs inside the application with no server to deploy and no signup, storing data in memory, a directory or a single .rl file. It speaks openCypher and is tested against the openCypher TCK, and ships with an agent skill plus an MCP endpoint so agents such as Claude Code, Codex and Cursor can write Cypher queries against connected facts. Installation runs through a curl script that verifies release signatures and SHA256 checksums, and libraries are offered for Rust, Python, JavaScript, WebAssembly, Go, Java, Swift and C.

  30. Hacker News · AI60

    Keenable 1.0 launches with 100 million knowledge cards and dynamic snippets for AI agents

    Keenable launched version 1.0 of its AI web search API, claiming first place on the Artificial Analysis Search Index (BrowseComp, DeepSearchQA and AA-Omniscience) and on NEEDLE, its open-source benchmark rerun daily on fresh queries. The release adds 100 million knowledge cards, which summarize key facts on a topic and are refreshed frequently via partner APIs, plus dynamic snippets that read full documents and extract only the needed context, cutting token consumption by 50% on research tasks. Since its launch two months ago the service has served millions of agent queries, and new accounts start with 100,000 requests through one key and one MCP endpoint.

  31. Hacker News · AI60

    Cerulion 2.0 released: an open-source ROS 2-compatible robot runtime with multi-process replay

    Cerulion Inc. released Cerulion 2.0, an open-source, ROS 2-compatible robot runtime that records runs and replays failures against changed code, with one process per node by default. It ships Linux x86_64/ARM64 and macOS binaries, an rmw_cerulion layer tested on Foxy through Lyrical, and MCAP recordings with byte-exact replay verification that returns a nonzero exit code on divergence. On one x86-64 Linux desktop at 1 MiB payload, the project reports a 4.08 µs median round trip versus 10,952 µs for ROS 2 Jazzy with rmw_fastrtps_cpp defaults.

  33. Hacker News · AI60

    Neon and Mubit release a template for an agent that cuts its own frontier-model tokens by 73%

    Neon and Mubit published a template for a data analyst agent on Neon Functions and Lakebase Postgres that sends every model call through Mubit to Neon AI Gateway. In Mubit's benchmark on 20 CL-bench questions run three times each, the setup cut gpt-5.5 input tokens by 73% and answered 40% faster, with accuracy at 65% versus 60% for gpt-5.5 alone. Mubit moves routine steps such as listing tables and writing up answers to a small tuned model after it passes an exam built from the task's own traffic, while gpt-5.5 still writes every SQL query.

  34. Hacker News · AI40

    AxiomStory: An AI Story Studio That Keeps Characters and Worlds Consistent Across Text, Images and Video

    AxiomStory is a new AI story studio that reads every chapter of a manuscript and flags continuity errors, such as a character's eye color changing between chapters. It builds a wiki page for each character and place, and reuses one approved look and voice per character across generated pictures and video. The free plan offers about 30,000 words of AI help; paid tiers run from $16 to $160 per month.

  36. TechCrunch · AI60

    Meta's Muse now places calls to US businesses for paying subscribers

    Meta's consumer AI agent Muse can now place calls to US businesses on behalf of users, but the feature is limited to paid subscribers in the US. Muse plans start at $20 per month for 500 million tokens per week, or $100 per month for 3 billion tokens. Meta Chief AI officer Alexandr Wang said the feature targets calls people don't want to make, such as insurance, cable, the DMV or dinner reservations, and a Muse email address option will soon roll out to free users.

  37. AWS Machine Learning Blog58

    AWS releases SGLang-Neuron, enabling deployment of frontier models on Trainium with the existing SGLang interface

    Amazon announced the public availability of SGLang-Neuron, an out-of-tree plugin that runs SGLang on AWS Trainium through an AWS Deep Learning Container, released by RadixArk with Annapurna Labs. Users keep the same SGLang server interface and generation APIs, while the plugin supplies Trainium-specific models, attention, MoE and a graph runner built on native PyTorch and NKI kernels compiled with torch.compile. It also supports PD disaggregation, transferring the prefill KV cache to a decode server via NIXL over EFA, and the walkthrough serves openai/gpt-oss-120b on a Trainium3 EC2 instance with the pytorch-inference-sglang-neuronx container.

  39. The Decoder60

    Anthropic launches Claude Meetings to join video calls as a participant

    Anthropic has launched Claude Meetings, a feature that lets Claude join video calls as a visible participant, answering questions, generating documents and whiteboards, and logging notes and action items. Notes, transcripts and documents Claude produces are collected on a dedicated page in claude.ai after the meeting, and privacy controls block Claude from joining calls with external participants by default. The feature is in beta for Team and Enterprise plans, supports only Google Meet so far, and is unavailable to organizations using HIPAA or customer-managed encryption configurations.

  40. MarkTechPost68

    CopilotKit releases OpenBot 1.0, an MIT-licensed self-hostable AI coworker with built-in governance

    CopilotKit released OpenBot 1.0 on November 9, an MIT-licensed, self-hostable agent workspace where teams bring their own models, agents and infrastructure. Every browser click, file write, MCP tool call and component passes through a governance gateway that evaluates a CEL policy and writes the audit row before acting, with deny rules running first and broken rules failing closed. The release adds Mac and Windows desktop apps, a Learning feature that turns a recorded task into a reusable skill, multi-account support through Composio and Arcade, and Bot-to-Bot orchestration; personal use is free and OpenBot for Business costs up to $29 per active user per month.