Skip to content
Only First-party#RAG
TodayNovember 13Friday4 items
  1. OpenRouter Announcements58

    OpenRouter tests 11 rerankers on a 274-question RAG benchmark

    OpenRouter benchmarked 11 rerankers on a 274-question synthetic RAG dataset and found that reranking the top 30 vector-search candidates with voyageai/rerank-3-lite raised precision@1 from 81.0% to 97.1% at about $0.10 per 1,000 queries. The guide recommends retrieving roughly 30 chunks, reranking them, and sending only the top 3 to the LLM, which in its test lifted answer accuracy to 99.3% while cutting answering cost from $0.22 to $0.16 per 1,000 questions. It also flags failure modes: omitting the input_type parameter cost 7 to 12 points of precision@1, and cohere/rerank-v3.5 silently ignores content beyond its 4,096-token limit.

  2. AWS Machine Learning Blog40

    How Natera built SWARM, an agentic AI system for lab ops on Amazon Bedrock AgentCore

    Natera built SWARM, an agentic AI system for lab operations, on Amazon Bedrock AgentCore, cutting first response time by about 130x and automating 96.2 percent of support tickets. The system pairs a swarm-agent that drafts diagnostic reports before engineers open a ticket with a swarm-hive for real-time engineer interaction, both sharing one skill library. It addresses over 65 daily Jira tickets across three queues that previously averaged 17.4 hours for first response.

  3. AWS Machine Learning Blog40

    AWS opens catalog of 23 reusable generative AI assets from its Innovation Center

    AWS has published a catalog of 23 production-ready, open source generative AI assets from its Generative AI Innovation Center, now part of AWS Frontier AI Engineering & Services. The building blocks cover RAG pipelines, document processors, agent scaffolding and evaluation frameworks, and AWS says they can cut development from months to weeks. DoorDash reported a 50x increase in testing capacity and Ricoh a 7-fold throughput increase after building on the assets.

  4. AWS Machine Learning Blog34

    Migrating to Amazon Bedrock Managed Knowledge Base with a coding agent

    AWS added a knowledge base migration guide to the amazon-bedrock skill in the Agent Toolkit for AWS, letting a coding agent plan a move from a customer-managed knowledge base to Amazon Bedrock Managed Knowledge Base. The agent starts with read-only discovery and a line-by-line reviewed plan, then creates the new knowledge base and data sources alongside the original or writes a migrated IaC template. Managed Knowledge Base raises default quotas to 200 data sources per knowledge base and 10,000 knowledge bases per account per Region, and adds agentic retrieval, AgentCore Gateway integration, and resource-based policies.

November 11Wednesday
  1. Hugging Face Blog41

    Pooling-Aware Training for Multi-Vector Embedding Models with Sentence Transformers

    Hugging Face shows how pooling-aware training lifts retrieval quality for multi-vector embedding models at a fixed storage budget. With pool_factor=4, a normally trained model keeps 94.6% of its unpooled NanoBEIR nDCG@10 while cutting document vectors 4x, and pooling-aware training raises that retention to 97.8%. The post walks through HierarchicalTokenPooling, budget calibration and a reproducible Sentence Transformers example.

  2. LangChain Blog58

    LangChain explains retrieval techniques for AI agent context engineering

    LangChain published a blog post on how retrieval design shapes context engineering for AI agents, using a competitive analysis agent built on its Deep Agents harness as the example. The post covers three failure modes, inefficient searching, loading too much context at once, and irrelevant or stale results, and pairs each with techniques such as glob and grep filesystem tools, paging through large files with read_file offsets, offloading oversized tool results to files, and delegating reading to subagents under a retrieve, offload, delegate pattern. It also warns that retrieved text is data rather than instructions and can carry prompt injection, so outputs should be checked against cited sources.

November 5Thursday
  1. Apple Machine Learning Research38

    Apple's Learned Support Functions Speed Up RAG Retrieval

    Apple researchers presented "Amortizing Maximum Inner Product Search with Learned Support Functions" at ICML 2026, training small neural networks offline to route queries toward their best-matching keys faster. SupportNet learns the support function via input convex neural networks (ICNNs) to improve cluster routing, while KeyNet directly outputs the best-matching key vector, kept geometrically grounded by a consistency loss from Euler's theorem. Both are trained on the actual query distribution, trading an upfront amortization cost for faster, more accurate retrieval at inference time.

October 26Monday
  1. Mastra Blog40

    Mastra opens Knowledge, a self-hosted company brain for AI agents, to eight more design partners

    Mastra is opening its Knowledge service, a self-hosted company-wide context layer for AI agents, to eight more design partners on a first-come, first-served basis. Knowledge connects systems like Slack and Monday, keeps itself current, and supports separate knowledge bases per function with permissions at the individual, team and org level. Mastra says wiring a company-wide knowledge graph into its coding agents produced a noticeable improvement in shipped code quality.

October 30, 2025Thursday
  1. Modal Blog38

    Modal and Datalab: Deploy Marker and Surya Document Intelligence in Under 5 Minutes

    Modal has partnered with Datalab to let developers deploy the Marker document-parsing model and Surya OCR toolkit on Modal GPUs in under five minutes. Marker is a sub-billion-parameter model supporting over 90 languages, and running it on Modal reaches about 2.2 pages per second per container, roughly 10x the 0.22 pages per second on an M4 Mac using Apple MPS. Datalab's tools stay free for research, personal use, and startups under $2M in funding or revenue, with commercial licensing available.

September 24, 2024Tuesday
September 18, 2024Wednesday
April 26, 2024Friday
  1. Modal Blog50

    Fine-tuning an open source embedding model to beat OpenAI's text-embedding-3-small

    A fine-tuned open source embedding model can outperform OpenAI's text-embedding-3-small in accuracy at lower cost using only a handful of examples. Modal ran an experiment on the Quora duplicate-questions dataset to find how much fine-tuning data a simple question-answering use case needs, and describes how to build one on its serverless infrastructure.

January 23, 2024Tuesday
  1. Modal Blog40

    Embedding English Wikipedia in under 15 minutes with Modal and Hugging Face TEI

    Modal and Hugging Face's Text Embedding Inference server can embed the entire English Wikipedia in about 15 minutes for just over $15, using Modal's serverless GPU scaling. The post argues open-source embedding models beat API-based ones like OpenAI's text-embedding-ada-002 for production RAG, since they can be fine-tuned on user data and avoid rate limits and per-token costs.