Hacker News · AI·· 44 min agoAI score55
Langfuse releases AI Gateway, an open source Rust gateway that traces every LLM call
Show HN: Langfuse AI Gateway, open source rust gateway to trace every LLM call
AI summary
Langfuse has published AI Gateway, a standalone Rust service that proxies native OpenAI and Anthropic API paths under /openai/v1 and /anthropic/v1 and uploads each finalized call to Langfuse as a generation over OTLP. The gateway relays provider JSON and SSE bytes without rewriting them, resolves credentials through Langfuse Web, and works with Claude Code by pointing ANTHROPIC_BASE_URL at the /anthropic namespace. It ships as a multi-platform Docker image on Docker Hub and ghcr.io, with capture limited to 5 MiB request inspection and 1 MiB retained output per execution.
Source:Hacker News · AI · github.com