Langfuse releases open-source Rust AI Gateway for LLM tracing
Start here
Langfuse has released AI Gateway, a standalone open-source Rust service that proxies native OpenAI and Anthropic API paths under /openai/v1 and /anthropic/v1 and uploads each finalized call to Langfuse as a generation over OTLP. The gateway relays provider JSON and SSE bytes without rewriting them, resolves credentials through Langfuse Web, and can be used with Claude Code by pointing ANTHROPIC_BASE_URL at the /anthropic namespace. Inference requires a configured Web URL and shared service key; without a Web URL the process starts with only liveness available, while readiness and inference return 503. Building and testing need no real Web, database or provider credentials, and the gateway loads the root .env and listens on the first available port starting at 8080. It ships as a multi-platform Docker image on Docker Hub and ghcr.io. Capture is limited to 5 MiB of request inspection and 1 MiB of retained output per execution.
Generated from reports · updated 11 min ago
Report timeline
Follow the reports to see the event from different sides.
- Hacker News · AILangfuse releases AI Gateway, an open source Rust gateway that traces every LLM call
Langfuse has published AI Gateway, a standalone Rust service that proxies native OpenAI and Anthropic API paths under /openai/v1 and /anthropic/v1 and uploads each finalized call to Langfuse as a generation over OTLP. The gateway relays provider JSON and SSE bytes without rewriting them, resolves credentials through Langfuse Web, and works with Claude Code by pointing ANTHROPIC_BASE_URL at the /anthropic namespace. It ships as a multi-platform Docker image on Docker Hub and ghcr.io, with capture limited to 5 MiB request inspection and 1 MiB retained output per execution.
Heat for this event
Not enough continuous observations yet to draw a trend.