Langfuse open-sources Rust AI Gateway
Understand this story
Langfuse has open-sourced AI Gateway on GitHub: a standalone gateway written in Rust that proxies native provider APIs under the two namespaces /openai/v1 and /anthropic/v1, and uploads each call as a generation to Langfuse via OTLP. For deployment, when no Web URL is configured the process can still start and liveness is available, but readiness and inference requests return 503; to enable inference, a Web URL and a shared service key must be configured. Both namespaces limit request bodies to 16 MiB by default. Building and testing do not require real Web, database, or provider credentials.
AI overview based on source reports · Updated 22 hr ago
Coverage timeline
Follow the coverage to explore different perspectives.
- Hacker News AIShow HN: Langfuse AI Gateway, open source rust gateway to trace every LLM call
Langfuse AI Gateway is a standalone Rust gateway that exposes OpenAI and Anthropic native APIs under /openai/v1 and /anthropic/v1 namespaces, relaying provider JSON or SSE without rewriting bytes while capturing each finalized generation and uploading it to Langfuse via OTLP. It resolves gateway keys to trusted provider connections through Web, adds request IDs and trace/observation IDs to responses, and emits operational OpenTelemetry traces and metrics. Configuration is environment-based, with pnpm dev or cargo run for local use and no real provider credentials needed for building and testing.
Activity for this story
- Current comparable activity
- 5
- Peak comparable activity
- 10Nov 14 00:00
- Change in the past 24 hours
- –
Trends compare the same fully observed participants, which may cover fewer participants than current activity. Move the pointer or tap the chart to inspect hourly activity; use the left and right arrow keys with a keyboard.