Hacker News AI· clemo_ra·· 23 hr agoAI score58
Show HN: Langfuse AI Gateway, open source rust gateway to trace every LLM call
Show HN: Langfuse AI Gateway, open source rust gateway to trace every LLM call
AI summary
Langfuse AI Gateway is a standalone Rust gateway that exposes OpenAI and Anthropic native APIs under /openai/v1 and /anthropic/v1 namespaces, relaying provider JSON or SSE without rewriting bytes while capturing each finalized generation and uploading it to Langfuse via OTLP. It resolves gateway keys to trusted provider connections through Web, adds request IDs and trace/observation IDs to responses, and emits operational OpenTelemetry traces and metrics. Configuration is environment-based, with pnpm dev or cargo run for local use and no real provider credentials needed for building and testing.
Source: Hacker News AI · github.com