iCreatAI News
Skip to content
Hacker News AI· Ir0n·· 34 min agoAI score58

Show HN: Goethe – The infrastructure for self-hosted AI

Show HN: Goethe – The infrastructure for self-hosted AI

AI summary

Goethe turns a Linux machine with NVIDIA GPUs into a self-hosted API compatible with OpenAI, Anthropic and LiteLLM clients, letting you install, load and share models in three steps. It serves every loaded model at one address, supports rate-limited and revocable keys, and offers network options including local-only, VPN or public IP. It requires an NVIDIA driver (580+ for GeForce/TITAN cards) and ships its own CUDA 13 runtime, with support for Blackwell, Hopper, Ada and Ampere GPUs.

Source: Hacker News AI · github.com