An easy way to try local AI with braindead-local-intelligence

Solène introduces braindead-local-intelligence, a project that runs podman containers for an OpenAI-compatible LLM server, an image generation server, SearXNG web search and Open WebUI behind a single token-protected address, loading only one model at a time and unloading it after a few minutes idle. It requires a Linux system with rootless podman 5.0 or newer, targets AMD GPUs (tested up to 12 GB VRAM), and offers a documented list of ready-to-use text, vision and image models. Setup involves adding the user to the render and video groups, running bin/ia install and ia doctor, then ia start, with the web interface at http://127.0.0.1:3000.