Simon Willison·· 3 hr agoAI score22
datasette-llm 0.1a11
datasette-llm 0.1a11
AI summary
datasette-llm is an intermediate Datasette plugin for configuring LLMs used by other Datasette plugins. Version 0.1a11 adds support for OpenAI-compatible endpoints, allowing Datasette to use an LLM hosted anywhere that speaks the OpenAI pseudo-standard web protocol, including local models run with LM Studio, Ollama or llama.cpp (which just hit v1.0.0). The post shows running Datasette via uvx with a default_model configuration pointing at a local LM Studio endpoint to get a Datasette Agent instance powered by a local model.
Source: Simon Willison · simonwillison.net