datasette-llm 0.1a11 supports OpenAI-compatible endpoints
Understand this story
Simon Willison released datasette-llm 0.1a11, an intermediate plugin for Datasette, adding support for OpenAI-compatible endpoints. Users can configure Datasette to use any LLM served via the OpenAI protocol, no longer limited to a specific hosting provider. Willison said that if a local model is running via LM Studio, Ollama, or llama.cpp, which just released v1.0.0, users can use uvx to launch a Datasette Agent instance powered by the local model.
AI overview based on source reports · Updated 1 hr ago
Coverage timeline
Follow the coverage to explore different perspectives.
- Simon Willisondatasette-llm 0.1a11
datasette-llm is an intermediate Datasette plugin for configuring LLMs used by other Datasette plugins. Version 0.1a11 adds support for OpenAI-compatible endpoints, allowing Datasette to use an LLM hosted anywhere that speaks the OpenAI pseudo-standard web protocol, including local models run with LM Studio, Ollama or llama.cpp (which just hit v1.0.0). The post shows running Datasette via uvx with a default_model configuration pointing at a local LM Studio endpoint to get a Datasette Agent instance powered by a local model.
Activity for this story
Not enough continuous observations to show a trend yet.