Datasette-llm 0.1a11 Adds OpenAI-Compatible Endpoint Support
Start here
Datasette-llm version 0.1a11, the intermediary plugin that configures LLMs for Datasette plugins, now supports OpenAI-compatible endpoints. This lets Datasette use models hosted on any service that implements the OpenAI web protocol, including local models run through LM Studio, Ollama or llama.cpp, which recently reached v1.0.0. According to Simon Willison, those local models can now power a Datasette Agent instance launched via uvx. The change widens where Datasette's LLM-backed features can draw their models from, extending beyond the providers the plugin previously supported to self-hosted and third-party OpenAI-compatible servers.
Generated from reports · updated 1 h ago
Report timeline
Follow the reports to see the event from different sides.
- Simon WillisonDatasette-llm 0.1a11 adds OpenAI-compatible endpoint support
Datasette-llm 0.1a11, the intermediate plugin for configuring LLMs across Datasette plugins, now supports OpenAI-compatible endpoints, letting Datasette use models hosted anywhere that speaks the OpenAI pseudo-standard web protocol. Local models running via LM Studio, Ollama or llama.cpp (which just hit v1.0.0) can now power a Datasette Agent instance launched through uvx.
Heat for this event
Not enough continuous observations yet to draw a trend.