Skip to content
Hot eventDeveloping

Datasette-llm 0.1a11 Adds OpenAI-Compatible Endpoint Support

1 reports1 reporting sourcesUpdated 3 h ago

Start here

AI digest

Datasette-llm version 0.1a11, the intermediary plugin that configures LLMs for Datasette plugins, now supports OpenAI-compatible endpoints. This lets Datasette use models hosted on any service that implements the OpenAI web protocol, including local models run through LM Studio, Ollama or llama.cpp, which recently reached v1.0.0. According to Simon Willison, those local models can now power a Datasette Agent instance launched via uvx. The change widens where Datasette's LLM-backed features can draw their models from, extending beyond the providers the plugin previously supported to self-hosted and third-party OpenAI-compatible servers.

Generated from reports · updated 1 h ago

Report timeline

Follow the reports to see the event from different sides.

November 15
  1. Simon Willison
    Datasette-llm 0.1a11 adds OpenAI-compatible endpoint support

    Datasette-llm 0.1a11, the intermediate plugin for configuring LLMs across Datasette plugins, now supports OpenAI-compatible endpoints, letting Datasette use models hosted anywhere that speaks the OpenAI pseudo-standard web protocol. Local models running via LM Studio, Ollama or llama.cpp (which just hit v1.0.0) can now power a Datasette Agent instance launched through uvx.

Heat for this event

Not enough continuous observations yet to draw a trend.