Skip to content
Hot eventDeveloping

LangSmith launches Data Annotation Queues beta

1 reports1 reporting sourcesUpdated 1 d ago

Start here

AI digest

LangSmith has released Data Annotation Queues in beta, a feature that lets teams filter logs, annotate individual datapoints, and add them to datasets for evaluation and fine-tuning. Users can query logs with filters such as negative user feedback, then label or edit each datapoint before adding it to a dataset. Access requires signing up for the beta. The release coincides with langfree, an open-source package by Hamel Husain for extracting and curating ChatOpenAI runs from LangSmith traces.

Generated from reports · updated 11 h ago

Report timeline

Follow the reports to see the event from different sides.

November 19
  1. LangChain Blog
    LangSmith Launches Data Annotation Queues for LLM App Data Review

    LangSmith has launched Data Annotation Queues, a feature that lets teams filter logs, annotate datapoints, and add them to datasets for evaluation and fine-tuning. Users can query logs by filters such as negative user feedback, then label each datapoint or edit it before adding it to a dataset. The release coincides with langfree, an open-source package by Hamel Husain for extracting and curating ChatOpenAI runs from LangSmith traces.

Heat for this event

Current, comparable range
5
Peak, comparable range
7November 19 17:00
Change in 24 hours
–

The trend compares the same participants over hours observed continuously, so its range can be narrower than the current heat count. Hover or tap the chart for hourly heat; the arrow keys move through it.