LangSmith launches Data Annotation Queues beta
Start here
LangSmith has released Data Annotation Queues in beta, a feature that lets teams filter logs, annotate individual datapoints, and add them to datasets for evaluation and fine-tuning. Users can query logs with filters such as negative user feedback, then label or edit each datapoint before adding it to a dataset. Access requires signing up for the beta. The release coincides with langfree, an open-source package by Hamel Husain for extracting and curating ChatOpenAI runs from LangSmith traces.
Generated from reports · updated 11 h ago
Report timeline
Follow the reports to see the event from different sides.
- LangChain BlogLangSmith Launches Data Annotation Queues for LLM App Data Review
LangSmith has launched Data Annotation Queues, a feature that lets teams filter logs, annotate datapoints, and add them to datasets for evaluation and fine-tuning. Users can query logs by filters such as negative user feedback, then label each datapoint or edit it before adding it to a dataset. The release coincides with langfree, an open-source package by Hamel Husain for extracting and curating ChatOpenAI runs from LangSmith traces.
Heat for this event
- Current, comparable range
- 5
- Peak, comparable range
- 7November 19 17:00
- Change in 24 hours
- –
The trend compares the same participants over hours observed continuously, so its range can be narrower than the current heat count. Hover or tap the chart for hourly heat; the arrow keys move through it.