LangChain Blog·· 1 d agoAI score36
LangSmith Launches Data Annotation Queues for LLM App Data Review
Announcing Data Annotation Queues
AI summary
LangSmith has launched Data Annotation Queues, a feature that lets teams filter logs, annotate datapoints, and add them to datasets for evaluation and fine-tuning. Users can query logs by filters such as negative user feedback, then label each datapoint or edit it before adding it to a dataset. The release coincides with langfree, an open-source package by Hamel Husain for extracting and curating ChatOpenAI runs from LangSmith traces.
Source:LangChain Blog · langchain.com