Skip to content
Hot eventDeveloping

LangSmith launches Alerts for production monitoring

1 reports1 reporting sourcesUpdated 1 d ago

Start here

AI digest

LangChain has launched Alerts in LangSmith, letting teams monitor LLM apps and agents in real time. Alerts can be set on error count and rate, average latency, and average feedback score, and each one supports filters for specific run subsets, 5- or 15-minute aggregation windows, and thresholds. Notifications are delivered through PagerDuty or a custom webhook, such as one that posts to a Slack channel. LangChain says users who already send production traces to LangSmith can set up their first alert now.

Generated from reports · updated 11 h ago

Report timeline

Follow the reports to see the event from different sides.

November 19
  1. LangChain Blog
    LangSmith Alerts: Monitor LLM App Failures in Real Time

    LangChain launched Alerts in LangSmith, letting teams monitor LLM apps and agents in real time on error count and rate, average latency, and average feedback score. Each alert supports filters for specific run subsets, 5- or 15-minute aggregation windows, and thresholds, with delivery via PagerDuty or custom webhooks such as Slack. Users already sending production traces to LangSmith can set up an alert now.

Heat for this event

Current, comparable range
5
Peak, comparable range
7November 19 17:00
Change in 24 hours
–

The trend compares the same participants over hours observed continuously, so its range can be narrower than the current heat count. Hover or tap the chart for hourly heat; the arrow keys move through it.