Meta puts LLM-generated JiTTests into production
Start here
Meta has moved its Catching Just-in-Time Tests (JiTTests) system from a research prototype into its production infrastructure. The system uses an LLM to generate tests designed to fail when a code diff introduces a bug, so risky changes are caught before they land. It runs on Meta's internal infrastructure overnight using spare capacity. JiTTests is internal to Meta: the company has not released code, models or an API, so the system is not publicly available. The reported figures put the initial deployment at 5%, while Meta's earlier ACH mutation-guided hardening is cited at 8%.
Generated from reports · updated 14 min ago
Report timeline
Follow the reports to see the event from different sides.
- MarkTechPostMeta's JiTTests generates LLM tests that fail on risky code before it lands
Meta has moved its Catching Just-in-Time Tests (JiTTests) system from research prototype into production infrastructure, using LLM-generated tests designed to fail when a diff introduces a bug. 5% in the initial deployment. 8% for Meta's earlier ACH mutation-guided hardening.
Heat for this event
Not enough continuous observations yet to draw a trend.