Skip to content
Hot eventDeveloping

Meta puts LLM-generated JiTTests into production

1 reports1 reporting sourcesUpdated 1 h ago

Start here

AI digest

Meta has moved its Catching Just-in-Time Tests (JiTTests) system from a research prototype into its production infrastructure. The system uses an LLM to generate tests designed to fail when a code diff introduces a bug, so risky changes are caught before they land. It runs on Meta's internal infrastructure overnight using spare capacity. JiTTests is internal to Meta: the company has not released code, models or an API, so the system is not publicly available. The reported figures put the initial deployment at 5%, while Meta's earlier ACH mutation-guided hardening is cited at 8%.

Generated from reports · updated 14 min ago

Report timeline

Follow the reports to see the event from different sides.

November 16
  1. MarkTechPost
    Meta's JiTTests generates LLM tests that fail on risky code before it lands

    Meta has moved its Catching Just-in-Time Tests (JiTTests) system from research prototype into production infrastructure, using LLM-generated tests designed to fail when a diff introduces a bug. 5% in the initial deployment. 8% for Meta's earlier ACH mutation-guided hardening.

Heat for this event

Not enough continuous observations yet to draw a trend.