iCreatAI News
Skip to content
Trending storyUpdating

Meta puts JiTTests into production infrastructure

1 reports1 sources2 hr agoUpdated

Understand this story

AI overview

Meta has moved JiTTests from a research prototype to production infrastructure. This large language model-based system generates "should fail" tests for risky code changes, using test failures to prove that the change actually altered code behavior, thereby intercepting defects before code is merged. JiTTests runs on Meta's internal infrastructure, using idle compute to execute at night. It is currently not publicly available, and Meta has not released the related code, models, or API.

AI overview based on source reports · Updated 2 hr ago

Coverage timeline

Follow the coverage to explore different perspectives.

Nov 16
  1. MarkTechPost
    Meet Meta’s JiTTests: LLM-Generated Tests Designed to Fail Before Risky Code Lands

    Meta has moved JiTTests, an LLM-based system that generates executable tests designed to fail on risky code changes, from research prototype into production infrastructure, and reports it caught 74 privacy SEVs at the diff stage in the first half of 2026 while privacy SEV occurrence fell 20%. The pipeline selects risky diffs overnight, generates candidate tests via dodgy-diff and intent-aware workflows, scores failures with an LLM judge ensemble plus rule-based filters, and keeps humans on the loop; the FSE 2026 paper analyzes 22,126 generated tests. Engineers report a 60% true-positive rate at full scale, up from 19.5% in the initial deployment, and the system is internal only with no code, models or API released.

Activity for this story

Not enough continuous observations to show a trend yet.