ShadowDiff releases AI migration backend shadow testing tool
Understand this story
Developer vishalraj1 has released ShadowDiff, a network proxy and analysis engine for comparing old and new services when AI refactors a backend. It copies real HTTP traffic simultaneously to the legacy service and the AI-refactored service, performing a three-way diff comparison. ShadowDiff mirrors traffic via Envoy's request_mirror_policies, uses dual baselines to cancel out noise such as timestamps, and compares SQL writes, transaction boundaries, and N+1 queries. The project is under the MIT license.
AI overview based on source reports · Updated 42 min ago
Coverage timeline
Follow the coverage to explore different perspectives.
- Hacker News AIShow HN: ShadowDiff – Shadow testing and SQL diffing for AI-migrated back ends
ShadowDiff is a network proxy and analysis engine that mirrors live HTTP traffic to both a legacy service and its AI-refactored candidate, then runs a 3-way diff with noise cancellation plus SQL side-effect comparison to isolate genuine regressions. It integrates with Envoy/Istio request mirroring, uses Google Gemini (gemini-2.0-flash) to synthesize regression tests, can open GitHub PRs with fixes, and offers a `shadowdiff gate` CLI for CI/CD quality gating. The project is MIT-licensed and includes Docker Compose and Kubernetes/Istio deployment examples.
Activity for this story
Not enough continuous observations to show a trend yet.