AI writes the fix.
PatchLens verifies it.

Independently reproduce the original failure, apply the candidate patch, and confirm the result using deterministic execution evidence.

ReproduceApply patchRe-run failureRun testsInspectVerdict
Ready

Student attendance application — KeyError on unknown student lookup.

benchmark/good_fix.diff

$python reproduce.py

Uses the bundled demo project

  1. Reproduce original failure

    Run the reproduction command against the unpatched codebase.

  2. Apply candidate patch

    Apply the diff to a clean working copy.

  3. Re-run original failure

    Execute the same command against the patched codebase.

  4. Run test suite

    Execute the full test suite to check for regressions.

  5. Inspect patch integrity

    Static checks for suspicious patch patterns.

  6. Produce verdict

    Emit VERIFIED, NOT FIXED, or INCONCLUSIVE.

plj-20240612-001

demo-repo

KeyError when looking up attendance for an unknown student. The application crashes instead of handling a missing student record gracefully.

candidate.diff
--- a/app/student_service.py
+++ b/app/student_service.py
@@ -7,7 +7,12 @@
def get_student(student_id):
- return STUDENTS[student_id]
+ return STUDENTS.get(student_id)
def get_attendance(student_id):
student = get_student(student_id)
+
+ if student is None:
+ return None
+
return student["attendance"]
$python reproduce.py

Runs end-to-end deterministic verification