Skip to content

Gate releases on a live benchmark regression check - #125

Merged
morgaesis merged 1 commit into
mainfrom
bench-release-gate
Jul 30, 2026
Merged

Gate releases on a live benchmark regression check#125
morgaesis merged 1 commit into
mainfrom
bench-release-gate

Gate releases on a live benchmark regression check

47886b6
Select commit
Loading
Failed to load commit list.
postil-dev / postil/review succeeded Jul 30, 2026 in 2m 50s

0 error, 1 warn, 0 info

info 1 advisory finding open

  • PR description claims p95 latency is lower than detection rate in pull request description: The description says 'p50/p95 latency of 4.5 and 48.6 seconds, the last of these lower than detection rate because it also penalizes a must-block defect reported at warn.' The 'last of these' refers to p95 latency (48.585s per bench/baseline.json line 21), but 48.585 seconds is not 'lower than' the detection rate of 0.965 (line 15) — the units are incomparable. The explanation about penalizing a must-block defect applies to gate-verdict correctness (76.8%, line 17), which is indeed lower than detection rate (96.5%). The sentence as written contradicts baseline.json. Fix the referent: clarify that gate-verdict correctness, not p95 latency, is lower than detection rate because it penalizes must-block defects reported at warn.

Review details