Gate releases on a live benchmark regression check - #125
Merged
postil-dev / postil/review
succeeded
Jul 30, 2026 in 2m 50s
0 error, 1 warn, 0 info
- PR description claims p95 latency is lower than detection rate in pull request description: The description says 'p50/p95 latency of 4.5 and 48.6 seconds, the last of these lower than detection rate because it also penalizes a must-block defect reported at warn.' The 'last of these' refers to p95 latency (48.585s per bench/baseline.json line 21), but 48.585 seconds is not 'lower than' the detection rate of 0.965 (line 15) — the units are incomparable. The explanation about penalizing a must-block defect applies to gate-verdict correctness (76.8%, line 17), which is indeed lower than detection rate (96.5%). The sentence as written contradicts baseline.json. Fix the referent: clarify that gate-verdict correctness, not p95 latency, is lower than detection rate because it penalizes must-block defects reported at warn.
Loading