Commit 92447bd
docs(fr-041): two validity threats found by running the thing, not reasoning about it
A pilot run on 2026-09-12 (first execution of the revived harness against 1.0.3)
surfaced two §8 entries that no amount of reading the design would have produced.
The agent inherits the HOST's MCP servers and user-level agent instructions,
because it is launched headless with the sandbox as its working directory and
nothing isolates its configuration. Part of each arm's context therefore comes
from whichever workstation runs it: not a fixed treatment, and not reproducible
by a stranger, which is the whole claim a published benchmark makes. Every
archived run shares the exposure.
And the per-task budget cap has to be re-derived whenever the agent model
changes — the same run took roughly twice the turns and cost of its archived
predecessor on the previous model generation, so a cap carried over unchanged
binds at a different rate than the one §8 reasons about.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_011cQxyVuTkdPmAduLiedNEg1 parent 49f1c47 commit 92447bd
1 file changed
Lines changed: 11 additions & 0 deletions
Lines changed: 11 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
317 | 317 | | |
318 | 318 | | |
319 | 319 | | |
| 320 | + | |
| 321 | + | |
| 322 | + | |
| 323 | + | |
| 324 | + | |
| 325 | + | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
320 | 331 | | |
321 | 332 | | |
322 | 333 | | |
| |||
0 commit comments