Skip to content

Migrate piece 3 to mmdbbench: remove benchmarks/experiments/evidence - #603

Merged
tae898 merged 1 commit into
mainfrom
migrate/piece-3-evidence
Nov 14, 2026
Merged

tae898 merged 1 commit into
mainfrom
migrate/piece-3-evidence

Conversation

@tae898

@tae898 tae898 commented Nov 14, 2026

Copy link
Copy Markdown

Closes #602.

Piece 3 of the one-piece-at-a-time move of the benchmark work to humemai/mmdbbench (plan and state: humemai/mmdbbench#25). Removes benchmarks/experiments/evidence/ (12 files) and switches the one doc pointer in PUBLISHING.md to its new home.

Where the content lives now: https://github.com/humemai/mmdbbench/tree/cab7f8456a758f30b48300a3d9c53bac3adc3381/experiments/evidence

Equality, computed by script (git show <commit>:<path> | sha256sum on both sides for each file, the script stops on any difference; this repository at f25676d0ae, mmdbbench at cab7f8456a, both sides hold the same 12 files and no others):

file under evidence/ bytes sha256 (equal on both sides)
ablation_cache_8d6af9475.jsonl 81871 100f48043c91843e1d7291cb00fd2abfc2e4b03e4819eb4c46ded26b684a0f1f
delta_scan_8d6af9475/delta_10000000_bounded.jsonl 4299 9216aaa367a28178c86cf463ada315434cdff51086f0123523a94789c6cdf1c9
delta_scan_8d6af9475/delta_10000000_sweep.jsonl 4345 697e0588439de71cb29646db13e283cc6eaa2e506cab5e22e01861fb4e4b5310
delta_scan_8d6af9475/delta_1000000_bounded.jsonl 4244 b0afeefb8dcfb5832804d3f344b1a7b8d22655e7bfcdedc1be6923ce661c2180
delta_scan_8d6af9475/delta_1000000_sweep.jsonl 4294 b06e799f32becd17c5c18a3c29538d00318d77d5ba4e2f89b2664ffec9758c41
lifecycle_close_repro.py 2976 e24f4c097c04b607bbaa6aefe0c713a1874b5cce96c1be7b006eb2408fd2e635
runs_lifecycle_8d6af9475.jsonl 279963 d675063cc50ab9accb0ec91622d05d7e2ef0e695758c231d4bd4fce951380050
verify_9010582b79/README.md 769 bdb8eff52449c672cff819a6998424b60c47e11acb1838da00684b84a133e3b6
verify_9010582b79/cache_default_10m.jsonl 337 64a231270aea2eaa08204219e9f2112be5872dce91e51169f1217bdfca0e299f
verify_9010582b79/cache_lines.txt 209 eeb59f7399d70e3391f24495328d34318f7f95fa07b8483d5f16073ad8d5ce6f
verify_9010582b79/delta_10000000_bounded.jsonl 4677 1b235eeae8db693e91c9fa3980bf84cc63a8f16da842ff6b5e4ad15c034e1f80
verify_9010582b79/delta_probe.engine-lines.txt 2870 aa0ad1be240d5778258ca25bdf74c52a1c590d20b6783dd30bf198957eb55d32

Consumers: the four upstream links (ArcadeData#7146, ArcadeData#7184 comment and body, ArcadeData#7260) already point to mmdbbench (0 old links, 1 new link per text). Doc references in this repository: PUBLISHING.md (switched here); PROTOCOL.md and dense_matrix.py name results/ablation_cache_8d6af9475.jsonl, the untracked working store, so they are not affected. No kit script on the benchmark host names evidence/ (read only scan of the stage kits, studies, candidate-build kit and home scripts).

Gate: the commit passed the repository's pre-commit hooks. The harness tests (.github/workflows/test-benchmarks-experiments.yml) run in CI on this pull request; the laptop guard blocks pytest, so I did not run them there. Draft until that run is green. I do not merge it.

🤖 Generated with Claude Code

…(refs #602)

humemai/mmdbbench holds experiments/evidence/ with the same 12 files and the
same sha256 per file (checked by script against cab7f8456a). The four
upstream links that named this directory (ArcadeData#7146, ArcadeData#7184,
ArcadeData#7260) were moved to mmdbbench first. PUBLISHING.md now points at the mmdbbench
tree by commit URL. No kit script on the benchmark host names the directory;
PROTOCOL.md and dense_matrix.py name results/, the untracked working store.
Third step of the one-piece-at-a-time retirement of this repository
(humemai/mmdbbench#25 and #26).

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
@tae898 tae898 added the enhancement New feature or request label Nov 14, 2026
@tae898 tae898 self-assigned this Nov 14, 2026
@tae898
tae898 marked this pull request as ready for review November 14, 2026 15:06
@tae898
tae898 merged commit 71512f3 into main Nov 14, 2026
4 checks passed
@tae898
tae898 deleted the migrate/piece-3-evidence branch November 14, 2026 15:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Migrate piece 3 to mmdbbench: remove benchmarks/experiments/evidence

1 participant