Skip to content

Drop the retrieval-eval database too, which the test-job cleanup did not cover - #682

Merged
mkreyman merged 1 commit into
masterfrom
ci/drop-retrieval-eval-db
Aug 13, 2026
Merged

Drop the retrieval-eval database too, which the test-job cleanup did not cover#682
mkreyman merged 1 commit into
masterfrom
ci/drop-retrieval-eval-db

Conversation

@mkreyman

Copy link
Copy Markdown
Owner

retrieval-eval builds its own run-scoped database via DEV_DB_NAME and never dropped it. The cleanup added in #681 covered only the ExUnit database, so every eval run left a loopctl_ci_eval_<run id> behind on the shared CI instance for the reaper to find two days later.

Counted on beelink just now: 64 of them.

Worth naming as a pattern, not two coincidences

This is the same shape as ecommerce-friendly#101, found the same way. When the CI port and the run-scoped name were rolled out, they went onto every job that creates a database. The drop went onto the obvious one.

The gap does not show up in a diff — both workflows look complete. It shows up as a count on the server, which is the only place either was found:

$ psql -p 5433 -Atqc "select count(*) ... like 'loopctl_ci_eval%'"
64

The generalisable check, for any repo adopting end-of-job cleanup: enumerate jobs whose env names a database, and assert each has a drop step. Two of five jobs across two repos failed that check after their cleanup PRs merged green.

Reviewed inline (this session cannot dispatch agents/workflows) per the CLAUDE.md gate clause.

…not cover

retrieval-eval builds its OWN run-scoped database via DEV_DB_NAME and never
dropped it. The cleanup added in PR 681 covered only the ExUnit database, so every
eval run left a loopctl_ci_eval_<run id> behind on the shared CI instance for the
reaper to find two days later. Counted on beelink just now: 64 of them.

Same shape as the miss in ecommerce-friendly PR 101, and worth naming as a pattern
rather than two coincidences. When the CI port and the run-scoped NAME were rolled
out, they were applied to every job that creates a database; the DROP was applied
to the obvious one. The gap does not show up in a diff - both files look complete -
it shows up as a count on the server, which is the only place I found either of
them.
@mkreyman
mkreyman merged commit 7aa28cd into master Aug 13, 2026
15 checks passed
@mkreyman
mkreyman deleted the ci/drop-retrieval-eval-db branch August 13, 2026 01:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant