Skip to content

[draft / wip] feat(stovepipe): coalesce backlog in process controller (PR A)#324

Draft
mnoah1 wants to merge 1 commit into
mnoah1/stovepipe-ingest-queue-wiringfrom
mnoah1/stovepipe-process-coalesce
Draft

[draft / wip] feat(stovepipe): coalesce backlog in process controller (PR A)#324
mnoah1 wants to merge 1 commit into
mnoah1/stovepipe-ingest-queue-wiringfrom
mnoah1/stovepipe-process-coalesce

Conversation

@mnoah1

@mnoah1 mnoah1 commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

Summary

PR A — process coalesce only. Touches stovepipe/controller/process/ (3 files).

  • accepted → compare against queue.latest_request_id; older heads → superseded; latest → ack (admit deferred)
  • superseded / processing → ack no-op (processing republish in PR C)
  • Retryable load for request/queue not-found; supersede CAS with version-mismatch retry

No proto, service wiring, or registry changes in this PR.

Why

Ingest admits every distinct head, but only the latest is worth validating. This PR drops intermediates before admit, gate, and build strategy land — kept isolated to one package for review.

Follow-up stack

PR Branch (planned) Scope
A (this) mnoah1/stovepipe-process-coalesce Coalesce + supersede
B mnoah1/stovepipe-build-contract BuildRequest proto/topic
C mnoah1/stovepipe-process-republish processing → build republish + registry
D (with C or separate) BatchSize=1 on process subscription
build stub, integration test, strategy, admit, gate

Saved WIP for B/C at local branch mnoah1/stovepipe-process-republish-wip (65c5fd6).

Test plan

  • //stovepipe/controller/process:go_default_test
  • //stovepipe/controller:go_default_test
  • //test/integration/stovepipe:go_default_test

@mnoah1 mnoah1 requested review from a team, behinddwalls and sbalabanov as code owners July 9, 2026 15:22
@mnoah1 mnoah1 marked this pull request as draft July 9, 2026 15:23
@mnoah1 mnoah1 changed the title feat(stovepipe): coalesce backlog in process controller [draft / wip] feat(stovepipe): coalesce backlog in process controller Jul 9, 2026
Compare accepted requests against queue.latest_request_id and mark
older heads superseded. Latest heads remain accepted until admit lands
in a follow-up PR.
@mnoah1 mnoah1 force-pushed the mnoah1/stovepipe-process-coalesce branch from 65c5fd6 to 0bb81c6 Compare July 9, 2026 15:28
@mnoah1 mnoah1 changed the title [draft / wip] feat(stovepipe): coalesce backlog in process controller feat(stovepipe): coalesce backlog in process controller (PR A) Jul 9, 2026
@mnoah1 mnoah1 changed the title feat(stovepipe): coalesce backlog in process controller (PR A) [draft / wip] feat(stovepipe): coalesce backlog in process controller (PR A) Jul 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant