Skip to content

Reconcile reviewer contracts with extracted publication guidance - #74559

Merged
pelikhan merged 1 commit into
mainfrom
pelikhan/reviewer-contract-reconciliation
Nov 3, 2026
Merged

pelikhan merged 1 commit into
mainfrom
pelikhan/reviewer-contract-reconciliation

Conversation

@pelikhan

@pelikhan pelikhan commented Nov 3, 2026

Copy link
Copy Markdown
Collaborator

Why

#74360 extracted PR Code Quality Reviewer publication guidance into the inline review-publication skill, leaving three Go contract tests asserting removed wording and obsolete step boundaries.

Changes

Update the contracts to check publication safeguards in the extracted skill and verify that the main workflow delegates to it only after the specialist completion barrier. Preserve bounded recovery, permission restrictions, comment-before-review ordering, and write-once submission coverage, with additional assertions for JSON/shell escaping and publication closure. Workflow behavior is unchanged.

Validation

  • Reproduced all three contract failures before the change.
  • go test ./pkg/cli -run '^TestPRCodeQualityReviewer' -count=1
  • make build
  • make fmt
  • make agent-report-progress

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@pelikhan
pelikhan marked this pull request as ready for review November 3, 2026 16:23
Copilot AI auto review requested due to automatic review settings November 3, 2026 16:23
@pelikhan
pelikhan merged commit 92b45a2 into main Nov 3, 2026
47 of 57 checks passed
@pelikhan
pelikhan deleted the pelikhan/reviewer-contract-reconciliation branch November 3, 2026 16:24
@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

🧠 Matt Pocock Skills Reviewer has completed the skills-based review. ✅

🧠 Reviewed using Matt Pocock's skills by Matt Pocock Skills Reviewer

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

✅ Design Decision Gate 🏗️ completed the design decision gate check. See the comment below for the result and any generated ADR draft.

Design Decision Gate 🏗️

Outcome: reported_no_action

The agent completed and reported no action. A no-op output alone does not verify that all required work was completed or that publication was possible.

Agent messages are omitted from this comment. The category uses structured run status, not interpretation of agent prose.

Generated from Design Decision Gate 🏗️ · routed: gpt56 max · ~1 AIC · ⌖ ~2 AIC · ⊞ 7.7K · ◷

🏗️ ADR gate enforced by Design Decision Gate 🏗️

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

✅ PR Code Quality Reviewer completed the code quality review.

🔎 Code quality review by PR Code Quality Reviewer

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

✅ Test Quality Sentinel completed test quality analysis.

Test Quality Sentinel

Outcome: reported_no_action

The agent completed and reported no action. A no-op output alone does not verify that all required work was completed or that publication was possible.

Agent messages are omitted from this comment. The category uses structured run status, not interpretation of agent prose.

Generated from Test Quality Sentinel · haiku45 · ~6 AIC · ⌖ ~15 AIC · ⊞ 9.4K · ◷

🧪 Test quality analysis by Test Quality Sentinel

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

✅ Ponytail Reviewer completed successfully!

Generated by Ponytail Reviewer for #74559

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

The contract test no longer verifies that the recovery path emits the terminal incomplete signal through the required safeoutputs transport, allowing a broken fallback to pass.

1 open issue
What changed in this PR

Updates the PR Code Quality Reviewer’s Go contract tests to reflect publication guidance extracted into the inline review-publication skill, while preserving workflow sequencing and publication safeguards.

Changes:

  • Scope publication assertions to the extracted skill.
  • Verify specialist completion barriers and delegated publication.
  • Add checks for escaping, recovery, publication closure, and write-once submission.
  • Moderate review note (3 votes): Restore an explicit assertion that the incomplete signal is emitted through the permitted safeoutputs transport, such as | safeoutputs report_incomplete ..
File Description
pkg/​cli/​pr_code_quality_reviewer_workflow_contract_test.go Revises workflow contract tests for the extracted publication skill and updated sequencing safeguards.

Review effort: Lite (auto)

assert.Contains(t, publication, "Do not write temporary payload files, use shell redirection or heredocs")
assert.Contains(t, publication, "Send each safe-output command separately from analysis commands")
assert.Contains(t, publication, "without widening permissions")
assert.Contains(t, publication, "then emit `report_incomplete` with the concrete blocker")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants