Skip to content

docs(matrix): record the #2487 live scenarios on Claude Code - #2503

Merged
bradygaster merged 2 commits into
devfrom
squad/claude-live-evidence
Nov 14, 2026
Merged

bradygaster merged 2 commits into
devfrom
squad/claude-live-evidence

Conversation

@bradygaster

Copy link
Copy Markdown
Collaborator

This records the #2487 live scenario evidence in the host feature matrix. All runs used Claude Code 2.1.318 and claude -p --agent squad, with .github/agents/squad.agent.md deleted.

Scenario Date Result Backs
Routing 11-12 pass routing-ownership
Human sign-off (#2491) 11-13 pass human-members (now validated-live)
Monorepo subfolder (#2490) 11-13 pass monorepo-team-root
Reviewer rejection 11-13 pass reviewer-lockout
Restart continuity 11-13 pass scribe-decisions-history
Customization precedence 11-13 pass scribe-decisions-history
Backend outage (#2495) 11-13 pass squad-state-mcp-bridge
First run, trusted folder (#2496) 11-13 partial: writing routing.md is denied headless by design init-mode-casting
Backend isolation, orphan (#2502) 11-13 pass state-backends
Compaction recovery 11-13 pass scribe-decisions-history

Azure DevOps stays deferred. The page is regenerated, and test/squad-20-host-feature-matrix.test.ts passes.

🤖 Generated with Claude Code

Ten live runs with Copilot's coordinator file deleted, linked from the cells
they back. Human members is now validated-live on Claude.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Copilot AI dynamic review requested due to automatic review settings November 14, 2026 04:38
@github-actions

Copy link
Copy Markdown
Contributor

🟡 Impact Analysis — PR #2503

Risk tier: 🟡 MEDIUM

📊 Summary

Metric Count
Files changed 2
Files added 0
Files modified 2
Files deleted 0
Modules touched 2

🎯 Risk Factors

  • 2 files changed (≤5 → LOW)
  • 2 modules touched (2-4 → MEDIUM)

📦 Modules Affected

docs (1 file)
  • docs/src/content/docs/reference/host-feature-matrix.md
root (1 file)
  • test-fixtures/spec/suite-v0.2/host-feature-matrix.json

This report is generated automatically for every PR. See #733 for details.

@github-actions

github-actions Bot commented Nov 14, 2026 •

Copy link
Copy Markdown
Contributor

🛫 PR Readiness Check

ℹ️ This comment updates on each push. Last checked: commit 0448c64

PR Scope: 🔧 Infrastructure

⚠️ 3 item(s) to address before review

Status Check Details
❌ Single commit 2 commits — consider squashing before review
✅ Not in draft Ready for review
✅ Branch up to date Up to date with dev
❌ Copilot review No Copilot review yet — it may still be processing
✅ Changeset present No source files changed — changeset not required
✅ Scope clean No .squad/ or docs/proposals/ files
✅ No merge conflicts No merge conflicts
❌ Copilot threads resolved 2 unresolved Copilot thread(s) — fix and resolve before merging
✅ CI passing All checks passing

Files Changed (2 files, +141 −19)

File +/−
docs/src/content/docs/reference/host-feature-matrix.md +20 −10
test-fixtures/spec/suite-v0.2/host-feature-matrix.json +121 −9

Total: +141 −19


This check runs automatically on every push. Fix any ❌ items and push again.
See CONTRIBUTING.md and PR Requirements for details.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

Two active findings remain because the newly recorded /compact and resume scenario is labeled as headless live evidence without documenting the actual invocation or removing the interactive claim.

2 open issues
What changed in this PR

This PR records Claude Code live-scenario evidence for issue #2487 in the host feature matrix and regenerates the reference documentation. The compaction scenario’s interactive /compact and resume flow should be reconciled with the documented headless invocation, and the matrix evidence metadata should remain consistent with the recorded runs.

Changes:

  • Adds ten Claude Code scenario records covering routing, sign-off, monorepo resolution, reviewer rejection, recovery, backend behavior, initialization, isolation, customization precedence, and compaction.
  • Promotes Claude’s human-sign-off capability to live-validated status and updates validation counts.
  • Regenerates the host feature matrix documentation and live-run log.
File Description
test-fixtures/​spec/​suite-v0.2/​host-feature-matrix.json Adds Claude Code live-run evidence, updates human-sign-off validation metadata and counts, and records scenario metadata.
docs/​src/​content/​docs/​reference/​host-feature-matrix.md Regenerated documentation reflecting the updated Claude validation status, feature evidence, and live-run entries.

Review effort: Lite (dynamic)

| 2026-11-13 | `claude` | no-copilot-backend-outage | ✅ pass | `mcp__squad_state__squad_state_health` | Bridge down with stateBackend two-layer: stopped after 2 turns, named the backend, pointed to `squad doctor`, wrote nothing (#2495). Claude Code 2.1.318, `claude -p --agent squad`, Copilot's `.github/agents/squad.agent.md` deleted (#2487). |
| 2026-11-13 | `claude` | no-copilot-first-run-trusted | ⚠️ partial | `Bash`, `mcp__squad_state__squad_state_read` | Trusted folder: `squad cast` x3, `squad client sync` and squad_state ran without prompts (#2496). Writing routing.md is not allowlisted, so headless runs deny it by design; the coordinator stopped and named what it needed. Claude Code 2.1.318, `claude -p --agent squad`, Copilot's `.github/agents/squad.agent.md` deleted (#2487). |
| 2026-11-13 | `claude` | no-copilot-backend-isolation | ✅ pass | `mcp__squad_state__squad_state_health`, `mcp__squad_state__squad_decide` | Orphan backend (`squad upgrade --state-backend orphan`): decisions landed only on the squad-state branch, no working-tree files, no commit on main, 0 denials; the coordinator names the branch as the location (#2502). Model claude-opus-4-6[1m]. Claude Code 2.1.318, `claude -p --agent squad`, Copilot's `.github/agents/squad.agent.md` deleted (#2487). |
| 2026-11-13 | `claude` | no-copilot-compaction | ✅ pass | — | Work session (Dallas edit + commit, Ripley review, Scribe merge, one decision), then `/compact`, then resumed with "make sure everything is finished": no second commit, spawn or decision entry, and no invented approvals. It answered from the compacted summary without re-reading state. Model claude-opus-4-6[1m]. Claude Code 2.1.318, `claude -p --agent squad`, Copilot's `.github/agents/squad.agent.md` deleted (#2487). |
"date": "2026-11-13",
"outcome": "pass",
"observedTools": [],
"notes": "Work session (Dallas edit + commit, Ripley review, Scribe merge, one decision), then `/compact`, then resumed with \"make sure everything is finished\": no second commit, spawn or decision entry, and no invented approvals. It answered from the compacted summary without re-reading state. Model claude-opus-4-6[1m]. Claude Code 2.1.318, `claude -p --agent squad`, Copilot's `.github/agents/squad.agent.md` deleted (#2487)."
@bradygaster
bradygaster merged commit df9982a into dev Nov 14, 2026
29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants