Skip to content

fix(llm): Board agent runs never get the offline demo in place of the real model - #277

Merged
hoangsnowy merged 1 commit into
mainfrom
fix/no-offline-demo-in-board-runs
Oct 23, 2026
Merged

hoangsnowy merged 1 commit into
mainfrom
fix/no-offline-demo-in-board-runs

Conversation

@hoangsnowy

Copy link
Copy Markdown
Owner

Summary

  • On the lab (2026-10-23 22:17–23:50 local) the paired computer's Claude plan hit its session limit. FailoverLlmClient fell over to the keyless Offline client every minute (99 times). New idea got the canned "Offline demo specification", and three junk tickets were created on DeltaByteLab/VNChessAcademy (chore(ci): bump azure/login from 2 to 3 in the actions-all group #88–chore(deps): Bump MessagePack from 2.5.301 to 3.1.7 #90, now closed). Reviewer and Testing calls in that window also received canned text.
  • An open LlmCallScope already marks a Board agent run (Discovery, Coding, Reviewer, Testing, the Autopilot lead, Retrospective). LlmClientFactory no longer appends the Offline safety net inside one, so those runs fail with the real reason.
  • New idea now says nothing was created: "The AI couldn't write the spec, so nothing was created — … Try again once it is back."
  • The Workflow demo and standalone path keep the fallback. CONFIG.md and README are updated.

Test plan

  • New LlmClientFactoryLiveSettingsTests.Create_InsideBoardAgentRun_NeverFallsOverToTheOfflineDemo: a provider that throws a plan-limit error still falls over to Offline outside a scope, and throws (recorded as a failed call) inside one.
  • Full Release build with 0 warnings. dotnet test --solution AgentOs.slnx -c Release: 1,558 passed, 0 failed.
  • Lab: after the update, New idea during a plan limit shows the error and creates nothing.

🤖 Generated with Claude Code

https://claude.ai/code/session_018WAdQ7Rm24xss5QDSvXtJB

… real model

On the lab the member's Claude plan hit its session limit; the failover chain fell
over to the Offline client, New idea got its canned "Offline demo specification",
and three junk tickets were created on a real repo. Reviewer / Testing calls in
the same window received canned text too.

An open LlmCallScope already marks a Board agent run (Discovery, Coding, Reviewer,
Testing, the Autopilot lead, Retrospective); the factory no longer appends the
Offline safety net there, so those runs fail with the real reason and New idea
says nothing was created. The Workflow demo / standalone path keeps the fallback.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018WAdQ7Rm24xss5QDSvXtJB
@hoangsnowy
hoangsnowy merged commit 6f00c33 into main Oct 23, 2026
4 checks passed
@hoangsnowy
hoangsnowy deleted the fix/no-offline-demo-in-board-runs branch October 23, 2026 17:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant