Repository navigation
fix(inference): widened offers get bids; ETAs survive restarts; bridge benches failing workers (v0.3.73) - #371
Merged
Merged
Conversation
ThreatCrush Security Scan14 finding(s) HIGH/CRITICAL: 2 | MEDIUM: 8 | LOW: 4
Snippets are redacted; ThreatCrush never prints matched credential material. |
Live on 0.3.71 every widened plain-text offer got 0 bids and the bridge fell back to the exact model each time. dispatch::live_tags rebuilds the inference tags per offer from the runtime's model list (the boot snapshot predates it) and only re-added the role and model tags, never infernet:inference:accept. It now adds the accept tag whenever models are served. inference::worker_load() also skipped runner::with_history, so every update reset each node's ETA to the 60 s placeholder and the bench score alone picked winners (a node that cannot fetch e2e specs then won and failed, costing each job a ~50 s re-award). Job times now persist like every other workload's. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The jobs bridge, which runs every infernet.inference auction, never used the penalty box (only the speech gateway and text training did), so a node that cannot take jobs kept winning: sergey-234 won 20 and failed 15 in 24 h, each failure costing the caller a ~50 s re-award. AuctionOutcome now lists failed_workers (re-awarded past for a failed or missing receipt). The bridge strikes them in a persistent PenaltyBox (jobs-bridge-penalties.json: 30 min, doubling to 6 h), passes benched workers as fallback-only bidders (they still win when nobody else bids), and clears a worker that delivers. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
v0.3.72 went out with #372 while this PR was in CI. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
sh1pt-actions-fleet
Bot
force-pushed
the
fix/inference-accept-tag-live
branch
from
November 15, 2026 00:58
ae8f700 to
6670285
Compare
Merged
ralyodio
added a commit
that referenced
this pull request
Nov 15, 2026
Ships #371 (inference: widened offers get bids, ETAs survive restarts, the jobs bridge benches failing workers) and #374 (node contact email, message any node with `c0mpute dm send <node>`, `dm read`, TUI inbox), merged after the v0.3.73 tag (#376). Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
ralyodio
added a commit
that referenced
this pull request
Nov 15, 2026
…380) * test(hosting_market_e2e): give convergence CI headroom (90 s -> 240 s) preferred_hosts_hold_pass_challenges_and_get_paid failed on most master runs on 2026-11-15 (and on #371/#379): the first three copies land within seconds, but one host's 5 MiB fetch fails and retries ("chunks still missing"), the second preferred copy arrives ~60 s in, and the extra copies still need their trim grace, which ran past the 90 s wait on loaded runners. The test still requires both preferred hosts and exactly three stable copies; only the time allowed grows (agreement window 60 s -> 120 s too). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * ci(rust): retry failed tests once by exact name Multi-node loopback E2Es time out now and then on loaded runners; on 2026-11-15 hosting_market_e2e, hosting_e2e, git_e2e and a private-objects replication test failed across most PRs and on master. The Test step now runs with --no-fail-fast, and only if it fails reruns each failed test once by exact name; a test that fails twice still fails the job. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Follow-up to #370, from watching v0.3.71 live on the dev2 bridge.
dispatch::live_tagsrebuilds the inference tags from the runtime's model list on every offer and re-added only the role and model tags, neverinfernet:inference:accept. It now adds the accept tag whenever models are served; test extended.inference::worker_load()skippedrunner::with_history. Job times now persist like every other workload's.…mgsu3m6q) won 20 inference jobs in 24 h and failed 15: the bridge can't connect to it directly, and it reportsFailedabout 45 s after accepting. Each failure cost the caller a re-award of about 50 s.AuctionOutcome.failed_workersnow lists workers re-awarded past. The bridge strikes them in a persistent penalty box (jobs-bridge-penalties.json: 30 min, doubling to 6 h), keeps benched workers as fallback-only bidders, and clears a worker that delivers.🤖 Generated with Claude Code