Skip to content

fix: report health-check failures instead of skipping them - #58

Draft
binaryaaron wants to merge 1 commit into
mainfrom
fix/health-check-runner
Draft

binaryaaron wants to merge 1 commit into
mainfrom
fix/health-check-runner

Conversation

@binaryaaron

Copy link
Copy Markdown

Invalid model configuration currently looks like missing credentials, and the scheduled health job masks provider failures. Skip only absent credentials; fail on configuration, execution, timeout, or missing-output errors.

Move the existing one-row simulate/eval/report recipe into a small Python runner that reuses CLI configuration and environment helpers. Keep Make as the entry point and report the outcome in the workflow summary.

Validation: 20 focused offline tests passed; changed-file Ruff lint and formatting, Make dry-run, and whitespace checks passed. No live provider calls were made.

Standalone replacement for the health-check portion of #46, based directly on main. Draft for review; hold CI changes until after the 0.2.0 release freeze.

Signed-off-by: Aaron Gonzales <aagonzales@nvidia.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant