Repository navigation
Add verified 1.0.0 benchmark history and advisory same-run comparisons - #51
Merged
Merged
Conversation
dombrovsky
marked this pull request as ready for review
October 18, 2026 06:36
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Implements #45 first, then #44, starting from PR #50's exact
7e3410545c4cdf38602f2cdd01b2e9e67d9bad51. This stacked PR targetsbenchmarks-1.0.0; merge #50 first, then retarget this PR tomain. It does not use PR #47. Production trees, root build configuration, and all common C# harness/project/configuration files remain unchanged from #50.Behavior
Benchmark historyexplicitly selects the release-based checkout for TaskFlow 1.0.0, verifies library/annotations/build/signing identities against0800af84229d7beb3a6fa507d236d0ff533b0c92, and measures all 16 stable cases with SDK 10.0.100 / runtime 10.0.0 / BDN 0.15.8, three warmups and eight actual iterations. Main and exact release selections, weekly scheduling, provenance, raw JSON and readable summaries are supported. Dry/incomplete results are rejected.benchmark-data. Non-force push plus fetch/reapply retry preserves concurrent writers and reruns. Release records have no automatic expiry. Generated results never enter source branches. Read-only PR measurement jobs cannot publish.workflow_run; data-branch pushes do not loop. The chart/table page separates incompatible configurations and exposes time, throughput, valid allocations, variability, release labels, provenance and raw evidence links.Benchmark comparisonsupports release and PR merge-base selection. It executes identical compatible harnesses sequentially on the same runner with independent build/raw directories and matched settings. Summaries include both metrics, absolute/percentage changes, uncertainty, unsupported/missing data and infrastructure failures. Performance changes are advisory; failures of infrastructure remain visible. The representative subset and full common suite are available.Measured evidence and validation
measured-historyartifact and workflow summary. Its publication job correctly skipped the untrusted PR context.1.0.0-rc2exclusion jobs all succeeded. Summaries and separate downloadable artifacts contain the reports. The actual PR merge-base mode also passed in this run.SpinWait(5000)comparison: approximately 110–328x slower means; three material slowdown labels and the noisiest case insufficient evidence. The exact uncommitted synthetic diff is in provenance; it is removed with its disposable worktree and rejected by history publication. No production change is committed.0e597547a98ec96b5e027ea7079e3876cb149432vs release: 11 paired measured cases, identical harness/environment identity; all five middleware cases explicitly omitted from both sides.1.0.0-rc2has an incompatible Enqueue API and is explicitly unsupported rather than silently adapted.IMPORTSerrors inTaskSchedulerBaseFixture.Scheduling.csandLoggingTaskSchedulerExtensions.cs. No production formatting changes are included. Existing .NET 10 tests: 268 passed / one timing-sensitive core failure; its focused retry passed all three applicable fixtures. Existing .NET 8 core tests: 238 passed / 11 cancellation/timing failures. These occur in unchanged production/test source; no production fixes are included in this benchmark PR.Required activation — live publication is not complete
The real 1.0.0 baseline is captured in Actions evidence, not yet durably published or deployed.
maindoes not contain these new workflows. Do not close #45's live-publication acceptance on the strength of a PR artifact or local preview.main, review and merge it. No merge is performed by this session.main, dispatch Benchmark history,source=1.0.0. This explicitly measures the release checkout again; running merged main is never substituted for the release.benchmark-data/index.jsonand the immutable release raw tree. Confirm the triggered Documentation deployment succeeds and https://dombrovsky.github.io/TaskFlow/benchmarks/ shows the TaskFlow 1.0.0 series, table and chart with provenance/run/raw links. That URL is the intended live view; it does not yet show this baseline.source=mainfor the trusted current-main history point. Subsequent relevant merges, schedules and release events collect automatically. The manual comparison workflow also activates on the default branch.Use the existing Pages Actions environment and permit the publisher's requested
contents: writeif repository policy restricts it; measurement jobs must remain read-only. Full reproduction, variance, compatibility, storage/retention, retries and activation guidance is inTaskFlow.Benchmarks/README.md.Refs #45 and #44; depends on #50.