Skip to content

docs: note that the CodSpeed app tracks the tested Python versions - #150

Open
fargito wants to merge 1 commit into
masterfrom
cod-3506-runtime-matrix-pointer
Open

fargito wants to merge 1 commit into
masterfrom
cod-3506-runtime-matrix-pointer

Conversation

@fargito

@fargito fargito commented Nov 2, 2026

Copy link
Copy Markdown
Member

CodSpeed keeps its own per-release copy of the Python versions each `pytest-codspeed` release is tested with, to warn on runs outside them. Point to it next to `MIN_SUPPORTED_PYTHON_VERSION` and `MAX_SUPPORTED_PYTHON_VERSION` so a change to the bounds reaches it.

Refs COD-3506

@codspeed

codspeed Bot commented Nov 2, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 4.81%

3 warnings, 1 note

⚠️ 6 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ 3 benchmarks with a significant change ran on different hardware

Their base and head results were measured on machines with a different CPU, core count or memory, so the changes might not come from the code. Run base and head on the same runner type.

Learn more about Macro Runners

See affected benchmarks

⚠️ 12 benchmarks with a significant change ran in a different software environment

Their base and head results were measured with a different OS or toolchain, such as compiler, runtime or library versions, so the changes might come from this difference rather than from the code. Open an affected benchmark to see what changed.

See affected benchmarks

ℹ️ 19 benchmarks have no flamegraph

The flamegraph wasn't generated: the symbols of the profiling trace could not be resolved, because no information about the language frames was collected.

See affected benchmarks

⚡ 6 improved benchmarks
❌ 9 regressed benchmarks
✅ 262 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Walltime test_multiprocessing_map[10000] 60.2 ms 111 ms -45.8%
❌ Memory test_multiprocessing_map[100] 3.2 MB 3.9 MB -18.4%
❌ Memory test_multiprocessing_map[10] 3 MB 3.5 MB -16.29%
❌ Walltime test_tcp_connection[1.1.1.1-53] 823.5 µs 963.9 µs -14.57%
❌ Walltime test_count_even[count_even_fast] 1.1 ms 1.3 ms -13.85%
❌ Walltime test_sum_of_squares[sum_of_squares_sum_comprehension_power] 221.8 µs 246.4 µs -10.02%
❌ Walltime test_sum_of_squares[sum_of_squares_sum_labmda_product] 279.5 µs 303.5 µs -7.92%
❌ Walltime test_pipe_communication[100] 5.9 ms 6.3 ms -6.89%
❌ Walltime test_noop_pass_decorated 692.6 ns 732.5 ns -5.44%
⚡ Walltime test_multiprocessing_map[100000] 370.5 ms 253 ms +46.47%
⚡ Memory test_multiprocessing_map[1000] 3.4 MB 2.8 MB +20.02%
⚡ Memory test_multiprocessing_map[10000] 3.6 MB 3.2 MB +11.38%
⚡ Walltime test_hamilton_cycle[graph0] 27.8 µs 25.5 µs +9.01%
⚡ Walltime test_sudoku[initial_grid0] 8.3 µs 7.8 µs +6.33%
⚡ Walltime test_multiprocessing_map[100] 54.2 ms 51.2 ms +5.82%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing cod-3506-runtime-matrix-pointer (05099d6) with master (7d20221)

Open in CodSpeed

@fargito
fargito requested a review from not-matthias November 5, 2026 19:36
@fargito
fargito marked this pull request as ready for review November 5, 2026 19:37
@greptile-apps

greptile-apps Bot commented Nov 5, 2026 •

Copy link
Copy Markdown

RetriggerView in GreptileConfidence Score: 5/5

[Low impact] This comment-only change appears safe to merge.

Summary

Adds a reminder beside MIN_SUPPORTED_PYTHON_VERSION and MAX_SUPPORTED_PYTHON_VERSION to notify the team when the bounds change, since the CodSpeed app tracks tested Python versions per release.

  • The Python version note now includes the CodSpeed app.

Reviews (1) · Last reviewed commit: "docs: note that the CodSpeed app tracks ..." · Reviewed by Greptile

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant