Skip to content

Attach RowFn validity during Boolean output construction - #10674

Open
connortsui20 wants to merge 1 commit into
developfrom
ct/row-fn-cleanup/output-validity
Open

connortsui20 wants to merge 1 commit into
developfrom
ct/row-fn-cleanup/output-validity

Conversation

@connortsui20

@connortsui20 connortsui20 commented Oct 21, 2026 •

Copy link
Copy Markdown
Member

Summary

Extracts output finalization from #9979. Packed Boolean collectors can construct the result with its input validity attached, avoiding a second array construction.

Targets develop and can merge independently of the borrowed-decoding and batch-inspection changes.

Changes

The validity handoff stays private to the executor. Other canonical outputs receive validity directly, while custom kernel outputs retain validation before masking can hide an invalid result. Existing allocator cases are retained, and new cases cover attached Boolean validity and canonical batch output.

The Vortex test suite was not run locally. Focused native measurements of the combined migration were run separately during the compiler investigation.

@connortsui20
connortsui20 added this pull request to stack #10677 October 21, 2026 15:10
@codspeed

codspeed Bot commented Oct 21, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 11.12%

3 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 8 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ Base and head ran on different runner types

Some benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.

Learn more about Macro Runners

Open the report in CodSpeed to investigate

⚡ 3 improved benchmarks
❌ 5 regressed benchmarks
✅ 332 untouched benchmarks
⏩ 2080 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Walltime mul_u64_nonnull_neon 20.6 µs 39.9 µs -48.42%
❌ Walltime filter_neon[8] 893 ns 1,162 ns -23.15%
❌ Walltime filter_neon[64] 1.7 µs 2 µs -12.03%
❌ Walltime bitpack_blocked_compress_avx2 6.7 µs 7.6 µs -11.62%
❌ CPU Simulation test_scan_filter[int] 3.1 ms 3.4 ms -10.94%
⚡ Walltime bitpack_blocked_compress_avx512 5.6 µs 4.9 µs +15.2%
⚡ Walltime add_constant_shapes_neon[(32768, PerRowNullableConstant)] 16.7 µs 15 µs +11.2%
⚡ Walltime add_constant_shapes_neon[(32768, PerRowConstant)] 15.9 µs 14.4 µs +10.81%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ct/row-fn-cleanup/output-validity (cfbd513) with develop (d270200)

Open in CodSpeed

Footnotes

  1. 2080 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@connortsui20
connortsui20 force-pushed the ct/row-fn-cleanup/batch-inputs branch from 5541df9 to abc8689 Compare October 22, 2026 14:09
@connortsui20
connortsui20 force-pushed the ct/row-fn-cleanup/output-validity branch from 14c6b46 to 263d116 Compare October 22, 2026 14:09
@connortsui20
connortsui20 removed this pull request from stack #10677 October 22, 2026 14:10
@connortsui20
connortsui20 changed the base branch from ct/row-fn-cleanup/batch-inputs to develop October 22, 2026 14:10
Let the packed Boolean collectors consume the batch validity when constructing their result. Keep custom output validation before masking and attach validity directly to other canonical outputs.

Extracted from #9979.

Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
connortsui20 marked this pull request as ready for review October 23, 2026 00:43
@connortsui20
connortsui20 force-pushed the ct/row-fn-cleanup/output-validity branch from 263d116 to cfbd513 Compare October 23, 2026 00:43
@connortsui20 connortsui20 added action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-spatial Run only SpatialBench SQL benchmarks on this PR labels Oct 23, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 23, 2026
@github-actions

github-actions Bot commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done cfbd513 clickbench-nvme 1 Explore Profiling Data
🟢 Done cfbd513 polarsignals 1 Explore Profiling Data
🟢 Done cfbd513 tpch-nvme-10 1 Explore Profiling Data
🟢 Done cfbd513 fineweb 1 Explore Profiling Data
🟢 Done cfbd513 tpch-s3 1 Explore Profiling Data
🟢 Done cfbd513 tpcds-nvme 1 Explore Profiling Data
🟢 Done cfbd513 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR cfbd5133 vs base d270200d
Vortex (geomean): hot 0.998x ➖ · cold 0.945x ➖


datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44818957 / 44744811 / +0.2% 86986036 / 92053975 / -5.5% 0.52 / 0.49 / +6.0%
polarsignals_q01/datafusion:vortex-file-compressed 51172676 / 50471093 / +1.4% 109014667 / 115244299 / -5.4% 0.47 / 0.44 / +7.2%
polarsignals_q02/datafusion:vortex-file-compressed 43574777 / 43477550 / +0.2% 83018192 / 84517206 / -1.8% 0.52 / 0.51 / +2.0%
polarsignals_q03/datafusion:vortex-file-compressed 54627956 / 53196134 / +2.7% 111797581 / 117408277 / -4.8% 0.49 / 0.45 / +7.8%
polarsignals_q04/datafusion:vortex-file-compressed 9244284 / 9321116 / -0.8% 44514764 / 46961493 / -5.2% 0.21 / 0.20 / +4.6%
polarsignals_q05/datafusion:vortex-file-compressed 11869534 / 11993730 / -1.0% 47533083 / 52087625 / -8.7% 0.25 / 0.23 / +8.4%
polarsignals_q06/datafusion:vortex-file-compressed 23001250 / 23454714 / -1.9% 61321598 / 65673288 / -6.6% 0.38 / 0.36 / +5.0%
polarsignals_q07/datafusion:vortex-file-compressed 11013732 / 11219796 / -1.8% 47763450 / 52109937 / -8.3% 0.23 / 0.22 / +7.1%
polarsignals_q08/datafusion:vortex-file-compressed 97928680 / 98392024 / -0.5% 158687587 / 163447155 / -2.9% 0.62 / 0.60 / +2.5%
polarsignals_q09/datafusion:vortex-file-compressed 9935210 / 9927289 / +0.1% 45188829 / 47845722 / -5.6% 0.22 / 0.21 / +6.0%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR cfbd5133 vs base d270200d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Engines: DataFusion No clear signal (+3.5%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 1.017x ➖ · cold 0.982x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.015x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.024x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7062478 / 6986400 / +1.1% 18581454 / 18050622 / +2.9% 0.38 / 0.39 / -1.8%
fineweb_q01/datafusion:vortex-file-compressed 8312497 / 7275371 / +14.3% 🔴 41616022 / 44008989 / -5.4% 0.20 / 0.17 / +20.8%
fineweb_q02/datafusion:vortex-file-compressed 10276866 / 9643182 / +6.6% 49451427 / 51623419 / -4.2% 0.21 / 0.19 / +11.3%
fineweb_q03/datafusion:vortex-file-compressed 19758052 / 20239974 / -2.4% 107893672 / 113788461 / -5.2% 0.18 / 0.18 / +3.0%
fineweb_q04/datafusion:vortex-file-compressed 66490208 / 67301001 / -1.2% 158432505 / 159615326 / -0.7% 0.42 / 0.42 / -0.5%
fineweb_q05/datafusion:vortex-file-compressed 66705742 / 66250654 / +0.7% 152402576 / 152308326 / +0.1% 0.44 / 0.43 / +0.6%
fineweb_q06/datafusion:vortex-file-compressed 19499076 / 19394815 / +0.5% 114988048 / 113713476 / +1.1% 0.17 / 0.17 / -0.6%
fineweb_q07/datafusion:vortex-file-compressed 17685082 / 17205394 / +2.8% 108583969 / 108328681 / +0.2% 0.16 / 0.16 / +2.5%
fineweb_q08/datafusion:vortex-file-compressed 9218350 / 9192522 / +0.3% 51625866 / 53868375 / -4.2% 0.18 / 0.17 / +4.6%
datafusion / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9715606 / 9599664 / +1.2% 32316612 / 30957398 / +4.4% 0.30 / 0.31 / -3.0%
fineweb_q01/datafusion:parquet 74315824 / 76818224 / -3.3% 160715182 / 156716863 / +2.6% 0.46 / 0.49 / -5.7%
fineweb_q02/datafusion:parquet 74639795 / 75857119 / -1.6% 162894723 / 157029308 / +3.7% 0.46 / 0.48 / -5.1%
fineweb_q03/datafusion:parquet 73483937 / 74763248 / -1.7% 155709239 / 155066913 / +0.4% 0.47 / 0.48 / -2.1%
fineweb_q04/datafusion:parquet 82308822 / 82126054 / +0.2% 156191141 / 155280968 / +0.6% 0.53 / 0.53 / -0.4%
fineweb_q05/datafusion:parquet 80832598 / 80871888 / -0.0% 160668153 / 159896464 / +0.5% 0.50 / 0.51 / -0.5%
fineweb_q06/datafusion:parquet 74851154 / 76115157 / -1.7% 163482930 / 154647418 / +5.7% 0.46 / 0.49 / -7.0%
fineweb_q07/datafusion:parquet 72820024 / 75486456 / -3.5% 155516046 / 154294677 / +0.8% 0.47 / 0.49 / -4.3%
fineweb_q08/datafusion:parquet 73535910 / 72714976 / +1.1% 156647384 / 154494638 / +1.4% 0.47 / 0.47 / -0.3%
duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2450613 / 2442904 / +0.3% 8171972 / 7646728 / +6.9% 0.30 / 0.32 / -6.1%
fineweb_q01/duckdb:vortex-file-compressed 9518859 / 9633722 / -1.2% 36664750 / 36742609 / -0.2% 0.26 / 0.26 / -1.0%
fineweb_q02/duckdb:vortex-file-compressed 11415337 / 10759263 / +6.1% 37113382 / 37502538 / -1.0% 0.31 / 0.29 / +7.2%
fineweb_q03/duckdb:vortex-file-compressed 19558892 / 19525922 / +0.2% 101181174 / 108469343 / -6.7% 0.19 / 0.18 / +7.4%
fineweb_q04/duckdb:vortex-file-compressed 68601470 / 66771893 / +2.7% 123102208 / 121769522 / +1.1% 0.56 / 0.55 / +1.6%
fineweb_q05/duckdb:vortex-file-compressed 66660074 / 66827687 / -0.3% 118407158 / 118962195 / -0.5% 0.56 / 0.56 / +0.2%
fineweb_q06/duckdb:vortex-file-compressed 19023062 / 18863626 / +0.8% 110093446 / 110992318 / -0.8% 0.17 / 0.17 / +1.7%
fineweb_q07/duckdb:vortex-file-compressed 18369184 / 18856960 / -2.6% 104940486 / 109803242 / -4.4% 0.18 / 0.17 / +1.9%
fineweb_q08/duckdb:vortex-file-compressed 5679575 / 5512714 / +3.0% 14243963 / 15736650 / -9.5% 0.40 / 0.35 / +13.8%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 27401534 / 27556044 / -0.6% 29985184 / 29626087 / +1.2% 0.91 / 0.93 / -1.8%
fineweb_q01/duckdb:parquet 60179901 / 59969350 / +0.4% 86279761 / 82803940 / +4.2% 0.70 / 0.72 / -3.7%
fineweb_q02/duckdb:parquet 63502120 / 64344502 / -1.3% 83963680 / 83294170 / +0.8% 0.76 / 0.77 / -2.1%
fineweb_q03/duckdb:parquet 129191462 / 127188536 / +1.6% 194717280 / 189037997 / +3.0% 0.66 / 0.67 / -1.4%
fineweb_q04/duckdb:parquet 182524098 / 181173968 / +0.7% 233041088 / 228337627 / +2.1% 0.78 / 0.79 / -1.3%
fineweb_q05/duckdb:parquet 174878134 / 177437846 / -1.4% 216668997 / 222997388 / -2.8% 0.81 / 0.80 / +1.4%
fineweb_q06/duckdb:parquet 95297242 / 94799788 / +0.5% 156363651 / 158066465 / -1.1% 0.61 / 0.60 / +1.6%
fineweb_q07/duckdb:parquet 99146556 / 95855718 / +3.4% 159023361 / 156182174 / +1.8% 0.62 / 0.61 / +1.6%
fineweb_q08/duckdb:parquet 33014234 / 33243135 / -0.7% 32992191 / 33871389 / -2.6% 1.00 / 0.98 / +2.0%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR cfbd5133 vs base d270200d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.036x ➖
Parquet (geomean): hot 0.993x ➖ · cold 1.013x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 14762543 / 14720854 / +0.3% 45764999 / 41884161 / +9.3% 0.32 / 0.35 / -8.2%
tpch_q02/datafusion:vortex-file-compressed 17172126 / 17131901 / +0.2% 39800167 / 34345564 / +15.9% 🔴 0.43 / 0.50 / -13.5%
tpch_q03/datafusion:vortex-file-compressed 18338553 / 18472161 / -0.7% 52839835 / 45809517 / +15.3% 🔴 0.35 / 0.40 / -13.9%
tpch_q04/datafusion:vortex-file-compressed 9934188 / 9896271 / +0.4% 35192079 / 32372925 / +8.7% 0.28 / 0.31 / -7.7%
tpch_q05/datafusion:vortex-file-compressed 36235943 / 36519125 / -0.8% 71531867 / 66240622 / +8.0% 0.51 / 0.55 / -8.1%
tpch_q06/datafusion:vortex-file-compressed 5953760 / 6074928 / -2.0% 32279815 / 28713673 / +12.4% 🔴 0.18 / 0.21 / -12.8%
tpch_q07/datafusion:vortex-file-compressed 51344628 / 51076790 / +0.5% 84693947 / 75336868 / +12.4% 🔴 0.61 / 0.68 / -10.6%
tpch_q08/datafusion:vortex-file-compressed 51665102 / 51570499 / +0.2% 80158185 / 82191556 / -2.5% 0.64 / 0.63 / +2.7%
tpch_q09/datafusion:vortex-file-compressed 48788154 / 49400561 / -1.2% 83041629 / 75863633 / +9.5% 0.59 / 0.65 / -9.8%
tpch_q10/datafusion:vortex-file-compressed 16808198 / 16896704 / -0.5% 56324761 / 51372094 / +9.6% 0.30 / 0.33 / -9.3%
tpch_q11/datafusion:vortex-file-compressed 14933517 / 14750158 / +1.2% 35534984 / 35398537 / +0.4% 0.42 / 0.42 / +0.9%
tpch_q12/datafusion:vortex-file-compressed 22567771 / 22912314 / -1.5% 48359399 / 47321091 / +2.2% 0.47 / 0.48 / -3.6%
tpch_q13/datafusion:vortex-file-compressed 19103546 / 19466228 / -1.9% 43652471 / 39324900 / +11.0% 🔴 0.44 / 0.50 / -11.6%
tpch_q14/datafusion:vortex-file-compressed 14570289 / 14689874 / -0.8% 45076065 / 40788319 / +10.5% 🔴 0.32 / 0.36 / -10.2%
tpch_q15/datafusion:vortex-file-compressed 18080930 / 18118386 / -0.2% 46040744 / 44596704 / +3.2% 0.39 / 0.41 / -3.3%
tpch_q16/datafusion:vortex-file-compressed 18229502 / 18138361 / +0.5% 40968814 / 40166329 / +2.0% 0.44 / 0.45 / -1.5%
tpch_q17/datafusion:vortex-file-compressed 27728697 / 28001192 / -1.0% 63790146 / 59632905 / +7.0% 0.43 / 0.47 / -7.4%
tpch_q18/datafusion:vortex-file-compressed 36416655 / 36936377 / -1.4% 61038741 / 58978664 / +3.5% 0.60 / 0.63 / -4.7%
tpch_q19/datafusion:vortex-file-compressed 14614706 / 14291435 / +2.3% 47592387 / 40784922 / +16.7% 🔴 0.31 / 0.35 / -12.4%
tpch_q20/datafusion:vortex-file-compressed 19995783 / 20243490 / -1.2% 45525942 / 43790825 / +4.0% 0.44 / 0.46 / -5.0%
tpch_q21/datafusion:vortex-file-compressed 38232913 / 38110461 / +0.3% 68500461 / 68913363 / -0.6% 0.56 / 0.55 / +0.9%
tpch_q22/datafusion:vortex-file-compressed 11821448 / 12080060 / -2.1% 36895432 / 33637108 / +9.7% 0.32 / 0.36 / -10.8%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 19047092 / 18979678 / +0.4% 47687202 / 46466290 / +2.6% 0.40 / 0.41 / -2.2%
tpch_q02/datafusion:parquet 49548976 / 49113246 / +0.9% 78114728 / 72867456 / +7.2% 0.63 / 0.67 / -5.9%
tpch_q03/datafusion:parquet 40689926 / 40374587 / +0.8% 72749773 / 71699536 / +1.5% 0.56 / 0.56 / -0.7%
tpch_q04/datafusion:parquet 17761929 / 17474402 / +1.6% 47053759 / 44134939 / +6.6% 0.38 / 0.40 / -4.7%
tpch_q05/datafusion:parquet 70699554 / 71101517 / -0.6% 99936825 / 103632011 / -3.6% 0.71 / 0.69 / +3.1%
tpch_q06/datafusion:parquet 10594296 / 10608224 / -0.1% 37848795 / 38165146 / -0.8% 0.28 / 0.28 / +0.7%
tpch_q07/datafusion:parquet 78277555 / 78299226 / -0.0% 114551640 / 116471073 / -1.6% 0.68 / 0.67 / +1.6%
tpch_q08/datafusion:parquet 88893207 / 88241962 / +0.7% 127830397 / 126235819 / +1.3% 0.70 / 0.70 / -0.5%
tpch_q09/datafusion:parquet 76357437 / 76151155 / +0.3% 111444011 / 111102344 / +0.3% 0.69 / 0.69 / -0.0%
tpch_q10/datafusion:parquet 31170328 / 31350921 / -0.6% 62142664 / 64388130 / -3.5% 0.50 / 0.49 / +3.0%
tpch_q11/datafusion:parquet 38102658 / 38207328 / -0.3% 67045212 / 66142810 / +1.4% 0.57 / 0.58 / -1.6%
tpch_q12/datafusion:parquet 28186536 / 28522974 / -1.2% 55603917 / 50770003 / +9.5% 0.51 / 0.56 / -9.8%
tpch_q13/datafusion:parquet 28790430 / 28232193 / +2.0% 47959480 / 45921643 / +4.4% 0.60 / 0.61 / -2.4%
tpch_q14/datafusion:parquet 23889058 / 24046851 / -0.7% 56503183 / 52011538 / +8.6% 0.42 / 0.46 / -8.6%
tpch_q15/datafusion:parquet 38070693 / 38529679 / -1.2% 69621026 / 69418084 / +0.3% 0.55 / 0.56 / -1.5%
tpch_q16/datafusion:parquet 28689579 / 29243026 / -1.9% 52734782 / 52364465 / +0.7% 0.54 / 0.56 / -2.6%
tpch_q17/datafusion:parquet 43994174 / 44965518 / -2.2% 80457750 / 80309945 / +0.2% 0.55 / 0.56 / -2.3%
tpch_q18/datafusion:parquet 43982303 / 44371168 / -0.9% 71789283 / 69969103 / +2.6% 0.61 / 0.63 / -3.4%
tpch_q19/datafusion:parquet 20629809 / 20879857 / -1.2% 55384620 / 54408507 / +1.8% 0.37 / 0.38 / -2.9%
tpch_q20/datafusion:parquet 54697058 / 54984009 / -0.5% 94151818 / 91226550 / +3.2% 0.58 / 0.60 / -3.6%
tpch_q21/datafusion:parquet 78078279 / 78129180 / -0.1% 115432008 / 113306674 / +1.9% 0.68 / 0.69 / -1.9%
tpch_q22/datafusion:parquet 21644641 / 21333552 / +1.5% 47532351 / 45089881 / +5.4% 0.46 / 0.47 / -3.8%
duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9815507 / 10165497 / -3.4% 20784459 / 21473581 / -3.2% 0.47 / 0.47 / -0.2%
tpch_q02/duckdb:vortex-file-compressed 16199793 / 16113460 / +0.5% 26973930 / 25106850 / +7.4% 0.60 / 0.64 / -6.4%
tpch_q03/duckdb:vortex-file-compressed 19557624 / 20059592 / -2.5% 35794895 / 35899844 / -0.3% 0.55 / 0.56 / -2.2%
tpch_q04/duckdb:vortex-file-compressed 13234710 / 12779915 / +3.6% 28318069 / 26741110 / +5.9% 0.47 / 0.48 / -2.2%
tpch_q05/duckdb:vortex-file-compressed 20945290 / 21423519 / -2.2% 34600753 / 35849194 / -3.5% 0.61 / 0.60 / +1.3%
tpch_q06/duckdb:vortex-file-compressed 5925200 / 5896514 / +0.5% 16278458 / 16807799 / -3.1% 0.36 / 0.35 / +3.8%
tpch_q07/duckdb:vortex-file-compressed 25395279 / 25447196 / -0.2% 43657648 / 42368487 / +3.0% 0.58 / 0.60 / -3.2%
tpch_q08/duckdb:vortex-file-compressed 21790244 / 22117523 / -1.5% 39439098 / 39790606 / -0.9% 0.55 / 0.56 / -0.6%
tpch_q09/duckdb:vortex-file-compressed 22858059 / 23163908 / -1.3% 41586537 / 41581702 / +0.0% 0.55 / 0.56 / -1.3%
tpch_q10/duckdb:vortex-file-compressed 24067068 / 23789035 / +1.2% 41493595 / 40511577 / +2.4% 0.58 / 0.59 / -1.2%
tpch_q11/duckdb:vortex-file-compressed 8354802 / 8290155 / +0.8% 16336702 / 17164096 / -4.8% 0.51 / 0.48 / +5.9%
tpch_q12/duckdb:vortex-file-compressed 16647753 / 16773208 / -0.7% 31962210 / 31403584 / +1.8% 0.52 / 0.53 / -2.5%
tpch_q13/duckdb:vortex-file-compressed 21129935 / 21495771 / -1.7% 34365639 / 35333166 / -2.7% 0.61 / 0.61 / +1.1%
tpch_q14/duckdb:vortex-file-compressed 12553123 / 12263698 / +2.4% 25771142 / 24737589 / +4.2% 0.49 / 0.50 / -1.7%
tpch_q15/duckdb:vortex-file-compressed 9353104 / 9444418 / -1.0% 20615553 / 20880313 / -1.3% 0.45 / 0.45 / +0.3%
tpch_q16/duckdb:vortex-file-compressed 19154865 / 18931823 / +1.2% 25791677 / 25617861 / +0.7% 0.74 / 0.74 / +0.5%
tpch_q17/duckdb:vortex-file-compressed 14175985 / 14515698 / -2.3% 28438171 / 29744254 / -4.4% 0.50 / 0.49 / +2.1%
tpch_q18/duckdb:vortex-file-compressed 27201601 / 27483023 / -1.0% 36845171 / 38550818 / -4.4% 0.74 / 0.71 / +3.6%
tpch_q19/duckdb:vortex-file-compressed 12328705 / 12624827 / -2.3% 27513669 / 28241518 / -2.6% 0.45 / 0.45 / +0.2%
tpch_q20/duckdb:vortex-file-compressed 15758587 / 16022366 / -1.6% 33954807 / 32943342 / +3.1% 0.46 / 0.49 / -4.6%
tpch_q21/duckdb:vortex-file-compressed 39182941 / 40140318 / -2.4% 59119629 / 59236122 / -0.2% 0.66 / 0.68 / -2.2%
tpch_q22/duckdb:vortex-file-compressed 19081399 / 18899946 / +1.0% 29784748 / 29941738 / -0.5% 0.64 / 0.63 / +1.5%
duckdb / parquet / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 18074084 / 18666860 / -3.2% 22325859 / 22206838 / +0.5% 0.81 / 0.84 / -3.7%
tpch_q02/duckdb:parquet 31775107 / 32597697 / -2.5% 38961657 / 39608128 / -1.6% 0.82 / 0.82 / -0.9%
tpch_q03/duckdb:parquet 37035725 / 36638202 / +1.1% 48536951 / 45071947 / +7.7% 0.76 / 0.81 / -6.1%
tpch_q04/duckdb:parquet 26615905 / 26766180 / -0.6% 33978199 / 34868676 / -2.6% 0.78 / 0.77 / +2.0%
tpch_q05/duckdb:parquet 40912134 / 41326967 / -1.0% 52888142 / 51136437 / +3.4% 0.77 / 0.81 / -4.3%
tpch_q06/duckdb:parquet 10842297 / 11239823 / -3.5% 16503455 / 16320295 / +1.1% 0.66 / 0.69 / -4.6%
tpch_q07/duckdb:parquet 44613870 / 44537468 / +0.2% 57416647 / 56634780 / +1.4% 0.78 / 0.79 / -1.2%
tpch_q08/duckdb:parquet 48619738 / 49633183 / -2.0% 59733363 / 60118179 / -0.6% 0.81 / 0.83 / -1.4%
tpch_q09/duckdb:parquet 52389216 / 52383972 / +0.0% 62519252 / 61516222 / +1.6% 0.84 / 0.85 / -1.6%
tpch_q10/duckdb:parquet 41914930 / 42294920 / -0.9% 50482003 / 50605070 / -0.2% 0.83 / 0.84 / -0.7%
tpch_q11/duckdb:parquet 17275291 / 17766571 / -2.8% 25163733 / 24168987 / +4.1% 0.69 / 0.74 / -6.6%
tpch_q12/duckdb:parquet 22819992 / 23688654 / -3.7% 30207832 / 31045530 / -2.7% 0.76 / 0.76 / -1.0%
tpch_q13/duckdb:parquet 35603968 / 36243377 / -1.8% 40305487 / 40871676 / -1.4% 0.88 / 0.89 / -0.4%
tpch_q14/duckdb:parquet 25704371 / 26058360 / -1.4% 33740430 / 34600288 / -2.5% 0.76 / 0.75 / +1.2%
tpch_q15/duckdb:parquet 19449691 / 19006459 / +2.3% 25319480 / 25479027 / -0.6% 0.77 / 0.75 / +3.0%
tpch_q16/duckdb:parquet 31183870 / 31162826 / +0.1% 39276804 / 39538607 / -0.7% 0.79 / 0.79 / +0.7%
tpch_q17/duckdb:parquet 25977058 / 26842171 / -3.2% 36430231 / 34677131 / +5.1% 0.71 / 0.77 / -7.9%
tpch_q18/duckdb:parquet 38487517 / 39036355 / -1.4% 47535306 / 50859301 / -6.5% 0.81 / 0.77 / +5.5%
tpch_q19/duckdb:parquet 23009089 / 22846631 / +0.7% 30585010 / 30382477 / +0.7% 0.75 / 0.75 / +0.0%
tpch_q20/duckdb:parquet 33047729 / 32932254 / +0.4% 43961843 / 43761703 / +0.5% 0.75 / 0.75 / -0.1%
tpch_q21/duckdb:parquet 64054687 / 65735205 / -2.6% 77842460 / 75550714 / +3.0% 0.82 / 0.87 / -5.4%
tpch_q22/duckdb:parquet 24221514 / 24332936 / -0.5% 32270849 / 32029332 / +0.8% 0.75 / 0.76 / -1.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR cfbd5133 vs base d270200d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.995x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.014x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 86999223 / 86496369 / +0.6% 140591457 / 146958834 / -4.3% 0.62 / 0.59 / +5.1%
tpch_q02/datafusion:vortex-file-compressed 63541634 / 63772897 / -0.4% 94861814 / 94698631 / +0.2% 0.67 / 0.67 / -0.5%
tpch_q03/datafusion:vortex-file-compressed 61760976 / 61626461 / +0.2% 107941021 / 111691050 / -3.4% 0.57 / 0.55 / +3.7%
tpch_q04/datafusion:vortex-file-compressed 32879064 / 33221679 / -1.0% 69168159 / 67773347 / +2.1% 0.48 / 0.49 / -3.0%
tpch_q05/datafusion:vortex-file-compressed 114070911 / 113960374 / +0.1% 163778201 / 158779950 / +3.1% 0.70 / 0.72 / -3.0%
tpch_q06/datafusion:vortex-file-compressed 10300118 / 10749478 / -4.2% 55829356 / 55333879 / +0.9% 0.18 / 0.19 / -5.0%
tpch_q07/datafusion:vortex-file-compressed 132352157 / 134734501 / -1.8% 175931149 / 173649587 / +1.3% 0.75 / 0.78 / -3.0%
tpch_q08/datafusion:vortex-file-compressed 141590059 / 139805446 / +1.3% 195509922 / 195985074 / -0.2% 0.72 / 0.71 / +1.5%
tpch_q09/datafusion:vortex-file-compressed 179269484 / 182263407 / -1.6% 245985848 / 252623009 / -2.6% 0.73 / 0.72 / +1.0%
tpch_q10/datafusion:vortex-file-compressed 69931453 / 70178506 / -0.4% 131687825 / 127961453 / +2.9% 0.53 / 0.55 / -3.2%
tpch_q11/datafusion:vortex-file-compressed 43224883 / 42891207 / +0.8% 66400212 / 66205555 / +0.3% 0.65 / 0.65 / +0.5%
tpch_q12/datafusion:vortex-file-compressed 36297216 / 38160767 / -4.9% 76414538 / 76917697 / -0.7% 0.48 / 0.50 / -4.3%
tpch_q13/datafusion:vortex-file-compressed 42233935 / 42041864 / +0.5% 72391941 / 73865921 / -2.0% 0.58 / 0.57 / +2.5%
tpch_q14/datafusion:vortex-file-compressed 21975491 / 23321888 / -5.8% 89266931 / 87568450 / +1.9% 0.25 / 0.27 / -7.6%
tpch_q15/datafusion:vortex-file-compressed 33024704 / 33696846 / -2.0% 88226752 / 86791794 / +1.7% 0.37 / 0.39 / -3.6%
tpch_q16/datafusion:vortex-file-compressed 36086790 / 35911838 / +0.5% 67958564 / 67358721 / +0.9% 0.53 / 0.53 / -0.4%
tpch_q17/datafusion:vortex-file-compressed 170233558 / 170938101 / -0.4% 215380892 / 215232959 / +0.1% 0.79 / 0.79 / -0.5%
tpch_q18/datafusion:vortex-file-compressed 199455705 / 197205238 / +1.1% 252590759 / 254037489 / -0.6% 0.79 / 0.78 / +1.7%
tpch_q19/datafusion:vortex-file-compressed 29766209 / 30345755 / -1.9% 89386552 / 87912912 / +1.7% 0.33 / 0.35 / -3.5%
tpch_q20/datafusion:vortex-file-compressed 60322638 / 60752757 / -0.7% 115024723 / 114999153 / +0.0% 0.52 / 0.53 / -0.7%
tpch_q21/datafusion:vortex-file-compressed 176849887 / 175512505 / +0.8% 236329371 / 240562771 / -1.8% 0.75 / 0.73 / +2.6%
tpch_q22/datafusion:vortex-file-compressed 25420556 / 25193867 / +0.9% 52873506 / 51286407 / +3.1% 0.48 / 0.49 / -2.1%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 85966864 / 86040726 / -0.1% 126151736 / 123163012 / +2.4% 0.68 / 0.70 / -2.5%
tpch_q02/datafusion:parquet 98618086 / 98928510 / -0.3% 135416474 / 134352458 / +0.8% 0.73 / 0.74 / -1.1%
tpch_q03/datafusion:parquet 125974362 / 125601235 / +0.3% 173960419 / 165369432 / +5.2% 0.72 / 0.76 / -4.7%
tpch_q04/datafusion:parquet 57624678 / 58136625 / -0.9% 88657091 / 86574584 / +2.4% 0.65 / 0.67 / -3.2%
tpch_q05/datafusion:parquet 156936520 / 156585469 / +0.2% 220923587 / 204764340 / +7.9% 0.71 / 0.76 / -7.1%
tpch_q06/datafusion:parquet 36970653 / 36891022 / +0.2% 76633185 / 74143945 / +3.4% 0.48 / 0.50 / -3.0%
tpch_q07/datafusion:parquet 204647296 / 205191377 / -0.3% 264927527 / 261983178 / +1.1% 0.77 / 0.78 / -1.4%
tpch_q08/datafusion:parquet 196439324 / 195466195 / +0.5% 271628526 / 261226966 / +4.0% 0.72 / 0.75 / -3.4%
tpch_q09/datafusion:parquet 218527341 / 217073264 / +0.7% 283757872 / 283216725 / +0.2% 0.77 / 0.77 / +0.5%
tpch_q10/datafusion:parquet 152306212 / 152037531 / +0.2% 208686495 / 206045568 / +1.3% 0.73 / 0.74 / -1.1%
tpch_q11/datafusion:parquet 59435417 / 60039349 / -1.0% 92757296 / 92361436 / +0.4% 0.64 / 0.65 / -1.4%
tpch_q12/datafusion:parquet 83585721 / 82833515 / +0.9% 121777796 / 118474727 / +2.8% 0.69 / 0.70 / -1.8%
tpch_q13/datafusion:parquet 206223550 / 205856281 / +0.2% 238328317 / 237215492 / +0.5% 0.87 / 0.87 / -0.3%
tpch_q14/datafusion:parquet 59059466 / 58461591 / +1.0% 128495258 / 121360765 / +5.9% 0.46 / 0.48 / -4.6%
tpch_q15/datafusion:parquet 97800034 / 97430395 / +0.4% 149282527 / 146251123 / +2.1% 0.66 / 0.67 / -1.7%
tpch_q16/datafusion:parquet 45489792 / 45518945 / -0.1% 75122457 / 75337980 / -0.3% 0.61 / 0.60 / +0.2%
tpch_q17/datafusion:parquet 197075907 / 197837609 / -0.4% 254781695 / 250783713 / +1.6% 0.77 / 0.79 / -1.9%
tpch_q18/datafusion:parquet 241291993 / 240888219 / +0.2% 281458800 / 280492851 / +0.3% 0.86 / 0.86 / -0.2%
tpch_q19/datafusion:parquet 84296317 / 84731868 / -0.5% 150835868 / 145841682 / +3.4% 0.56 / 0.58 / -3.8%
tpch_q20/datafusion:parquet 124035233 / 123397964 / +0.5% 195805731 / 196204345 / -0.2% 0.63 / 0.63 / +0.7%
tpch_q21/datafusion:parquet 268853607 / 270676225 / -0.7% 334810411 / 336206409 / -0.4% 0.80 / 0.81 / -0.3%
tpch_q22/datafusion:parquet 57429849 / 57071102 / +0.6% 85596956 / 86298836 / -0.8% 0.67 / 0.66 / +1.5%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 39370728 / 40197783 / -2.1% 80419869 / 80071791 / +0.4% 0.49 / 0.50 / -2.5%
tpch_q02/duckdb:vortex-file-compressed 30114885 / 30072177 / +0.1% 44349109 / 43280723 / +2.5% 0.68 / 0.69 / -2.3%
tpch_q03/duckdb:vortex-file-compressed 56213314 / 55911562 / +0.5% 103715459 / 103648995 / +0.1% 0.54 / 0.54 / +0.5%
tpch_q04/duckdb:vortex-file-compressed 53622772 / 53084703 / +1.0% 83148093 / 84321406 / -1.4% 0.64 / 0.63 / +2.4%
tpch_q05/duckdb:vortex-file-compressed 70911478 / 71482740 / -0.8% 114450179 / 117043008 / -2.2% 0.62 / 0.61 / +1.4%
tpch_q06/duckdb:vortex-file-compressed 23597425 / 23677983 / -0.3% 66558384 / 66454913 / +0.2% 0.35 / 0.36 / -0.5%
tpch_q07/duckdb:vortex-file-compressed 60058781 / 58948970 / +1.9% 114781918 / 115403851 / -0.5% 0.52 / 0.51 / +2.4%
tpch_q08/duckdb:vortex-file-compressed 90493440 / 90590409 / -0.1% 136100336 / 140221219 / -2.9% 0.66 / 0.65 / +2.9%
tpch_q09/duckdb:vortex-file-compressed 114941384 / 113434440 / +1.3% 176733141 / 183312711 / -3.6% 0.65 / 0.62 / +5.1%
tpch_q10/duckdb:vortex-file-compressed 100222040 / 99921395 / +0.3% 148190708 / 151103661 / -1.9% 0.68 / 0.66 / +2.3%
tpch_q11/duckdb:vortex-file-compressed 15739166 / 15715668 / +0.1% 29197550 / 28273044 / +3.3% 0.54 / 0.56 / -3.0%
tpch_q12/duckdb:vortex-file-compressed 61027063 / 60589106 / +0.7% 104222310 / 105072752 / -0.8% 0.59 / 0.58 / +1.5%
tpch_q13/duckdb:vortex-file-compressed 77374501 / 76154977 / +1.6% 98846979 / 97506011 / +1.4% 0.78 / 0.78 / +0.2%
tpch_q14/duckdb:vortex-file-compressed 30353772 / 30284424 / +0.2% 73955293 / 73772222 / +0.2% 0.41 / 0.41 / -0.0%
tpch_q15/duckdb:vortex-file-compressed 26406089 / 26231296 / +0.7% 62292905 / 66288993 / -6.0% 0.42 / 0.40 / +7.1%
tpch_q16/duckdb:vortex-file-compressed 52464160 / 52143317 / +0.6% 63641391 / 65083095 / -2.2% 0.82 / 0.80 / +2.9%
tpch_q17/duckdb:vortex-file-compressed 38677005 / 38408488 / +0.7% 76053776 / 74601240 / +1.9% 0.51 / 0.51 / -1.2%
tpch_q18/duckdb:vortex-file-compressed 113549643 / 114515995 / -0.8% 131093693 / 132737368 / -1.2% 0.87 / 0.86 / +0.4%
tpch_q19/duckdb:vortex-file-compressed 37592781 / 37937642 / -0.9% 92037324 / 96702059 / -4.8% 0.41 / 0.39 / +4.1%
tpch_q20/duckdb:vortex-file-compressed 50059285 / 50896449 / -1.6% 96006100 / 101231872 / -5.2% 0.52 / 0.50 / +3.7%
tpch_q21/duckdb:vortex-file-compressed 100938340 / 99224910 / +1.7% 146560397 / 150648775 / -2.7% 0.69 / 0.66 / +4.6%
tpch_q22/duckdb:vortex-file-compressed 36397685 / 36263841 / +0.4% 54945934 / 53808630 / +2.1% 0.66 / 0.67 / -1.7%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 80106167 / 80284294 / -0.2% 101688332 / 102083536 / -0.4% 0.79 / 0.79 / +0.2%
tpch_q02/duckdb:parquet 54682979 / 55355585 / -1.2% 61790202 / 63384321 / -2.5% 0.88 / 0.87 / +1.3%
tpch_q03/duckdb:parquet 120283250 / 120423795 / -0.1% 152456659 / 152981318 / -0.3% 0.79 / 0.79 / +0.2%
tpch_q04/duckdb:parquet 83111750 / 82462370 / +0.8% 103634706 / 102350063 / +1.3% 0.80 / 0.81 / -0.5%
tpch_q05/duckdb:parquet 140947114 / 139672064 / +0.9% 172108125 / 174737031 / -1.5% 0.82 / 0.80 / +2.5%
tpch_q06/duckdb:parquet 39695322 / 39172140 / +1.3% 61856362 / 60605546 / +2.1% 0.64 / 0.65 / -0.7%
tpch_q07/duckdb:parquet 134837429 / 133478547 / +1.0% 174400475 / 174810653 / -0.2% 0.77 / 0.76 / +1.3%
tpch_q08/duckdb:parquet 174286260 / 172690786 / +0.9% 215364108 / 216962992 / -0.7% 0.81 / 0.80 / +1.7%
tpch_q09/duckdb:parquet 181119066 / 178706039 / +1.4% 223526051 / 226092450 / -1.1% 0.81 / 0.79 / +2.5%
tpch_q10/duckdb:parquet 157685573 / 157896196 / -0.1% 177167325 / 179032054 / -1.0% 0.89 / 0.88 / +0.9%
tpch_q11/duckdb:parquet 33899410 / 34268505 / -1.1% 45840789 / 44387668 / +3.3% 0.74 / 0.77 / -4.2%
tpch_q12/duckdb:parquet 77685114 / 76845953 / +1.1% 98836166 / 96306775 / +2.6% 0.79 / 0.80 / -1.5%
tpch_q13/duckdb:parquet 335703531 / 332507798 / +1.0% 347809890 / 347014048 / +0.2% 0.97 / 0.96 / +0.7%
tpch_q14/duckdb:parquet 75441842 / 74362031 / +1.5% 112116892 / 111512641 / +0.5% 0.67 / 0.67 / +0.9%
tpch_q15/duckdb:parquet 70953201 / 70856087 / +0.1% 99867123 / 101109917 / -1.2% 0.71 / 0.70 / +1.4%
tpch_q16/duckdb:parquet 65214714 / 65513458 / -0.5% 67779829 / 67313061 / +0.7% 0.96 / 0.97 / -1.1%
tpch_q17/duckdb:parquet 87152958 / 88249572 / -1.2% 123315571 / 120261520 / +2.5% 0.71 / 0.73 / -3.7%
tpch_q18/duckdb:parquet 186382587 / 182604608 / +2.1% 195097305 / 167547898 / +16.4% 🔴 0.96 / 1.09 / -12.3%
tpch_q19/duckdb:parquet 80209179 / 81150692 / -1.2% 115921435 / 119625996 / -3.1% 0.69 / 0.68 / +2.0%
tpch_q20/duckdb:parquet 93472368 / 92544029 / +1.0% 132944030 / 130260533 / +2.1% 0.70 / 0.71 / -1.0%
tpch_q21/duckdb:parquet 281490895 / 279064583 / +0.9% 303883256 / 303593541 / +0.1% 0.93 / 0.92 / +0.8%
tpch_q22/duckdb:parquet 57821812 / 56525226 / +2.3% 67186728 / 68219098 / -1.5% 0.86 / 0.83 / +3.9%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR cfbd5133 vs base d270200d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.997x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.991x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1279435 / 1263414 / +1.3% 22512768 / 21504141 / +4.7% 0.06 / 0.06 / -3.3%
clickbench_q01/datafusion:vortex-file-compressed 5676500 / 5723647 / -0.8% 33056281 / 28584622 / +15.6% 🔴 0.17 / 0.20 / -14.2%
clickbench_q02/datafusion:vortex-file-compressed 9820014 / 9382253 / +4.7% 35055007 / 37493555 / -6.5% 0.28 / 0.25 / +11.9%
clickbench_q03/datafusion:vortex-file-compressed 11619483 / 10722368 / +8.4% 52858031 / 52786866 / +0.1% 0.22 / 0.20 / +8.2%
clickbench_q04/datafusion:vortex-file-compressed 55397639 / 54365156 / +1.9% 88772163 / 89116962 / -0.4% 0.62 / 0.61 / +2.3%
clickbench_q05/datafusion:vortex-file-compressed 74732006 / 73296778 / +2.0% 119952892 / 119101808 / +0.7% 0.62 / 0.62 / +1.2%
clickbench_q06/datafusion:vortex-file-compressed 1255573 / 1258368 / -0.2% 22806565 / 21920108 / +4.0% 0.06 / 0.06 / -4.1%
clickbench_q07/datafusion:vortex-file-compressed 9319628 / 9022344 / +3.3% 32982958 / 31527321 / +4.6% 0.28 / 0.29 / -1.3%
clickbench_q08/datafusion:vortex-file-compressed 72687454 / 74244710 / -2.1% 112860953 / 114397584 / -1.3% 0.64 / 0.65 / -0.8%
clickbench_q09/datafusion:vortex-file-compressed 163973576 / 168989817 / -3.0% 202364249 / 207860679 / -2.6% 0.81 / 0.81 / -0.3%
clickbench_q10/datafusion:vortex-file-compressed 22971698 / 23132475 / -0.7% 68141220 / 63392508 / +7.5% 0.34 / 0.36 / -7.6%
clickbench_q11/datafusion:vortex-file-compressed 24744266 / 25249670 / -2.0% 68867747 / 66752829 / +3.2% 0.36 / 0.38 / -5.0%
clickbench_q12/datafusion:vortex-file-compressed 72068996 / 71405590 / +0.9% 117500560 / 118555590 / -0.9% 0.61 / 0.60 / +1.8%
clickbench_q13/datafusion:vortex-file-compressed 116844708 / 116907152 / -0.1% 174244560 / 176035319 / -1.0% 0.67 / 0.66 / +1.0%
clickbench_q14/datafusion:vortex-file-compressed 73504960 / 74324927 / -1.1% 117486705 / 118872641 / -1.2% 0.63 / 0.63 / +0.1%
clickbench_q15/datafusion:vortex-file-compressed 60519159 / 62417768 / -3.0% 95629925 / 95151063 / +0.5% 0.63 / 0.66 / -3.5%
clickbench_q16/datafusion:vortex-file-compressed 149436350 / 152095829 / -1.7% 202522315 / 207166742 / -2.2% 0.74 / 0.73 / +0.5%
clickbench_q17/datafusion:vortex-file-compressed 149795088 / 146499146 / +2.2% 206087506 / 206232623 / -0.1% 0.73 / 0.71 / +2.3%
clickbench_q18/datafusion:vortex-file-compressed 282338250 / 289874646 / -2.6% 376468444 / 385415863 / -2.3% 0.75 / 0.75 / -0.3%
clickbench_q19/datafusion:vortex-file-compressed 7642870 / 7374996 / +3.6% 48858468 / 48225757 / +1.3% 0.16 / 0.15 / +2.3%
clickbench_q20/datafusion:vortex-file-compressed 60595364 / 61966176 / -2.2% 224441204 / 231230479 / -2.9% 0.27 / 0.27 / +0.7%
clickbench_q21/datafusion:vortex-file-compressed 88516562 / 89043482 / -0.6% 267348172 / 264587887 / +1.0% 0.33 / 0.34 / -1.6%
clickbench_q22/datafusion:vortex-file-compressed 96338796 / 99792072 / -3.5% 344036369 / 349826059 / -1.7% 0.28 / 0.29 / -1.8%
clickbench_q23/datafusion:vortex-file-compressed 192027154 / 191540153 / +0.3% 503480289 / 431052733 / +16.8% 🔴 0.38 / 0.44 / -14.2%
clickbench_q24/datafusion:vortex-file-compressed 15990290 / 15449876 / +3.5% 63646805 / 64323866 / -1.1% 0.25 / 0.24 / +4.6%
clickbench_q25/datafusion:vortex-file-compressed 17455272 / 17936340 / -2.7% 56038383 / 58938613 / -4.9% 0.31 / 0.30 / +2.4%
clickbench_q26/datafusion:vortex-file-compressed 15274877 / 15479545 / -1.3% 64233360 / 67672701 / -5.1% 0.24 / 0.23 / +4.0%
clickbench_q27/datafusion:vortex-file-compressed 94784050 / 96047214 / -1.3% 244284987 / 245880425 / -0.6% 0.39 / 0.39 / -0.7%
clickbench_q28/datafusion:vortex-file-compressed 553098622 / 563586646 / -1.9% 607107734 / 623540250 / -2.6% 0.91 / 0.90 / +0.8%
clickbench_q29/datafusion:vortex-file-compressed 23006416 / 23185798 / -0.8% 50878978 / 49483361 / +2.8% 0.45 / 0.47 / -3.5%
clickbench_q30/datafusion:vortex-file-compressed 55842776 / 58484918 / -4.5% 102802687 / 105458505 / -2.5% 0.54 / 0.55 / -2.1%
clickbench_q31/datafusion:vortex-file-compressed 65493013 / 66876132 / -2.1% 152460460 / 152816774 / -0.2% 0.43 / 0.44 / -1.8%
clickbench_q32/datafusion:vortex-file-compressed 289462542 / 296672912 / -2.4% 397387405 / 384507307 / +3.3% 0.73 / 0.77 / -5.6%
clickbench_q33/datafusion:vortex-file-compressed 317595916 / 321275592 / -1.1% 418420798 / 438840272 / -4.7% 0.76 / 0.73 / +3.7%
clickbench_q34/datafusion:vortex-file-compressed 316792622 / 319437272 / -0.8% 418409910 / 431934822 / -3.1% 0.76 / 0.74 / +2.4%
clickbench_q35/datafusion:vortex-file-compressed 55799557 / 56751335 / -1.7% 86387010 / 86716009 / -0.4% 0.65 / 0.65 / -1.3%
clickbench_q36/datafusion:vortex-file-compressed 37163968 / 37159138 / +0.0% 65450136 / 65212230 / +0.4% 0.57 / 0.57 / -0.4%
clickbench_q37/datafusion:vortex-file-compressed 21783980 / 21649628 / +0.6% 47581282 / 46737539 / +1.8% 0.46 / 0.46 / -1.2%
clickbench_q38/datafusion:vortex-file-compressed 11821638 / 11779650 / +0.4% 39190088 / 39200064 / -0.0% 0.30 / 0.30 / +0.4%
clickbench_q39/datafusion:vortex-file-compressed 76905111 / 77557356 / -0.8% 109715473 / 109554588 / +0.1% 0.70 / 0.71 / -1.0%
clickbench_q40/datafusion:vortex-file-compressed 11293608 / 11251030 / +0.4% 36153346 / 36321221 / -0.5% 0.31 / 0.31 / +0.8%
clickbench_q41/datafusion:vortex-file-compressed 10575544 / 10710174 / -1.3% 36853304 / 35916343 / +2.6% 0.29 / 0.30 / -3.8%
clickbench_q42/datafusion:vortex-file-compressed 10878714 / 11101097 / -2.0% 38136327 / 36464898 / +4.6% 0.29 / 0.30 / -6.3%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1262270 / 1257998 / +0.3% 50570256 / 51249978 / -1.3% 0.02 / 0.02 / +1.7%
clickbench_q01/datafusion:parquet 15774251 / 15992357 / -1.4% 67700170 / 68808162 / -1.6% 0.23 / 0.23 / +0.3%
clickbench_q02/datafusion:parquet 18628834 / 18229861 / +2.2% 82199082 / 80621433 / +2.0% 0.23 / 0.23 / +0.2%
clickbench_q03/datafusion:parquet 16912181 / 16624108 / +1.7% 79569424 / 80378918 / -1.0% 0.21 / 0.21 / +2.8%
clickbench_q04/datafusion:parquet 63802030 / 62850747 / +1.5% 125192012 / 126146050 / -0.8% 0.51 / 0.50 / +2.3%
clickbench_q05/datafusion:parquet 88499122 / 88293888 / +0.2% 157691670 / 160785633 / -1.9% 0.56 / 0.55 / +2.2%
clickbench_q06/datafusion:parquet 1265987 / 1269862 / -0.3% 50371148 / 51352457 / -1.9% 0.03 / 0.02 / +1.6%
clickbench_q07/datafusion:parquet 16569190 / 17196414 / -3.6% 69724014 / 69395812 / +0.5% 0.24 / 0.25 / -4.1%
clickbench_q08/datafusion:parquet 87089170 / 84743069 / +2.8% 161660637 / 168409659 / -4.0% 0.54 / 0.50 / +7.1%
clickbench_q09/datafusion:parquet 188879971 / 190057650 / -0.6% 271415778 / 271143581 / +0.1% 0.70 / 0.70 / -0.7%
clickbench_q10/datafusion:parquet 35793591 / 36449889 / -1.8% 102090223 / 101986989 / +0.1% 0.35 / 0.36 / -1.9%
clickbench_q11/datafusion:parquet 42737188 / 42513889 / +0.5% 110223454 / 112273893 / -1.8% 0.39 / 0.38 / +2.4%
clickbench_q12/datafusion:parquet 95948681 / 96214426 / -0.3% 162862017 / 165818634 / -1.8% 0.59 / 0.58 / +1.5%
clickbench_q13/datafusion:parquet 147632119 / 146822884 / +0.6% 228666042 / 227553301 / +0.5% 0.65 / 0.65 / +0.1%
clickbench_q14/datafusion:parquet 102192852 / 102002414 / +0.2% 173862100 / 181099529 / -4.0% 0.59 / 0.56 / +4.4%
clickbench_q15/datafusion:parquet 71563181 / 71970492 / -0.6% 135686420 / 132927100 / +2.1% 0.53 / 0.54 / -2.6%
clickbench_q16/datafusion:parquet 155907476 / 154620893 / +0.8% 234780524 / 235726054 / -0.4% 0.66 / 0.66 / +1.2%
clickbench_q17/datafusion:parquet 155277995 / 156062544 / -0.5% 237074727 / 239083833 / -0.8% 0.65 / 0.65 / +0.3%
clickbench_q18/datafusion:parquet 310535315 / 312702379 / -0.7% 418729688 / 428318067 / -2.2% 0.74 / 0.73 / +1.6%
clickbench_q19/datafusion:parquet 18817384 / 18717484 / +0.5% 78243339 / 78236781 / +0.0% 0.24 / 0.24 / +0.5%
clickbench_q20/datafusion:parquet 179392874 / 179867666 / -0.3% 309694963 / 302300795 / +2.4% 0.58 / 0.59 / -2.6%
clickbench_q21/datafusion:parquet 172193566 / 173871862 / -1.0% 323455831 / 316188116 / +2.3% 0.53 / 0.55 / -3.2%
clickbench_q22/datafusion:parquet 258608094 / 260920070 / -0.9% 472417315 / 453076835 / +4.3% 0.55 / 0.58 / -4.9%
clickbench_q23/datafusion:parquet 1008887505 / 1011100574 / -0.2% 1201576231 / 1197048449 / +0.4% 0.84 / 0.84 / -0.6%
clickbench_q24/datafusion:parquet 30054165 / 30348140 / -1.0% 88642531 / 91193559 / -2.8% 0.34 / 0.33 / +1.9%
clickbench_q25/datafusion:parquet 36981601 / 37437986 / -1.2% 102414084 / 104921563 / -2.4% 0.36 / 0.36 / +1.2%
clickbench_q26/datafusion:parquet 29945932 / 30612899 / -2.2% 88574863 / 93071232 / -4.8% 0.34 / 0.33 / +2.8%
clickbench_q27/datafusion:parquet 191404656 / 193888752 / -1.3% 291839526 / 302969532 / -3.7% 0.66 / 0.64 / +2.5%
clickbench_q28/datafusion:parquet 615165930 / 619170953 / -0.6% 704472564 / 708439139 / -0.6% 0.87 / 0.87 / -0.1%
clickbench_q29/datafusion:parquet 29294110 / 28783752 / +1.8% 90828434 / 90690085 / +0.2% 0.32 / 0.32 / +1.6%
clickbench_q30/datafusion:parquet 91061897 / 91412592 / -0.4% 173771509 / 176451776 / -1.5% 0.52 / 0.52 / +1.2%
clickbench_q31/datafusion:parquet 104069660 / 103107196 / +0.9% 195739023 / 200148149 / -2.2% 0.53 / 0.52 / +3.2%
clickbench_q32/datafusion:parquet 312955294 / 310179424 / +0.9% 428207587 / 426990864 / +0.3% 0.73 / 0.73 / +0.6%
clickbench_q33/datafusion:parquet 376107080 / 376234898 / -0.0% 473599398 / 477330700 / -0.8% 0.79 / 0.79 / +0.8%
clickbench_q34/datafusion:parquet 376887750 / 378563870 / -0.4% 473786754 / 477639794 / -0.8% 0.80 / 0.79 / +0.4%
clickbench_q35/datafusion:parquet 63488845 / 64531013 / -1.6% 124775833 / 123935403 / +0.7% 0.51 / 0.52 / -2.3%
clickbench_q36/datafusion:parquet 73327926 / 73390619 / -0.1% 136670508 / 136729215 / -0.0% 0.54 / 0.54 / -0.0%
clickbench_q37/datafusion:parquet 35435604 / 35779234 / -1.0% 91263019 / 94180899 / -3.1% 0.39 / 0.38 / +2.2%
clickbench_q38/datafusion:parquet 47407228 / 47553372 / -0.3% 108709253 / 111225094 / -2.3% 0.44 / 0.43 / +2.0%
clickbench_q39/datafusion:parquet 142980130 / 143529898 / -0.4% 211320333 / 213596621 / -1.1% 0.68 / 0.67 / +0.7%
clickbench_q40/datafusion:parquet 20020444 / 20026020 / -0.0% 77718550 / 77275408 / +0.6% 0.26 / 0.26 / -0.6%
clickbench_q41/datafusion:parquet 18687590 / 18845828 / -0.8% 75848103 / 76624615 / -1.0% 0.25 / 0.25 / +0.2%
clickbench_q42/datafusion:parquet 19015092 / 19501062 / -2.5% 75196754 / 74346141 / +1.1% 0.25 / 0.26 / -3.6%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2457070 / 2460774 / -0.2% 25445889 / 25632183 / -0.7% 0.10 / 0.10 / +0.6%
clickbench_q01/duckdb:vortex-file-compressed 7497280 / 7478300 / +0.3% 32686812 / 28371675 / +15.2% 🔴 0.23 / 0.26 / -13.0%
clickbench_q02/duckdb:vortex-file-compressed 8260738 / 8195336 / +0.8% 34974682 / 35755944 / -2.2% 0.24 / 0.23 / +3.0%
clickbench_q03/duckdb:vortex-file-compressed 16014379 / 16511744 / -3.0% 59136570 / 61515143 / -3.9% 0.27 / 0.27 / +0.9%
clickbench_q04/duckdb:vortex-file-compressed 56623492 / 58568130 / -3.3% 97353884 / 101544917 / -4.1% 0.58 / 0.58 / +0.8%
clickbench_q05/duckdb:vortex-file-compressed 64877876 / 65457408 / -0.9% 98387186 / 95370452 / +3.2% 0.66 / 0.69 / -3.9%
clickbench_q06/duckdb:vortex-file-compressed 2799437 / 2765738 / +1.2% 29641101 / 31317299 / -5.4% 0.09 / 0.09 / +6.9%
clickbench_q07/duckdb:vortex-file-compressed 8915140 / 8806761 / +1.2% 30875390 / 28985114 / +6.5% 0.29 / 0.30 / -5.0%
clickbench_q08/duckdb:vortex-file-compressed 67872406 / 68603723 / -1.1% 115587183 / 113762816 / +1.6% 0.59 / 0.60 / -2.6%
clickbench_q09/duckdb:vortex-file-compressed 89221540 / 90645587 / -1.6% 133495328 / 138001256 / -3.3% 0.67 / 0.66 / +1.8%
clickbench_q10/duckdb:vortex-file-compressed 27319694 / 27523700 / -0.7% 71899842 / 74644225 / -3.7% 0.38 / 0.37 / +3.0%
clickbench_q11/duckdb:vortex-file-compressed 29876708 / 29916612 / -0.1% 75468974 / 74586195 / +1.2% 0.40 / 0.40 / -1.3%
clickbench_q12/duckdb:vortex-file-compressed 71934264 / 72024875 / -0.1% 103329461 / 103893935 / -0.5% 0.70 / 0.69 / +0.4%
clickbench_q13/duckdb:vortex-file-compressed 128208252 / 129985626 / -1.4% 170784891 / 169425396 / +0.8% 0.75 / 0.77 / -2.2%
clickbench_q14/duckdb:vortex-file-compressed 76265672 / 76960763 / -0.9% 106028212 / 108983735 / -2.7% 0.72 / 0.71 / +1.9%
clickbench_q15/duckdb:vortex-file-compressed 76289207 / 76899128 / -0.8% 118066845 / 119446808 / -1.2% 0.65 / 0.64 / +0.4%
clickbench_q16/duckdb:vortex-file-compressed 141884934 / 140337334 / +1.1% 186385368 / 187437943 / -0.6% 0.76 / 0.75 / +1.7%
clickbench_q17/duckdb:vortex-file-compressed 142062714 / 145804348 / -2.6% 179694319 / 183559183 / -2.1% 0.79 / 0.79 / -0.5%
clickbench_q18/duckdb:vortex-file-compressed 266153989 / 266631077 / -0.2% 326989231 / 328819968 / -0.6% 0.81 / 0.81 / +0.4%
clickbench_q19/duckdb:vortex-file-compressed 9533820 / 9358417 / +1.9% 42183827 / 43337002 / -2.7% 0.23 / 0.22 / +4.7%
clickbench_q20/duckdb:vortex-file-compressed 64287845 / 66052996 / -2.7% 172684730 / 172868514 / -0.1% 0.37 / 0.38 / -2.6%
clickbench_q21/duckdb:vortex-file-compressed 96470274 / 98936984 / -2.5% 284345028 / 284050134 / +0.1% 0.34 / 0.35 / -2.6%
clickbench_q22/duckdb:vortex-file-compressed 176754382 / 177989371 / -0.7% 442010652 / 448461685 / -1.4% 0.40 / 0.40 / +0.8%
clickbench_q23/duckdb:vortex-file-compressed 35816375 / 36050826 / -0.7% 88154957 / 92084192 / -4.3% 0.41 / 0.39 / +3.8%
clickbench_q24/duckdb:vortex-file-compressed 14459638 / 14882966 / -2.8% 40736437 / 40374315 / +0.9% 0.35 / 0.37 / -3.7%
clickbench_q25/duckdb:vortex-file-compressed 18488450 / 19232500 / -3.9% 55868311 / 55411979 / +0.8% 0.33 / 0.35 / -4.7%
clickbench_q26/duckdb:vortex-file-compressed 11699978 / 11736795 / -0.3% 37907650 / 38129808 / -0.6% 0.31 / 0.31 / +0.3%
clickbench_q27/duckdb:vortex-file-compressed 55234664 / 55906996 / -1.2% 228304237 / 228348690 / -0.0% 0.24 / 0.24 / -1.2%
clickbench_q28/duckdb:vortex-file-compressed 458466563 / 456049460 / +0.5% 524788008 / 529217897 / -0.8% 0.87 / 0.86 / +1.4%
clickbench_q29/duckdb:vortex-file-compressed 18201132 / 18180470 / +0.1% 46259248 / 48528227 / -4.7% 0.39 / 0.37 / +5.0%
clickbench_q30/duckdb:vortex-file-compressed 60078114 / 59745674 / +0.6% 112195123 / 111327257 / +0.8% 0.54 / 0.54 / -0.2%
clickbench_q31/duckdb:vortex-file-compressed 112474324 / 112104451 / +0.3% 179470349 / 180163443 / -0.4% 0.63 / 0.62 / +0.7%
clickbench_q32/duckdb:vortex-file-compressed 372650982 / 379324790 / -1.8% 427133507 / 419957727 / +1.7% 0.87 / 0.90 / -3.4%
clickbench_q33/duckdb:vortex-file-compressed 357055554 / 361673707 / -1.3% 464453488 / 459257678 / +1.1% 0.77 / 0.79 / -2.4%
clickbench_q34/duckdb:vortex-file-compressed 369486298 / 370206934 / -0.2% 469158167 / 479143797 / -2.1% 0.79 / 0.77 / +1.9%
clickbench_q35/duckdb:vortex-file-compressed 60280930 / 57868149 / +4.2% 93919659 / 95619497 / -1.8% 0.64 / 0.61 / +6.1%
clickbench_q36/duckdb:vortex-file-compressed 12570270 / 12303252 / +2.2% 33747499 / 34193501 / -1.3% 0.37 / 0.36 / +3.5%
clickbench_q37/duckdb:vortex-file-compressed 8588676 / 8626968 / -0.4% 29322515 / 32720106 / -10.4% 🟢 0.29 / 0.26 / +11.1%
clickbench_q38/duckdb:vortex-file-compressed 9326598 / 9406338 / -0.8% 30658356 / 33447105 / -8.3% 0.30 / 0.28 / +8.2%
clickbench_q39/duckdb:vortex-file-compressed 21036270 / 20671180 / +1.8% 41989983 / 45009083 / -6.7% 0.50 / 0.46 / +9.1%
clickbench_q40/duckdb:vortex-file-compressed 7579770 / 7511632 / +0.9% 29610403 / 29513080 / +0.3% 0.26 / 0.25 / +0.6%
clickbench_q41/duckdb:vortex-file-compressed 8315584 / 8376094 / -0.7% 30163578 / 29629303 / +1.8% 0.28 / 0.28 / -2.5%
clickbench_q42/duckdb:vortex-file-compressed 7551844 / 7627772 / -1.0% 29004679 / 31367610 / -7.5% 0.26 / 0.24 / +7.1%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 12468854 / 12932688 / -3.6% 19362217 / 19289146 / +0.4% 0.64 / 0.67 / -4.0%
clickbench_q01/duckdb:parquet 18954093 / 19262904 / -1.6% 25415207 / 25388411 / +0.1% 0.75 / 0.76 / -1.7%
clickbench_q02/duckdb:parquet 27419880 / 27327352 / +0.3% 40213235 / 37772009 / +6.5% 0.68 / 0.72 / -5.8%
clickbench_q03/duckdb:parquet 26524453 / 26587340 / -0.2% 41802212 / 41100008 / +1.7% 0.63 / 0.65 / -1.9%
clickbench_q04/duckdb:parquet 65502040 / 65414997 / +0.1% 80009473 / 83558804 / -4.2% 0.82 / 0.78 / +4.6%
clickbench_q05/duckdb:parquet 88203476 / 89884955 / -1.9% 103353468 / 107142377 / -3.5% 0.85 / 0.84 / +1.7%
clickbench_q06/duckdb:parquet 25075058 / 25265130 / -0.8% 34151587 / 32124566 / +6.3% 0.73 / 0.79 / -6.6%
clickbench_q07/duckdb:parquet 20801366 / 21556709 / -3.5% 27697916 / 27809973 / -0.4% 0.75 / 0.78 / -3.1%
clickbench_q08/duckdb:parquet 80118570 / 77997936 / +2.7% 95388634 / 90879973 / +5.0% 0.84 / 0.86 / -2.1%
clickbench_q09/duckdb:parquet 104713319 / 105545644 / -0.8% 122817596 / 123001549 / -0.1% 0.85 / 0.86 / -0.6%
clickbench_q10/duckdb:parquet 45446130 / 45492238 / -0.1% 60960568 / 59528365 / +2.4% 0.75 / 0.76 / -2.4%
clickbench_q11/duckdb:parquet 50582108 / 51389866 / -1.6% 66735798 / 69849991 / -4.5% 0.76 / 0.74 / +3.0%
clickbench_q12/duckdb:parquet 97287027 / 99069860 / -1.8% 117350791 / 116120242 / +1.1% 0.83 / 0.85 / -2.8%
clickbench_q13/duckdb:parquet 156046308 / 157996337 / -1.2% 177555227 / 182177812 / -2.5% 0.88 / 0.87 / +1.3%
clickbench_q14/duckdb:parquet 108905649 / 109166775 / -0.2% 129387319 / 130867214 / -1.1% 0.84 / 0.83 / +0.9%
clickbench_q15/duckdb:parquet 91737974 / 92460925 / -0.8% 107050031 / 108326866 / -1.2% 0.86 / 0.85 / +0.4%
clickbench_q16/duckdb:parquet 179081016 / 179901930 / -0.5% 188966715 / 193649118 / -2.4% 0.95 / 0.93 / +2.0%
clickbench_q17/duckdb:parquet 183536334 / 185663408 / -1.1% 193154133 / 194079653 / -0.5% 0.95 / 0.96 / -0.7%
clickbench_q18/duckdb:parquet 314598018 / 311080270 / +1.1% 343134980 / 343501640 / -0.1% 0.92 / 0.91 / +1.2%
clickbench_q19/duckdb:parquet 23875422 / 23826262 / +0.2% 31123269 / 33719846 / -7.7% 0.77 / 0.71 / +8.6%
clickbench_q20/duckdb:parquet 203983484 / 195217536 / +4.5% 242727779 / 248950611 / -2.5% 0.84 / 0.78 / +7.2%
clickbench_q21/duckdb:parquet 233209108 / 229511160 / +1.6% 277900430 / 272401599 / +2.0% 0.84 / 0.84 / -0.4%
clickbench_q22/duckdb:parquet 336123702 / 326377726 / +3.0% 375603279 / 385428768 / -2.5% 0.89 / 0.85 / +5.7%
clickbench_q23/duckdb:parquet 179545217 / 179124993 / +0.2% 249423919 / 239075589 / +4.3% 0.72 / 0.75 / -3.9%
clickbench_q24/duckdb:parquet 36291982 / 36550134 / -0.7% 38208777 / 44577927 / -14.3% 🟢 0.95 / 0.82 / +15.8%
clickbench_q25/duckdb:parquet 46190296 / 47060986 / -1.9% 62662070 / 63859675 / -1.9% 0.74 / 0.74 / +0.0%
clickbench_q26/duckdb:parquet 37503284 / 36284955 / +3.4% 45154006 / 48243820 / -6.4% 0.83 / 0.75 / +10.4%
clickbench_q27/duckdb:parquet 206240524 / 200334614 / +2.9% 240928233 / 247648358 / -2.7% 0.86 / 0.81 / +5.8%
clickbench_q28/duckdb:parquet 852104976 / 840244340 / +1.4% 840687862 / 839734300 / +0.1% 1.01 / 1.00 / +1.3%
clickbench_q29/duckdb:parquet 30549304 / 30701560 / -0.5% 40478018 / 39135900 / +3.4% 0.75 / 0.78 / -3.8%
clickbench_q30/duckdb:parquet 110441858 / 111055856 / -0.6% 137842887 / 137097878 / +0.5% 0.80 / 0.81 / -1.1%
clickbench_q31/duckdb:parquet 165664362 / 166956364 / -0.8% 188054064 / 214679060 / -12.4% 🟢 0.88 / 0.78 / +13.3%
clickbench_q32/duckdb:parquet 413491711 / 402243770 / +2.8% 427740330 / 420796935 / +1.7% 0.97 / 0.96 / +1.1%
clickbench_q33/duckdb:parquet 491325619 / 481015907 / +2.1% 493102997 / 473239481 / +4.2% 1.00 / 1.02 / -2.0%
clickbench_q34/duckdb:parquet 488336896 / 487112054 / +0.3% 486401167 / 472647354 / +2.9% 1.00 / 1.03 / -2.6%
clickbench_q35/duckdb:parquet 67471238 / 66570893 / +1.4% 76359908 / 80314598 / -4.9% 0.88 / 0.83 / +6.6%
clickbench_q36/duckdb:parquet 36639387 / 37538342 / -2.4% 45704037 / 45787813 / -0.2% 0.80 / 0.82 / -2.2%
clickbench_q37/duckdb:parquet 28216102 / 28435990 / -0.8% 36379829 / 37364788 / -2.6% 0.78 / 0.76 / +1.9%
clickbench_q38/duckdb:parquet 30150492 / 30694778 / -1.8% 39617662 / 38565659 / +2.7% 0.76 / 0.80 / -4.4%
clickbench_q39/duckdb:parquet 62664454 / 63073209 / -0.6% 72349595 / 72755605 / -0.6% 0.87 / 0.87 / -0.1%
clickbench_q40/duckdb:parquet 18118741 / 17596888 / +3.0% 26376226 / 26841646 / -1.7% 0.69 / 0.66 / +4.8%
clickbench_q41/duckdb:parquet 18675121 / 18750233 / -0.4% 26169857 / 26406651 / -0.9% 0.71 / 0.71 / +0.5%
clickbench_q42/duckdb:parquet 18027096 / 18414249 / -2.1% 27380350 / 27041690 / +1.3% 0.66 / 0.68 / -3.3%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR cfbd5133 vs base d270200d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.029x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.016x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24289184 / 24420666 / -0.5% 43118785 / 41281865 / +4.4% 0.56 / 0.59 / -4.8%
tpcds_q02/datafusion:vortex-file-compressed 46914140 / 47431110 / -1.1% 66435405 / 63913641 / +3.9% 0.71 / 0.74 / -4.8%
tpcds_q03/datafusion:vortex-file-compressed 11886772 / 11723505 / +1.4% 28765677 / 27161778 / +5.9% 0.41 / 0.43 / -4.3%
tpcds_q04/datafusion:vortex-file-compressed 122831714 / 124886560 / -1.6% 156001746 / 153642586 / +1.5% 0.79 / 0.81 / -3.1%
tpcds_q05/datafusion:vortex-file-compressed 59319566 / 59362226 / -0.1% 78863776 / 79288903 / -0.5% 0.75 / 0.75 / +0.5%
tpcds_q06/datafusion:vortex-file-compressed 22595259 / 22659033 / -0.3% 44188064 / 43919851 / +0.6% 0.51 / 0.52 / -0.9%
tpcds_q07/datafusion:vortex-file-compressed 31390788 / 31676994 / -0.9% 53996009 / 53100859 / +1.7% 0.58 / 0.60 / -2.5%
tpcds_q08/datafusion:vortex-file-compressed 24622991 / 24209822 / +1.7% 43433580 / 41622010 / +4.4% 0.57 / 0.58 / -2.5%
tpcds_q09/datafusion:vortex-file-compressed 17025074 / 17038212 / -0.1% 35523647 / 33352912 / +6.5% 0.48 / 0.51 / -6.2%
tpcds_q10/datafusion:vortex-file-compressed 27182906 / 27343871 / -0.6% 49584815 / 46897016 / +5.7% 0.55 / 0.58 / -6.0%
tpcds_q11/datafusion:vortex-file-compressed 64020296 / 64120750 / -0.2% 92606202 / 92229983 / +0.4% 0.69 / 0.70 / -0.6%
tpcds_q12/datafusion:vortex-file-compressed 16547568 / 16582494 / -0.2% 32253741 / 32125728 / +0.4% 0.51 / 0.52 / -0.6%
tpcds_q13/datafusion:vortex-file-compressed 31955633 / 32005700 / -0.2% 55928017 / 53167509 / +5.2% 0.57 / 0.60 / -5.1%
tpcds_q14/datafusion:vortex-file-compressed 496049774 / 495576188 / +0.1% 556578302 / 553297880 / +0.6% 0.89 / 0.90 / -0.5%
tpcds_q15/datafusion:vortex-file-compressed 15415762 / 15612182 / -1.3% 35830712 / 33524986 / +6.9% 0.43 / 0.47 / -7.6%
tpcds_q16/datafusion:vortex-file-compressed 19556838 / 20023888 / -2.3% 40316898 / 37994494 / +6.1% 0.49 / 0.53 / -8.0%
tpcds_q17/datafusion:vortex-file-compressed 59934742 / 55711443 / +7.6% 82406799 / 72623221 / +13.5% 🔴 0.73 / 0.77 / -5.2%
tpcds_q18/datafusion:vortex-file-compressed 67876582 / 68069904 / -0.3% 91685755 / 92032345 / -0.4% 0.74 / 0.74 / +0.1%
tpcds_q19/datafusion:vortex-file-compressed 17426962 / 17304103 / +0.7% 38207264 / 37229410 / +2.6% 0.46 / 0.46 / -1.9%
tpcds_q20/datafusion:vortex-file-compressed 17717020 / 18124554 / -2.2% 36251881 / 34468946 / +5.2% 0.49 / 0.53 / -7.1%
tpcds_q21/datafusion:vortex-file-compressed 15689208 / 17114398 / -8.3% 37491565 / 38152750 / -1.7% 0.42 / 0.45 / -6.7%
tpcds_q22/datafusion:vortex-file-compressed 57765961 / 58068306 / -0.5% 81356046 / 80198917 / +1.4% 0.71 / 0.72 / -1.9%
tpcds_q23/datafusion:vortex-file-compressed 71323070 / 72749600 / -2.0% 95927588 / 97779682 / -1.9% 0.74 / 0.74 / -0.1%
tpcds_q24/datafusion:vortex-file-compressed 68013392 / 67025334 / +1.5% 90760281 / 89439825 / +1.5% 0.75 / 0.75 / -0.0%
tpcds_q25/datafusion:vortex-file-compressed 46451122 / 50179734 / -7.4% 81426442 / 78345544 / +3.9% 0.57 / 0.64 / -10.9%
tpcds_q26/datafusion:vortex-file-compressed 30469607 / 29926132 / +1.8% 52449704 / 49527819 / +5.9% 0.58 / 0.60 / -3.9%
tpcds_q27/datafusion:vortex-file-compressed 63580430 / 58678186 / +8.4% 89711064 / 82233912 / +9.1% 0.71 / 0.71 / -0.7%
tpcds_q28/datafusion:vortex-file-compressed 17782901 / 18015568 / -1.3% 37031475 / 37378151 / -0.9% 0.48 / 0.48 / -0.4%
tpcds_q29/datafusion:vortex-file-compressed 54655144 / 51125020 / +6.9% 82592011 / 80861622 / +2.1% 0.66 / 0.63 / +4.7%
tpcds_q30/datafusion:vortex-file-compressed 26728468 / 26560430 / +0.6% 46895800 / 42841544 / +9.5% 0.57 / 0.62 / -8.1%
tpcds_q31/datafusion:vortex-file-compressed 58577926 / 58139888 / +0.8% 82620338 / 83520677 / -1.1% 0.71 / 0.70 / +1.9%
tpcds_q32/datafusion:vortex-file-compressed 13422008 / 13677487 / -1.9% 30425302 / 29630064 / +2.7% 0.44 / 0.46 / -4.4%
tpcds_q33/datafusion:vortex-file-compressed 27780652 / 27516018 / +1.0% 50313295 / 48629287 / +3.5% 0.55 / 0.57 / -2.4%
tpcds_q34/datafusion:vortex-file-compressed 17948534 / 17480698 / +2.7% 36350289 / 33893394 / +7.2% 0.49 / 0.52 / -4.3%
tpcds_q35/datafusion:vortex-file-compressed 33752580 / 34003137 / -0.7% 57730413 / 56857490 / +1.5% 0.58 / 0.60 / -2.2%
tpcds_q36/datafusion:vortex-file-compressed 46932096 / 47892504 / -2.0% 75403447 / 70679133 / +6.7% 0.62 / 0.68 / -8.1%
tpcds_q37/datafusion:vortex-file-compressed 12347848 / 13039590 / -5.3% 32313003 / 31483474 / +2.6% 0.38 / 0.41 / -7.7%
tpcds_q38/datafusion:vortex-file-compressed 29770933 / 30268114 / -1.6% 50481355 / 49085672 / +2.8% 0.59 / 0.62 / -4.4%
tpcds_q39/datafusion:vortex-file-compressed 60723792 / 61653668 / -1.5% 92693835 / 85501239 / +8.4% 0.66 / 0.72 / -9.2%
tpcds_q40/datafusion:vortex-file-compressed 24287054 / 24117522 / +0.7% 44044678 / 42507385 / +3.6% 0.55 / 0.57 / -2.8%
tpcds_q41/datafusion:vortex-file-compressed 17318299 / 17188868 / +0.8% 31730911 / 30102009 / +5.4% 0.55 / 0.57 / -4.4%
tpcds_q42/datafusion:vortex-file-compressed 10989415 / 11179837 / -1.7% 27613927 / 26141554 / +5.6% 0.40 / 0.43 / -6.9%
tpcds_q43/datafusion:vortex-file-compressed 12787582 / 12930740 / -1.1% 31343073 / 29137482 / +7.6% 0.41 / 0.44 / -8.1%
tpcds_q44/datafusion:vortex-file-compressed 25932450 / 25912772 / +0.1% 48256719 / 45245341 / +6.7% 0.54 / 0.57 / -6.2%
tpcds_q45/datafusion:vortex-file-compressed 18360788 / 18332104 / +0.2% 37660690 / 35898738 / +4.9% 0.49 / 0.51 / -4.5%
tpcds_q46/datafusion:vortex-file-compressed 22496072 / 23096830 / -2.6% 47733632 / 43512734 / +9.7% 0.47 / 0.53 / -11.2%
tpcds_q47/datafusion:vortex-file-compressed 77057200 / 76949252 / +0.1% 107074397 / 104976505 / +2.0% 0.72 / 0.73 / -1.8%
tpcds_q48/datafusion:vortex-file-compressed 29633526 / 29942016 / -1.0% 53353497 / 50228058 / +6.2% 0.56 / 0.60 / -6.8%
tpcds_q49/datafusion:vortex-file-compressed 56056132 / 58373527 / -4.0% 82429043 / 78394893 / +5.1% 0.68 / 0.74 / -8.7%
tpcds_q50/datafusion:vortex-file-compressed 32247401 / 33039868 / -2.4% 55595713 / 51230970 / +8.5% 0.58 / 0.64 / -10.1%
tpcds_q51/datafusion:vortex-file-compressed 67415514 / 68327429 / -1.3% 91396976 / 88721206 / +3.0% 0.74 / 0.77 / -4.2%
tpcds_q52/datafusion:vortex-file-compressed 11641082 / 11785394 / -1.2% 27712322 / 26300947 / +5.4% 0.42 / 0.45 / -6.3%
tpcds_q53/datafusion:vortex-file-compressed 17667918 / 17741310 / -0.4% 39168611 / 36055529 / +8.6% 0.45 / 0.49 / -8.3%
tpcds_q54/datafusion:vortex-file-compressed 32955252 / 33193087 / -0.7% 60452878 / 57100247 / +5.9% 0.55 / 0.58 / -6.2%
tpcds_q55/datafusion:vortex-file-compressed 11416916 / 11271819 / +1.3% 27309100 / 25380268 / +7.6% 0.42 / 0.44 / -5.9%
tpcds_q56/datafusion:vortex-file-compressed 26467489 / 27000977 / -2.0% 48963043 / 47148125 / +3.8% 0.54 / 0.57 / -5.6%
tpcds_q57/datafusion:vortex-file-compressed 77861434 / 77615244 / +0.3% 103868199 / 100310111 / +3.5% 0.75 / 0.77 / -3.1%
tpcds_q58/datafusion:vortex-file-compressed 40905990 / 40933062 / -0.1% 65124058 / 64407422 / +1.1% 0.63 / 0.64 / -1.2%
tpcds_q59/datafusion:vortex-file-compressed 30887750 / 31044882 / -0.5% 53006110 / 50655448 / +4.6% 0.58 / 0.61 / -4.9%
tpcds_q60/datafusion:vortex-file-compressed 26487844 / 26980148 / -1.8% 47677611 / 45064856 / +5.8% 0.56 / 0.60 / -7.2%
tpcds_q61/datafusion:vortex-file-compressed 23347082 / 22302632 / +4.7% 45765831 / 42999231 / +6.4% 0.51 / 0.52 / -1.6%
tpcds_q62/datafusion:vortex-file-compressed 18145889 / 17982738 / +0.9% 34462933 / 32302190 / +6.7% 0.53 / 0.56 / -5.4%
tpcds_q63/datafusion:vortex-file-compressed 17512106 / 17834000 / -1.8% 40695902 / 37104256 / +9.7% 0.43 / 0.48 / -10.5%
tpcds_q64/datafusion:vortex-file-compressed 226782110 / 224131818 / +1.2% 267343585 / 266085838 / +0.5% 0.85 / 0.84 / +0.7%
tpcds_q65/datafusion:vortex-file-compressed 76187724 / 74406244 / +2.4% 95565775 / 95151269 / +0.4% 0.80 / 0.78 / +2.0%
tpcds_q66/datafusion:vortex-file-compressed 52387584 / 52393016 / -0.0% 74807623 / 71410238 / +4.8% 0.70 / 0.73 / -4.6%
tpcds_q67/datafusion:vortex-file-compressed 58433272 / 58435230 / -0.0% 87248808 / 85674975 / +1.8% 0.67 / 0.68 / -1.8%
tpcds_q68/datafusion:vortex-file-compressed 22674660 / 22335088 / +1.5% 46744955 / 44267435 / +5.6% 0.49 / 0.50 / -3.9%
tpcds_q69/datafusion:vortex-file-compressed 27092578 / 27399846 / -1.1% 49491050 / 45894508 / +7.8% 0.55 / 0.60 / -8.3%
tpcds_q70/datafusion:vortex-file-compressed 22852777 / 23151952 / -1.3% 45438095 / 43876402 / +3.6% 0.50 / 0.53 / -4.7%
tpcds_q71/datafusion:vortex-file-compressed 18812023 / 19762987 / -4.8% 39932238 / 35551115 / +12.3% 🔴 0.47 / 0.56 / -15.3%
tpcds_q72/datafusion:vortex-file-compressed 349710766 / 354706928 / -1.4% 412444031 / 396581694 / +4.0% 0.85 / 0.89 / -5.2%
tpcds_q73/datafusion:vortex-file-compressed 16074578 / 16530411 / -2.8% 35904734 / 34670921 / +3.6% 0.45 / 0.48 / -6.1%
tpcds_q74/datafusion:vortex-file-compressed 45648893 / 45955776 / -0.7% 71789521 / 69915157 / +2.7% 0.64 / 0.66 / -3.3%
tpcds_q75/datafusion:vortex-file-compressed 135899258 / 138539320 / -1.9% 158361573 / 161918323 / -2.2% 0.86 / 0.86 / +0.3%
tpcds_q76/datafusion:vortex-file-compressed 26503738 / 26647843 / -0.5% 46563691 / 45115611 / +3.2% 0.57 / 0.59 / -3.6%
tpcds_q77/datafusion:vortex-file-compressed 44640128 / 45415814 / -1.7% 67340034 / 62591959 / +7.6% 0.66 / 0.73 / -8.6%
tpcds_q78/datafusion:vortex-file-compressed 68590124 / 68079652 / +0.7% 98353174 / 94684746 / +3.9% 0.70 / 0.72 / -3.0%
tpcds_q79/datafusion:vortex-file-compressed 19841066 / 19727424 / +0.6% 42438581 / 40934213 / +3.7% 0.47 / 0.48 / -3.0%
tpcds_q80/datafusion:vortex-file-compressed 75528456 / 74248622 / +1.7% 104041198 / 102049145 / +2.0% 0.73 / 0.73 / -0.2%
tpcds_q81/datafusion:vortex-file-compressed 27418704 / 27003097 / +1.5% 45449872 / 43080032 / +5.5% 0.60 / 0.63 / -3.8%
tpcds_q82/datafusion:vortex-file-compressed 12194418 / 12354506 / -1.3% 33201742 / 33095031 / +0.3% 0.37 / 0.37 / -1.6%
tpcds_q83/datafusion:vortex-file-compressed 35269582 / 35631672 / -1.0% 56311706 / 53819376 / +4.6% 0.63 / 0.66 / -5.4%
tpcds_q84/datafusion:vortex-file-compressed 11748182 / 11622246 / +1.1% 26417790 / 24541959 / +7.6% 0.44 / 0.47 / -6.1%
tpcds_q85/datafusion:vortex-file-compressed 57268007 / 57531176 / -0.5% 82008296 / 82209078 / -0.2% 0.70 / 0.70 / -0.2%
tpcds_q86/datafusion:vortex-file-compressed 16395262 / 16753368 / -2.1% 33212522 / 31595049 / +5.1% 0.49 / 0.53 / -6.9%
tpcds_q87/datafusion:vortex-file-compressed 29319002 / 29438992 / -0.4% 51585093 / 49566954 / +4.1% 0.57 / 0.59 / -4.3%
tpcds_q88/datafusion:vortex-file-compressed 31407190 / 32085726 / -2.1% 62381919 / 60810608 / +2.6% 0.50 / 0.53 / -4.6%
tpcds_q89/datafusion:vortex-file-compressed 20581775 / 20636756 / -0.3% 41259615 / 39432556 / +4.6% 0.50 / 0.52 / -4.7%
tpcds_q90/datafusion:vortex-file-compressed 10183750 / 10199986 / -0.2% 25541841 / 25019472 / +2.1% 0.40 / 0.41 / -2.2%
tpcds_q91/datafusion:vortex-file-compressed 15638246 / 16038405 / -2.5% 37768194 / 34621916 / +9.1% 0.41 / 0.46 / -10.6%
tpcds_q92/datafusion:vortex-file-compressed 13347574 / 13551662 / -1.5% 32168039 / 29249384 / +10.0% 0.41 / 0.46 / -10.4%
tpcds_q93/datafusion:vortex-file-compressed 22095694 / 22604718 / -2.3% 40917208 / 39626744 / +3.3% 0.54 / 0.57 / -5.3%
tpcds_q94/datafusion:vortex-file-compressed 19309486 / 19361215 / -0.3% 37879555 / 35747265 / +6.0% 0.51 / 0.54 / -5.9%
tpcds_q95/datafusion:vortex-file-compressed 45384194 / 44776266 / +1.4% 64990784 / 64389249 / +0.9% 0.70 / 0.70 / +0.4%
tpcds_q96/datafusion:vortex-file-compressed 8474949 / 8300024 / +2.1% 25770019 / 23890636 / +7.9% 0.33 / 0.35 / -5.3%
tpcds_q97/datafusion:vortex-file-compressed 20937126 / 21109985 / -0.8% 43262806 / 39534303 / +9.4% 0.48 / 0.53 / -9.4%
tpcds_q98/datafusion:vortex-file-compressed 16986250 / 16917617 / +0.4% 36919368 / 34831386 / +6.0% 0.46 / 0.49 / -5.3%
tpcds_q99/datafusion:vortex-file-compressed 20804720 / 20706564 / +0.5% 38012502 / 35200562 / +8.0% 0.55 / 0.59 / -7.0%
datafusion / parquet / ns (0.998x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42734606 / 43890012 / -2.6% 60075777 / 58085919 / +3.4% 0.71 / 0.76 / -5.9%
tpcds_q02/datafusion:parquet 55375972 / 55311458 / +0.1% 70855519 / 70635554 / +0.3% 0.78 / 0.78 / -0.2%
tpcds_q03/datafusion:parquet 18937283 / 19205204 / -1.4% 32440673 / 30959837 / +4.8% 0.58 / 0.62 / -5.9%
tpcds_q04/datafusion:parquet 181634090 / 180954231 / +0.4% 208166345 / 204756864 / +1.7% 0.87 / 0.88 / -1.3%
tpcds_q05/datafusion:parquet 67804568 / 68910674 / -1.6% 90040540 / 89885895 / +0.2% 0.75 / 0.77 / -1.8%
tpcds_q06/datafusion:parquet 33753774 / 33043806 / +2.1% 46618633 / 50137263 / -7.0% 0.72 / 0.66 / +9.9%
tpcds_q07/datafusion:parquet 47824985 / 47652511 / +0.4% 67484076 / 64130645 / +5.2% 0.71 / 0.74 / -4.6%
tpcds_q08/datafusion:parquet 30885352 / 31057256 / -0.6% 46581596 / 42815557 / +8.8% 0.66 / 0.73 / -8.6%
tpcds_q09/datafusion:parquet 28855564 / 33269318 / -13.3% 🟢 38579226 / 38327534 / +0.7% 0.75 / 0.87 / -13.8%
tpcds_q10/datafusion:parquet 44990430 / 43613502 / +3.2% 59237953 / 55048819 / +7.6% 0.76 / 0.79 / -4.1%
tpcds_q11/datafusion:parquet 97958870 / 100250221 / -2.3% 123289003 / 119739028 / +3.0% 0.79 / 0.84 / -5.1%
tpcds_q12/datafusion:parquet 23660286 / 23622296 / +0.2% 36035441 / 35793094 / +0.7% 0.66 / 0.66 / -0.5%
tpcds_q13/datafusion:parquet 46808112 / 46371776 / +0.9% 70877025 / 66220331 / +7.0% 0.66 / 0.70 / -5.7%
tpcds_q14/datafusion:parquet 535443974 / 534469225 / +0.2% 585872964 / 593123627 / -1.2% 0.91 / 0.90 / +1.4%
tpcds_q15/datafusion:parquet 23324076 / 23379706 / -0.2% 38532837 / 37867823 / +1.8% 0.61 / 0.62 / -2.0%
tpcds_q16/datafusion:parquet 36759698 / 37606427 / -2.3% 52220414 / 49494614 / +5.5% 0.70 / 0.76 / -7.4%
tpcds_q17/datafusion:parquet 74268145 / 73179844 / +1.5% 98719527 / 97209166 / +1.6% 0.75 / 0.75 / -0.1%
tpcds_q18/datafusion:parquet 65231328 / 66081368 / -1.3% 91707478 / 88647051 / +3.5% 0.71 / 0.75 / -4.6%
tpcds_q19/datafusion:parquet 30028033 / 29797932 / +0.8% 44535775 / 42781751 / +4.1% 0.67 / 0.70 / -3.2%
tpcds_q20/datafusion:parquet 25408845 / 25075280 / +1.3% 38209707 / 36024876 / +6.1% 0.66 / 0.70 / -4.5%
tpcds_q21/datafusion:parquet 20218684 / 20188460 / +0.1% 35501869 / 31273842 / +13.5% 🔴 0.57 / 0.65 / -11.8%
tpcds_q22/datafusion:parquet 77399750 / 77073442 / +0.4% 89150996 / 88614172 / +0.6% 0.87 / 0.87 / -0.2%
tpcds_q23/datafusion:parquet 92578792 / 93212706 / -0.7% 113427136 / 112837716 / +0.5% 0.82 / 0.83 / -1.2%
tpcds_q24/datafusion:parquet 91942739 / 91259862 / +0.7% 114815024 / 116006193 / -1.0% 0.80 / 0.79 / +1.8%
tpcds_q25/datafusion:parquet 82368992 / 80500935 / +2.3% 103055786 / 97345522 / +5.9% 0.80 / 0.83 / -3.3%
tpcds_q26/datafusion:parquet 43770637 / 43981704 / -0.5% 60910854 / 57943229 / +5.1% 0.72 / 0.76 / -5.3%
tpcds_q27/datafusion:parquet 78616720 / 78321726 / +0.4% 99234487 / 95170755 / +4.3% 0.79 / 0.82 / -3.7%
tpcds_q28/datafusion:parquet 28580406 / 28603876 / -0.1% 43716778 / 41636187 / +5.0% 0.65 / 0.69 / -4.8%
tpcds_q29/datafusion:parquet 75458838 / 74682498 / +1.0% 98455294 / 95420003 / +3.2% 0.77 / 0.78 / -2.1%
tpcds_q30/datafusion:parquet 45909142 / 47243796 / -2.8% 59181813 / 58006019 / +2.0% 0.78 / 0.81 / -4.8%
tpcds_q31/datafusion:parquet 81755284 / 80824830 / +1.2% 100151220 / 98947533 / +1.2% 0.82 / 0.82 / -0.1%
tpcds_q32/datafusion:parquet 26065170 / 26851631 / -2.9% 41444255 / 40836100 / +1.5% 0.63 / 0.66 / -4.4%
tpcds_q33/datafusion:parquet 37161429 / 38654976 / -3.9% 56112462 / 49179060 / +14.1% 🔴 0.66 / 0.79 / -15.7%
tpcds_q34/datafusion:parquet 24619356 / 24566042 / +0.2% 36220843 / 35563142 / +1.8% 0.68 / 0.69 / -1.6%
tpcds_q35/datafusion:parquet 50056140 / 50997858 / -1.8% 63923705 / 64780675 / -1.3% 0.78 / 0.79 / -0.5%
tpcds_q36/datafusion:parquet 51764700 / 51877660 / -0.2% 74870143 / 73662951 / +1.6% 0.69 / 0.70 / -1.8%
tpcds_q37/datafusion:parquet 20648031 / 21301677 / -3.1% 34882498 / 33797003 / +3.2% 0.59 / 0.63 / -6.1%
tpcds_q38/datafusion:parquet 45377625 / 44433333 / +2.1% 59931363 / 63900736 / -6.2% 0.76 / 0.70 / +8.9%
tpcds_q39/datafusion:parquet 67872112 / 68447941 / -0.8% 84372024 / 86504577 / -2.5% 0.80 / 0.79 / +1.7%
tpcds_q40/datafusion:parquet 30171456 / 31491938 / -4.2% 51252311 / 50038180 / +2.4% 0.59 / 0.63 / -6.5%
tpcds_q41/datafusion:parquet 19651742 / 19353338 / +1.5% 33789506 / 31872596 / +6.0% 0.58 / 0.61 / -4.2%
tpcds_q42/datafusion:parquet 18350508 / 18038634 / +1.7% 32237305 / 30198006 / +6.8% 0.57 / 0.60 / -4.7%
tpcds_q43/datafusion:parquet 19372084 / 19342574 / +0.2% 32457063 / 31128463 / +4.3% 0.60 / 0.62 / -3.9%
tpcds_q44/datafusion:parquet 35865128 / 34713082 / +3.3% 49987876 / 49413652 / +1.2% 0.72 / 0.70 / +2.1%
tpcds_q45/datafusion:parquet 27949020 / 27936833 / +0.0% 44590804 / 37737428 / +18.2% 🔴 0.63 / 0.74 / -15.3%
tpcds_q46/datafusion:parquet 29662491 / 29598708 / +0.2% 46355492 / 46447797 / -0.2% 0.64 / 0.64 / +0.4%
tpcds_q47/datafusion:parquet 97908964 / 98940466 / -1.0% 121657317 / 119520780 / +1.8% 0.80 / 0.83 / -2.8%
tpcds_q48/datafusion:parquet 41995918 / 41886476 / +0.3% 58923427 / 60907589 / -3.3% 0.71 / 0.69 / +3.6%
tpcds_q49/datafusion:parquet 71610990 / 72314512 / -1.0% 96029522 / 94381759 / +1.7% 0.75 / 0.77 / -2.7%
tpcds_q50/datafusion:parquet 47936770 / 47867547 / +0.1% 68565932 / 66398776 / +3.3% 0.70 / 0.72 / -3.0%
tpcds_q51/datafusion:parquet 75893520 / 75549763 / +0.5% 94552283 / 94684762 / -0.1% 0.80 / 0.80 / +0.6%
tpcds_q52/datafusion:parquet 18869762 / 18825764 / +0.2% 32437512 / 29861393 / +8.6% 0.58 / 0.63 / -7.7%
tpcds_q53/datafusion:parquet 22290330 / 22102662 / +0.8% 39777530 / 37287705 / +6.7% 0.56 / 0.59 / -5.5%
tpcds_q54/datafusion:parquet 52414404 / 52264439 / +0.3% 73150521 / 68207985 / +7.2% 0.72 / 0.77 / -6.5%
tpcds_q55/datafusion:parquet 18208792 / 18071042 / +0.8% 33804455 / 31278180 / +8.1% 0.54 / 0.58 / -6.8%
tpcds_q56/datafusion:parquet 41637756 / 41065324 / +1.4% 54309464 / 55082849 / -1.4% 0.77 / 0.75 / +2.8%
tpcds_q57/datafusion:parquet 102781440 / 101257162 / +1.5% 119424107 / 120849110 / -1.2% 0.86 / 0.84 / +2.7%
tpcds_q58/datafusion:parquet 65370752 / 65849746 / -0.7% 84765246 / 79516020 / +6.6% 0.77 / 0.83 / -6.9%
tpcds_q59/datafusion:parquet 47732248 / 48606930 / -1.8% 65773937 / 63744606 / +3.2% 0.73 / 0.76 / -4.8%
tpcds_q60/datafusion:parquet 40657608 / 41468712 / -2.0% 57613093 / 51922195 / +11.0% 🔴 0.71 / 0.80 / -11.6%
tpcds_q61/datafusion:parquet 36607280 / 36144162 / +1.3% 52353453 / 51492514 / +1.7% 0.70 / 0.70 / -0.4%
tpcds_q62/datafusion:parquet 25158456 / 25297244 / -0.5% 38273227 / 36768878 / +4.1% 0.66 / 0.69 / -4.5%
tpcds_q63/datafusion:parquet 22236198 / 22293907 / -0.3% 38778369 / 36239539 / +7.0% 0.57 / 0.62 / -6.8%
tpcds_q64/datafusion:parquet 291518122 / 288469428 / +1.1% 330864038 / 325456313 / +1.7% 0.88 / 0.89 / -0.6%
tpcds_q65/datafusion:parquet 120103579 / 122504960 / -2.0% 140079601 / 136010238 / +3.0% 0.86 / 0.90 / -4.8%
tpcds_q66/datafusion:parquet 60404253 / 60330750 / +0.1% 78232283 / 77786187 / +0.6% 0.77 / 0.78 / -0.4%
tpcds_q67/datafusion:parquet 68515072 / 69257902 / -1.1% 92226569 / 92944734 / -0.8% 0.74 / 0.75 / -0.3%
tpcds_q68/datafusion:parquet 29892066 / 29224446 / +2.3% 49162781 / 47479747 / +3.5% 0.61 / 0.62 / -1.2%
tpcds_q69/datafusion:parquet 43665700 / 43576365 / +0.2% 55958584 / 57200284 / -2.2% 0.78 / 0.76 / +2.4%
tpcds_q70/datafusion:parquet 80653028 / 80829759 / -0.2% 99634464 / 97021737 / +2.7% 0.81 / 0.83 / -2.8%
tpcds_q71/datafusion:parquet 26449772 / 26317842 / +0.5% 37153518 / 37118194 / +0.1% 0.71 / 0.71 / +0.4%
tpcds_q72/datafusion:parquet 517461756 / 519664150 / -0.4% 550196211 / 584841214 / -5.9% 0.94 / 0.89 / +5.8%
tpcds_q73/datafusion:parquet 23733028 / 23916252 / -0.8% 36139556 / 35367753 / +2.2% 0.66 / 0.68 / -2.9%
tpcds_q74/datafusion:parquet 70435364 / 69465678 / +1.4% 84627549 / 88628953 / -4.5% 0.83 / 0.78 / +6.2%
tpcds_q75/datafusion:parquet 151482663 / 156497968 / -3.2% 184650068 / 182522475 / +1.2% 0.82 / 0.86 / -4.3%
tpcds_q76/datafusion:parquet 34528328 / 33571724 / +2.8% 47755809 / 45726813 / +4.4% 0.72 / 0.73 / -1.5%
tpcds_q77/datafusion:parquet 58131033 / 56148932 / +3.5% 75742929 / 71358894 / +6.1% 0.77 / 0.79 / -2.5%
tpcds_q78/datafusion:parquet 86802602 / 85291219 / +1.8% 117543228 / 115928497 / +1.4% 0.74 / 0.74 / +0.4%
tpcds_q79/datafusion:parquet 27125464 / 26828878 / +1.1% 42006576 / 41425210 / +1.4% 0.65 / 0.65 / -0.3%
tpcds_q80/datafusion:parquet 80128030 / 80861236 / -0.9% 111065194 / 109502009 / +1.4% 0.72 / 0.74 / -2.3%
tpcds_q81/datafusion:parquet 38272622 / 39142411 / -2.2% 51331604 / 49639555 / +3.4% 0.75 / 0.79 / -5.4%
tpcds_q82/datafusion:parquet 22338010 / 22169617 / +0.8% 35190829 / 33841389 / +4.0% 0.63 / 0.66 / -3.1%
tpcds_q83/datafusion:parquet 57847026 / 57594450 / +0.4% 75866355 / 74125029 / +2.3% 0.76 / 0.78 / -1.9%
tpcds_q84/datafusion:parquet 26494598 / 27003372 / -1.9% 42136744 / 40568821 / +3.9% 0.63 / 0.67 / -5.5%
tpcds_q85/datafusion:parquet 80461286 / 81187504 / -0.9% 104879425 / 102814807 / +2.0% 0.77 / 0.79 / -2.8%
tpcds_q86/datafusion:parquet 20590475 / 20704862 / -0.6% 34079156 / 32424211 / +5.1% 0.60 / 0.64 / -5.4%
tpcds_q87/datafusion:parquet 43916775 / 46040472 / -4.6% 59133471 / 57441631 / +2.9% 0.74 / 0.80 / -7.3%
tpcds_q88/datafusion:parquet 37373976 / 37328218 / +0.1% 52279634 / 51552834 / +1.4% 0.71 / 0.72 / -1.3%
tpcds_q89/datafusion:parquet 25789573 / 26023690 / -0.9% 43118527 / 40936254 / +5.3% 0.60 / 0.64 / -5.9%
tpcds_q90/datafusion:parquet 14404948 / 14514152 / -0.8% 28609079 / 26322249 / +8.7% 0.50 / 0.55 / -8.7%
tpcds_q91/datafusion:parquet 31725106 / 31678042 / +0.1% 47443216 / 46044485 / +3.0% 0.67 / 0.69 / -2.8%
tpcds_q92/datafusion:parquet 26905276 / 26655206 / +0.9% 41122536 / 40362357 / +1.9% 0.65 / 0.66 / -0.9%
tpcds_q93/datafusion:parquet 27815094 / 27621254 / +0.7% 46888472 / 45440763 / +3.2% 0.59 / 0.61 / -2.4%
tpcds_q94/datafusion:parquet 35354954 / 34978962 / +1.1% 49630829 / 48310891 / +2.7% 0.71 / 0.72 / -1.6%
tpcds_q95/datafusion:parquet 64858484 / 64911839 / -0.1% 78034331 / 77454165 / +0.7% 0.83 / 0.84 / -0.8%
tpcds_q96/datafusion:parquet 12550247 / 12453842 / +0.8% 24864949 / 23253368 / +6.9% 0.50 / 0.54 / -5.8%
tpcds_q97/datafusion:parquet 35590331 / 35865433 / -0.8% 52286515 / 50987399 / +2.5% 0.68 / 0.70 / -3.2%
tpcds_q98/datafusion:parquet 25387611 / 24873730 / +2.1% 38317111 / 36829473 / +4.0% 0.66 / 0.68 / -1.9%
tpcds_q99/datafusion:parquet 29688786 / 29507328 / +0.6% 42228432 / 42156658 / +0.2% 0.70 / 0.70 / +0.4%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 18163312 / 18081534 / +0.5% 28329231 / 27781144 / +2.0% 0.64 / 0.65 / -1.5%
tpcds_q02/duckdb:vortex-file-compressed 16782310 / 16556927 / +1.4% 24742284 / 24886140 / -0.6% 0.68 / 0.67 / +2.0%
tpcds_q03/duckdb:vortex-file-compressed 7878876 / 7730097 / +1.9% 17372118 / 16670189 / +4.2% 0.45 / 0.46 / -2.2%
tpcds_q04/duckdb:vortex-file-compressed 49770475 / 49498381 / +0.5% 59851135 / 58856591 / +1.7% 0.83 / 0.84 / -1.1%
tpcds_q05/duckdb:vortex-file-compressed 25226912 / 25494884 / -1.1% 33961018 / 33894449 / +0.2% 0.74 / 0.75 / -1.2%
tpcds_q06/duckdb:vortex-file-compressed 29420810 / 29381100 / +0.1% 43084694 / 42953144 / +0.3% 0.68 / 0.68 / -0.2%
tpcds_q07/duckdb:vortex-file-compressed 15180230 / 15053220 / +0.8% 26930909 / 25936629 / +3.8% 0.56 / 0.58 / -2.9%
tpcds_q08/duckdb:vortex-file-compressed 19829875 / 19683558 / +0.7% 28552299 / 28129371 / +1.5% 0.69 / 0.70 / -0.7%
tpcds_q09/duckdb:vortex-file-compressed 20225228 / 19723758 / +2.5% 31048478 / 30211629 / +2.8% 0.65 / 0.65 / -0.2%
tpcds_q10/duckdb:vortex-file-compressed 34383468 / 33930680 / +1.3% 49308966 / 47153459 / +4.6% 0.70 / 0.72 / -3.1%
tpcds_q11/duckdb:vortex-file-compressed 40398217 / 39979786 / +1.0% 49287915 / 49077608 / +0.4% 0.82 / 0.81 / +0.6%
tpcds_q12/duckdb:vortex-file-compressed 10979324 / 11117646 / -1.2% 19160403 / 18643493 / +2.8% 0.57 / 0.60 / -3.9%
tpcds_q13/duckdb:vortex-file-compressed 21941734 / 21889786 / +0.2% 36053673 / 34896211 / +3.3% 0.61 / 0.63 / -3.0%
tpcds_q14/duckdb:vortex-file-compressed 62795120 / 61834332 / +1.6% 73020922 / 72916288 / +0.1% 0.86 / 0.85 / +1.4%
tpcds_q15/duckdb:vortex-file-compressed 28063216 / 28022008 / +0.1% 35325524 / 35999845 / -1.9% 0.79 / 0.78 / +2.1%
tpcds_q16/duckdb:vortex-file-compressed 36818524 / 36960760 / -0.4% 48233737 / 47600563 / +1.3% 0.76 / 0.78 / -1.7%
tpcds_q17/duckdb:vortex-file-compressed 27134089 / 27081890 / +0.2% 43016656 / 41766602 / +3.0% 0.63 / 0.65 / -2.7%
tpcds_q18/duckdb:vortex-file-compressed 33552869 / 33751385 / -0.6% 44786236 / 43666879 / +2.6% 0.75 / 0.77 / -3.1%
tpcds_q19/duckdb:vortex-file-compressed 91110348 / 90225064 / +1.0% 101390114 / 101872861 / -0.5% 0.90 / 0.89 / +1.5%
tpcds_q20/duckdb:vortex-file-compressed 11998680 / 11614958 / +3.3% 20316657 / 20259965 / +0.3% 0.59 / 0.57 / +3.0%
tpcds_q21/duckdb:vortex-file-compressed 11227946 / 11170270 / +0.5% 24610266 / 23170470 / +6.2% 0.46 / 0.48 / -5.4%
tpcds_q22/duckdb:vortex-file-compressed 19579350 / 19526919 / +0.3% 30193680 / 29664243 / +1.8% 0.65 / 0.66 / -1.5%
tpcds_q23/duckdb:vortex-file-compressed 41515943 / 41196271 / +0.8% 53172602 / 52189301 / +1.9% 0.78 / 0.79 / -1.1%
tpcds_q24/duckdb:vortex-file-compressed 29188358 / 29588375 / -1.4% 40799355 / 41117557 / -0.8% 0.72 / 0.72 / -0.6%
tpcds_q25/duckdb:vortex-file-compressed 25379773 / 25004534 / +1.5% 40268654 / 37460315 / +7.5% 0.63 / 0.67 / -5.6%
tpcds_q26/duckdb:vortex-file-compressed 14366474 / 14358378 / +0.1% 23390804 / 23118240 / +1.2% 0.61 / 0.62 / -1.1%
tpcds_q27/duckdb:vortex-file-compressed 17632426 / 17962320 / -1.8% 30202642 / 28519861 / +5.9% 0.58 / 0.63 / -7.3%
tpcds_q28/duckdb:vortex-file-compressed 16289596 / 16396626 / -0.7% 26055959 / 25311398 / +2.9% 0.63 / 0.65 / -3.5%
tpcds_q29/duckdb:vortex-file-compressed 25191877 / 25519335 / -1.3% 40059838 / 37400158 / +7.1% 0.63 / 0.68 / -7.8%
tpcds_q30/duckdb:vortex-file-compressed 17608040 / 17390512 / +1.3% 26702537 / 25417992 / +5.1% 0.66 / 0.68 / -3.6%
tpcds_q31/duckdb:vortex-file-compressed 19798971 / 20086626 / -1.4% 29280586 / 28572620 / +2.5% 0.68 / 0.70 / -3.8%
tpcds_q32/duckdb:vortex-file-compressed 14320926 / 13976772 / +2.5% 23229862 / 22179255 / +4.7% 0.62 / 0.63 / -2.2%
tpcds_q33/duckdb:vortex-file-compressed 19493718 / 20066088 / -2.9% 28785215 / 28113823 / +2.4% 0.68 / 0.71 / -5.1%
tpcds_q34/duckdb:vortex-file-compressed 13900206 / 13733599 / +1.2% 23780559 / 23994398 / -0.9% 0.58 / 0.57 / +2.1%
tpcds_q35/duckdb:vortex-file-compressed 30627098 / 30562832 / +0.2% 42746633 / 41899959 / +2.0% 0.72 / 0.73 / -1.8%
tpcds_q36/duckdb:vortex-file-compressed 16182219 / 15712008 / +3.0% 27790502 / 26998045 / +2.9% 0.58 / 0.58 / +0.1%
tpcds_q37/duckdb:vortex-file-compressed 9978958 / 9959021 / +0.2% 25273425 / 24051384 / +5.1% 0.39 / 0.41 / -4.6%
tpcds_q38/duckdb:vortex-file-compressed 26597732 / 26342428 / +1.0% 32961871 / 32842810 / +0.4% 0.81 / 0.80 / +0.6%
tpcds_q39/duckdb:vortex-file-compressed 21606667 / 21948214 / -1.6% 32646998 / 33747543 / -3.3% 0.66 / 0.65 / +1.8%
tpcds_q40/duckdb:vortex-file-compressed 15167180 / 15465406 / -1.9% 22583715 / 22634560 / -0.2% 0.67 / 0.68 / -1.7%
tpcds_q41/duckdb:vortex-file-compressed 15875973 / 15929237 / -0.3% 24747721 / 24484767 / +1.1% 0.64 / 0.65 / -1.4%
tpcds_q42/duckdb:vortex-file-compressed 7960990 / 7825409 / +1.7% 17445749 / 16678626 / +4.6% 0.46 / 0.47 / -2.7%
tpcds_q43/duckdb:vortex-file-compressed 10764919 / 10822709 / -0.5% 20471594 / 20235268 / +1.2% 0.53 / 0.53 / -1.7%
tpcds_q44/duckdb:vortex-file-compressed 16702932 / 15760400 / +6.0% 28349422 / 28423880 / -0.3% 0.59 / 0.55 / +6.3%
tpcds_q45/duckdb:vortex-file-compressed 26177013 / 26097528 / +0.3% 34266760 / 33097662 / +3.5% 0.76 / 0.79 / -3.1%
tpcds_q46/duckdb:vortex-file-compressed 21120184 / 20956550 / +0.8% 30583566 / 30082726 / +1.7% 0.69 / 0.70 / -0.9%
tpcds_q47/duckdb:vortex-file-compressed 37887327 / 37632136 / +0.7% 47706309 / 48834248 / -2.3% 0.79 / 0.77 / +3.1%
tpcds_q48/duckdb:vortex-file-compressed 25177672 / 25078994 / +0.4% 38907713 / 38109304 / +2.1% 0.65 / 0.66 / -1.7%
tpcds_q49/duckdb:vortex-file-compressed 21861190 / 21613488 / +1.1% 36386304 / 34501064 / +5.5% 0.60 / 0.63 / -4.1%
tpcds_q50/duckdb:vortex-file-compressed 18283905 / 18114274 / +0.9% 31062772 / 30841967 / +0.7% 0.59 / 0.59 / +0.2%
tpcds_q51/duckdb:vortex-file-compressed 52304341 / 52658332 / -0.7% 60950100 / 81945689 / -25.6% 🟢 0.86 / 0.64 / +33.5%
tpcds_q52/duckdb:vortex-file-compressed 7768090 / 7778136 / -0.1% 17422262 / 16287379 / +7.0% 0.45 / 0.48 / -6.6%
tpcds_q53/duckdb:vortex-file-compressed 12671230 / 12561274 / +0.9% 22223139 / 22643732 / -1.9% 0.57 / 0.55 / +2.8%
tpcds_q54/duckdb:vortex-file-compressed 22227210 / 22160263 / +0.3% 32271616 / 31528785 / +2.4% 0.69 / 0.70 / -2.0%
tpcds_q55/duckdb:vortex-file-compressed 7577428 / 7712050 / -1.7% 16907561 / 16387252 / +3.2% 0.45 / 0.47 / -4.8%
tpcds_q56/duckdb:vortex-file-compressed 20153118 / 19915106 / +1.2% 29758414 / 28716014 / +3.6% 0.68 / 0.69 / -2.3%
tpcds_q57/duckdb:vortex-file-compressed 28189320 / 28270326 / -0.3% 36701881 / 36655945 / +0.1% 0.77 / 0.77 / -0.4%
tpcds_q58/duckdb:vortex-file-compressed 22439701 / 22417908 / +0.1% 32929419 / 31469085 / +4.6% 0.68 / 0.71 / -4.3%
tpcds_q59/duckdb:vortex-file-compressed 21352958 / 21434222 / -0.4% 30664893 / 29991204 / +2.2% 0.70 / 0.71 / -2.6%
tpcds_q60/duckdb:vortex-file-compressed 20776902 / 20752663 / +0.1% 30788463 / 30369530 / +1.4% 0.67 / 0.68 / -1.2%
tpcds_q61/duckdb:vortex-file-compressed 25723442 / 25786570 / -0.2% 36367203 / 35668632 / +2.0% 0.71 / 0.72 / -2.2%
tpcds_q62/duckdb:vortex-file-compressed 13128684 / 13234864 / -0.8% 20630825 / 20709727 / -0.4% 0.64 / 0.64 / -0.4%
tpcds_q63/duckdb:vortex-file-compressed 11882714 / 11926508 / -0.4% 21502207 / 21516430 / -0.1% 0.55 / 0.55 / -0.3%
tpcds_q64/duckdb:vortex-file-compressed 53581349 / 53237404 / +0.6% 74064400 / 72763927 / +1.8% 0.72 / 0.73 / -1.1%
tpcds_q65/duckdb:vortex-file-compressed 16585689 / 16456932 / +0.8% 26667969 / 26461837 / +0.8% 0.62 / 0.62 / +0.0%
tpcds_q66/duckdb:vortex-file-compressed 32706878 / 32505472 / +0.6% 43410812 / 43409525 / +0.0% 0.75 / 0.75 / +0.6%
tpcds_q67/duckdb:vortex-file-compressed 66117152 / 65428886 / +1.1% 75907316 / 74802876 / +1.5% 0.87 / 0.87 / -0.4%
tpcds_q68/duckdb:vortex-file-compressed 20764566 / 20793763 / -0.1% 30144512 / 30054807 / +0.3% 0.69 / 0.69 / -0.4%
tpcds_q69/duckdb:vortex-file-compressed 24356078 / 24312746 / +0.2% 40914785 / 39954680 / +2.4% 0.60 / 0.61 / -2.2%
tpcds_q70/duckdb:vortex-file-compressed 17204776 / 16943546 / +1.5% 28096726 / 27701524 / +1.4% 0.61 / 0.61 / +0.1%
tpcds_q71/duckdb:vortex-file-compressed 14503576 / 14311884 / +1.3% 24109619 / 23461782 / +2.8% 0.60 / 0.61 / -1.4%
tpcds_q72/duckdb:vortex-file-compressed 59896078 / 60012566 / -0.2% 76180032 / 74424014 / +2.4% 0.79 / 0.81 / -2.5%
tpcds_q73/duckdb:vortex-file-compressed 12563064 / 12543901 / +0.2% 23313242 / 22490738 / +3.7% 0.54 / 0.56 / -3.4%
tpcds_q74/duckdb:vortex-file-compressed 28398314 / 28022154 / +1.3% 36385945 / 35315404 / +3.0% 0.78 / 0.79 / -1.6%
tpcds_q75/duckdb:vortex-file-compressed 30180672 / 30879771 / -2.3% 42618427 / 41782651 / +2.0% 0.71 / 0.74 / -4.2%
tpcds_q76/duckdb:vortex-file-compressed 14378469 / 14306308 / +0.5% 25037128 / 23315033 / +7.4% 0.57 / 0.61 / -6.4%
tpcds_q77/duckdb:vortex-file-compressed 23526992 / 22786690 / +3.2% 33597632 / 32777696 / +2.5% 0.70 / 0.70 / +0.7%
tpcds_q78/duckdb:vortex-file-compressed 45541926 / 44752623 / +1.8% 55505794 / 55646312 / -0.3% 0.82 / 0.80 / +2.0%
tpcds_q79/duckdb:vortex-file-compressed 14627894 / 14618250 / +0.1% 23890748 / 23240309 / +2.8% 0.61 / 0.63 / -2.7%
tpcds_q80/duckdb:vortex-file-compressed 40937428 / 40040812 / +2.2% 53711605 / 51914546 / +3.5% 0.76 / 0.77 / -1.2%
tpcds_q81/duckdb:vortex-file-compressed 22828054 / 22684506 / +0.6% 30171622 / 29617865 / +1.9% 0.76 / 0.77 / -1.2%
tpcds_q82/duckdb:vortex-file-compressed 10550127 / 10702117 / -1.4% 25084893 / 24955667 / +0.5% 0.42 / 0.43 / -1.9%
tpcds_q83/duckdb:vortex-file-compressed 19917245 / 19628719 / +1.5% 26950416 / 27421849 / -1.7% 0.74 / 0.72 / +3.2%
tpcds_q84/duckdb:vortex-file-compressed 17307484 / 17034596 / +1.6% 25226980 / 24645026 / +2.4% 0.69 / 0.69 / -0.7%
tpcds_q85/duckdb:vortex-file-compressed 25850769 / 26720561 / -3.3% 40110531 / 38789929 / +3.4% 0.64 / 0.69 / -6.4%
tpcds_q86/duckdb:vortex-file-compressed 10928004 / 10691342 / +2.2% 19057589 / 19226955 / -0.9% 0.57 / 0.56 / +3.1%
tpcds_q87/duckdb:vortex-file-compressed 28095366 / 28453694 / -1.3% 36294489 / 35495536 / +2.3% 0.77 / 0.80 / -3.4%
tpcds_q88/duckdb:vortex-file-compressed 43087287 / 42463320 / +1.5% 52256381 / 53145120 / -1.7% 0.82 / 0.80 / +3.2%
tpcds_q89/duckdb:vortex-file-compressed 13416264 / 13442935 / -0.2% 23636423 / 23088017 / +2.4% 0.57 / 0.58 / -2.5%
tpcds_q90/duckdb:vortex-file-compressed 9644296 / 9917005 / -2.7% 16583348 / 17501188 / -5.2% 0.58 / 0.57 / +2.6%
tpcds_q91/duckdb:vortex-file-compressed 15445154 / 15487410 / -0.3% 22835140 / 23530233 / -3.0% 0.68 / 0.66 / +2.8%
tpcds_q92/duckdb:vortex-file-compressed 14415728 / 14472882 / -0.4% 23010165 / 23416446 / -1.7% 0.63 / 0.62 / +1.4%
tpcds_q93/duckdb:vortex-file-compressed 11491990 / 11523718 / -0.3% 26880900 / 26137003 / +2.8% 0.43 / 0.44 / -3.0%
tpcds_q94/duckdb:vortex-file-compressed 33714002 / 33434804 / +0.8% 43782095 / 44006230 / -0.5% 0.77 / 0.76 / +1.4%
tpcds_q95/duckdb:vortex-file-compressed 44801952 / 44911304 / -0.2% 54486262 / 54164010 / +0.6% 0.82 / 0.83 / -0.8%
tpcds_q96/duckdb:vortex-file-compressed 7468928 / 7202614 / +3.7% 16439314 / 15922635 / +3.2% 0.45 / 0.45 / +0.4%
tpcds_q97/duckdb:vortex-file-compressed 24592466 / 24703711 / -0.5% 33655069 / 32392529 / +3.9% 0.73 / 0.76 / -4.2%
tpcds_q98/duckdb:vortex-file-compressed 12311456 / 12559910 / -2.0% 21730966 / 21233980 / +2.3% 0.57 / 0.59 / -4.2%
tpcds_q99/duckdb:vortex-file-compressed 16089340 / 16028130 / +0.4% 24137648 / 24360571 / -0.9% 0.67 / 0.66 / +1.3%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 27712365 / 27711317 / +0.0% 35718984 / 35691204 / +0.1% 0.78 / 0.78 / -0.1%
tpcds_q02/duckdb:parquet 20069336 / 19909208 / +0.8% 26653234 / 26650808 / +0.0% 0.75 / 0.75 / +0.8%
tpcds_q03/duckdb:parquet 11342256 / 11478226 / -1.2% 18326687 / 18358912 / -0.2% 0.62 / 0.63 / -1.0%
tpcds_q04/duckdb:parquet 131696502 / 132507791 / -0.6% 143084182 / 141826643 / +0.9% 0.92 / 0.93 / -1.5%
tpcds_q05/duckdb:parquet 33015168 / 32478625 / +1.7% 38937270 / 38899995 / +0.1% 0.85 / 0.83 / +1.6%
tpcds_q06/duckdb:parquet 33183336 / 33192842 / -0.0% 44344361 / 43416043 / +2.1% 0.75 / 0.76 / -2.1%
tpcds_q07/duckdb:parquet 33657282 / 34148112 / -1.4% 43200442 / 43386917 / -0.4% 0.78 / 0.79 / -1.0%
tpcds_q08/duckdb:parquet 23499437 / 23490318 / +0.0% 29540299 / 29583404 / -0.1% 0.80 / 0.79 / +0.2%
tpcds_q09/duckdb:parquet 31534674 / 31564710 / -0.1% 36147828 / 37531858 / -3.7% 0.87 / 0.84 / +3.7%
tpcds_q10/duckdb:parquet 42208147 / 42577964 / -0.9% 51337813 / 50410154 / +1.8% 0.82 / 0.84 / -2.7%
tpcds_q11/duckdb:parquet 76067954 / 75481062 / +0.8% 84313497 / 84302767 / +0.0% 0.90 / 0.90 / +0.8%
tpcds_q12/duckdb:parquet 16529868 / 16666504 / -0.8% 22897282 / 23016593 / -0.5% 0.72 / 0.72 / -0.3%
tpcds_q13/duckdb:parquet 33653196 / 33709018 / -0.2% 44421858 / 44242762 / +0.4% 0.76 / 0.76 / -0.6%
tpcds_q14/duckdb:parquet 74231254 / 73038757 / +1.6% 79398846 / 79881748 / -0.6% 0.93 / 0.91 / +2.3%
tpcds_q15/duckdb:parquet 19193463 / 19329910 / -0.7% 26325053 / 26288329 / +0.1% 0.73 / 0.74 / -0.8%
tpcds_q16/duckdb:parquet 44776743 / 44778758 / -0.0% 52955058 / 52148797 / +1.5% 0.85 / 0.86 / -1.5%
tpcds_q17/duckdb:parquet 38839658 / 38818323 / +0.1% 46521645 / 46458874 / +0.1% 0.83 / 0.84 / -0.1%
tpcds_q18/duckdb:parquet 53016262 / 52937630 / +0.1% 61739568 / 61229889 / +0.8% 0.86 / 0.86 / -0.7%
tpcds_q19/duckdb:parquet 21370038 / 21379410 / -0.0% 29718936 / 29896075 / -0.6% 0.72 / 0.72 / +0.6%
tpcds_q20/duckdb:parquet 17599158 / 17824412 / -1.3% 23254990 / 23726590 / -2.0% 0.76 / 0.75 / +0.7%
tpcds_q21/duckdb:parquet 12712594 / 12757800 / -0.4% 20038797 / 19802969 / +1.2% 0.63 / 0.64 / -1.5%
tpcds_q22/duckdb:parquet 23064780 / 23137048 / -0.3% 30209598 / 30072760 / +0.5% 0.76 / 0.77 / -0.8%
tpcds_q23/duckdb:parquet 48281116 / 47605411 / +1.4% 55327792 / 54481385 / +1.6% 0.87 / 0.87 / -0.1%
tpcds_q24/duckdb:parquet 33974929 / 33967216 / +0.0% 42049010 / 41629503 / +1.0% 0.81 / 0.82 / -1.0%
tpcds_q25/duckdb:parquet 34892470 / 34762226 / +0.4% 43734607 / 42647752 / +2.5% 0.80 / 0.82 / -2.1%
tpcds_q26/duckdb:parquet 32343072 / 32051221 / +0.9% 40479763 / 39393006 / +2.8% 0.80 / 0.81 / -1.8%
tpcds_q27/duckdb:parquet 36723369 / 36939914 / -0.6% 46513759 / 46235118 / +0.6% 0.79 / 0.80 / -1.2%
tpcds_q28/duckdb:parquet 30277700 / 30591235 / -1.0% 37048225 / 37885131 / -2.2% 0.82 / 0.81 / +1.2%
tpcds_q29/duckdb:parquet 36962036 / 36667621 / +0.8% 46135649 / 45030615 / +2.5% 0.80 / 0.81 / -1.6%
tpcds_q30/duckdb:parquet 41563065 / 41565341 / -0.0% 51259286 / 51040740 / +0.4% 0.81 / 0.81 / -0.4%
tpcds_q31/duckdb:parquet 40437998 / 39693308 / +1.9% 48229160 / 47736426 / +1.0% 0.84 / 0.83 / +0.8%
tpcds_q32/duckdb:parquet 18301378 / 18270566 / +0.2% 25040694 / 25139632 / -0.4% 0.73 / 0.73 / +0.6%
tpcds_q33/duckdb:parquet 27313028 / 27157378 / +0.6% 33988477 / 34029115 / -0.1% 0.80 / 0.80 / +0.7%
tpcds_q34/duckdb:parquet 19219180 / 19128434 / +0.5% 27522974 / 27210682 / +1.1% 0.70 / 0.70 / -0.7%
tpcds_q35/duckdb:parquet 40678395 / 40426784 / +0.6% 50848484 / 50000778 / +1.7% 0.80 / 0.81 / -1.1%
tpcds_q36/duckdb:parquet 43188090 / 43261750 / -0.2% 53140031 / 53218492 / -0.1% 0.81 / 0.81 / -0.0%
tpcds_q37/duckdb:parquet 15423156 / 15359446 / +0.4% 23267106 / 22853540 / +1.8% 0.66 / 0.67 / -1.4%
tpcds_q38/duckdb:parquet 33670378 / 33329256 / +1.0% 38520074 / 38099017 / +1.1% 0.87 / 0.87 / -0.1%
tpcds_q39/duckdb:parquet 25793426 / 25961782 / -0.6% 33714544 / 32879876 / +2.5% 0.77 / 0.79 / -3.1%
tpcds_q40/duckdb:parquet 18999247 / 18898593 / +0.5% 25403979 / 24927774 / +1.9% 0.75 / 0.76 / -1.4%
tpcds_q41/duckdb:parquet 14457376 / 14563744 / -0.7% 22124988 / 22182406 / -0.3% 0.65 / 0.66 / -0.5%
tpcds_q42/duckdb:parquet 10924208 / 10967489 / -0.4% 18200404 / 18291422 / -0.5% 0.60 / 0.60 / +0.1%
tpcds_q43/duckdb:parquet 14077248 / 13938643 / +1.0% 21526359 / 21367725 / +0.7% 0.65 / 0.65 / +0.3%
tpcds_q44/duckdb:parquet 24942495 / 24944986 / -0.0% 30422510 / 30073118 / +1.2% 0.82 / 0.83 / -1.2%
tpcds_q45/duckdb:parquet 24323312 / 24659256 / -1.4% 32108119 / 32384993 / -0.9% 0.76 / 0.76 / -0.5%
tpcds_q46/duckdb:parquet 39501329 / 39508362 / -0.0% 48445472 / 48620235 / -0.4% 0.82 / 0.81 / +0.3%
tpcds_q47/duckdb:parquet 38269955 / 38366880 / -0.3% 45936029 / 46535084 / -1.3% 0.83 / 0.82 / +1.0%
tpcds_q48/duckdb:parquet 31742698 / 31503010 / +0.8% 41882018 / 41524778 / +0.9% 0.76 / 0.76 / -0.1%
tpcds_q49/duckdb:parquet 32675650 / 33441229 / -2.3% 41662587 / 41887131 / -0.5% 0.78 / 0.80 / -1.8%
tpcds_q50/duckdb:parquet 22386830 / 22230755 / +0.7% 29925349 / 29877788 / +0.2% 0.75 / 0.74 / +0.5%
tpcds_q51/duckdb:parquet 57483008 / 57092658 / +0.7% 64461354 / 64697213 / -0.4% 0.89 / 0.88 / +1.1%
tpcds_q52/duckdb:parquet 11034412 / 11141996 / -1.0% 18765500 / 18385940 / +2.1% 0.59 / 0.61 / -3.0%
tpcds_q53/duckdb:parquet 16011372 / 15992924 / +0.1% 23859326 / 23811490 / +0.2% 0.67 / 0.67 / -0.1%
tpcds_q54/duckdb:parquet 28736489 / 29137584 / -1.4% 37690658 / 37399213 / +0.8% 0.76 / 0.78 / -2.1%
tpcds_q55/duckdb:parquet 11123914 / 10896836 / +2.1% 18183095 / 18159305 / +0.1% 0.61 / 0.60 / +2.0%
tpcds_q56/duckdb:parquet 28750076 / 28801600 / -0.2% 36181336 / 35415588 / +2.2% 0.79 / 0.81 / -2.3%
tpcds_q57/duckdb:parquet 34763753 / 34390686 / +1.1% 41143053 / 41292770 / -0.4% 0.84 / 0.83 / +1.5%
tpcds_q58/duckdb:parquet 28353569 / 28372570 / -0.1% 35807532 / 35410315 / +1.1% 0.79 / 0.80 / -1.2%
tpcds_q59/duckdb:parquet 25924072 / 25960580 / -0.1% 33553820 / 33435703 / +0.4% 0.77 / 0.78 / -0.5%
tpcds_q60/duckdb:parquet 30788070 / 30670365 / +0.4% 37857848 / 37452560 / +1.1% 0.81 / 0.82 / -0.7%
tpcds_q61/duckdb:parquet 28067288 / 28782174 / -2.5% 33796352 / 33843396 / -0.1% 0.83 / 0.85 / -2.3%
tpcds_q62/duckdb:parquet 15327938 / 15040292 / +1.9% 21294423 / 21293387 / +0.0% 0.72 / 0.71 / +1.9%
tpcds_q63/duckdb:parquet 15378528 / 15327749 / +0.3% 23260630 / 23047071 / +0.9% 0.66 / 0.67 / -0.6%
tpcds_q64/duckdb:parquet 80721202 / 79635176 / +1.4% 92463478 / 91627704 / +0.9% 0.87 / 0.87 / +0.4%
tpcds_q65/duckdb:parquet 21994512 / 21576970 / +1.9% 28140788 / 29147739 / -3.5% 0.78 / 0.74 / +5.6%
tpcds_q66/duckdb:parquet 41611109 / 41410524 / +0.5% 49527911 / 49708579 / -0.4% 0.84 / 0.83 / +0.9%
tpcds_q67/duckdb:parquet 69362405 / 67992142 / +2.0% 78018371 / 76878468 / +1.5% 0.89 / 0.88 / +0.5%
tpcds_q68/duckdb:parquet 31579488 / 31819240 / -0.8% 41016589 / 40420800 / +1.5% 0.77 / 0.79 / -2.2%
tpcds_q69/duckdb:parquet 29810634 / 29638732 / +0.6% 39805238 / 39280273 / +1.3% 0.75 / 0.75 / -0.7%
tpcds_q70/duckdb:parquet 22382560 / 22243437 / +0.6% 30929342 / 30691298 / +0.8% 0.72 / 0.72 / -0.1%
tpcds_q71/duckdb:parquet 19724005 / 20460674 / -3.6% 27059281 / 27354501 / -1.1% 0.73 / 0.75 / -2.5%
tpcds_q72/duckdb:parquet 62173141 / 62406651 / -0.4% 71148972 / 71167690 / -0.0% 0.87 / 0.88 / -0.3%
tpcds_q73/duckdb:parquet 16736065 / 1656934 / +1.0% 24792292 / 24508892 / +1.2% 0.68 / 0.68 / -0.1%
tpcds_q74/duckdb:parquet 94113744 / 94827851 / -0.8% 101551084 / 103465956 / -1.9% 0.93 / 0.92 / +1.1%
tpcds_q75/duckdb:parquet 49073112 / 48571182 / +1.0% 57631279 / 57041719 / +1.0% 0.85 / 0.85 / -0.0%
tpcds_q76/duckdb:parquet 21633063 / 19954584 / +8.4% 27158884 / 27203095 / -0.2% 0.80 / 0.73 / +8.6%
tpcds_q77/duckdb:parquet 29601001 / 28827564 / +2.7% 36203618 / 35468783 / +2.1% 0.82 / 0.81 / +0.6%
tpcds_q78/duckdb:parquet 83756181 / 83890986 / -0.2% 93916940 / 92533336 / +1.5% 0.89 / 0.91 / -1.6%
tpcds_q79/duckdb:parquet 23905582 / 23961616 / -0.2% 32572397 / 33929629 / -4.0% 0.73 / 0.71 / +3.9%
tpcds_q80/duckdb:parquet 43163231 / 42788512 / +0.9% 50764614 / 49856012 / +1.8% 0.85 / 0.86 / -0.9%
tpcds_q81/duckdb:parquet 42387187 / 42033912 / +0.8% 52358494 / 50942342 / +2.8% 0.81 / 0.83 / -1.9%
tpcds_q82/duckdb:parquet 16482302 / 16262650 / +1.4% 24101311 / 24135658 / -0.1% 0.68 / 0.67 / +1.5%
tpcds_q83/duckdb:parquet 23983956 / 23914950 / +0.3% 30650593 / 30177266 / +1.6% 0.78 / 0.79 / -1.3%
tpcds_q84/duckdb:parquet 25154757 / 25417456 / -1.0% 31888538 / 32110972 / -0.7% 0.79 / 0.79 / -0.3%
tpcds_q85/duckdb:parquet 36515255 / 36766747 / -0.7% 45483347 / 44606730 / +2.0% 0.80 / 0.82 / -2.6%
tpcds_q86/duckdb:parquet 13802824 / 13821263 / -0.1% 20520134 / 20087215 / +2.2% 0.67 / 0.69 / -2.2%
tpcds_q87/duckdb:parquet 35461872 / 35786214 / -0.9% 41441407 / 40675508 / +1.9% 0.86 / 0.88 / -2.7%
tpcds_q88/duckdb:parquet 46727588 / 46386722 / +0.7% 51852926 / 53625928 / -3.3% 0.90 / 0.87 / +4.2%
tpcds_q89/duckdb:parquet 16260338 / 16246536 / +0.1% 24638184 / 24516273 / +0.5% 0.66 / 0.66 / -0.4%
tpcds_q90/duckdb:parquet 12059052 / 11927200 / +1.1% 18870445 / 18792526 / +0.4% 0.64 / 0.63 / +0.7%
tpcds_q91/duckdb:parquet 23969362 / 23968342 / +0.0% 32900743 / 32859432 / +0.1% 0.73 / 0.73 / -0.1%
tpcds_q92/duckdb:parquet 19535816 / 19485224 / +0.3% 27606572 / 27272511 / +1.2% 0.71 / 0.71 / -1.0%
tpcds_q93/duckdb:parquet 15980326 / 16013162 / -0.2% 23518146 / 23451558 / +0.3% 0.68 / 0.68 / -0.5%
tpcds_q94/duckdb:parquet 38599384 / 38710508 / -0.3% 46520413 / 46242138 / +0.6% 0.83 / 0.84 / -0.9%
tpcds_q95/duckdb:parquet 49960338 / 49116444 / +1.7% 55917644 / 55738902 / +0.3% 0.89 / 0.88 / +1.4%
tpcds_q96/duckdb:parquet 9570764 / 9622160 / -0.5% 16041752 / 16405408 / -2.2% 0.60 / 0.59 / +1.7%
tpcds_q97/duckdb:parquet 29669558 / 29853608 / -0.6% 36092909 / 35664900 / +1.2% 0.82 / 0.84 / -1.8%
tpcds_q98/duckdb:parquet 19406311 / 19291110 / +0.6% 27080113 / 27048653 / +0.1% 0.72 / 0.71 / +0.5%
tpcds_q99/duckdb:parquet 21047430 / 21058746 / -0.1% 27066157 / 27505402 / -1.6% 0.78 / 0.77 / +1.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR cfbd5133 vs base d270200d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +11.3%
Engines: DataFusion No clear signal (+16.1%, environment too noisy confidence) · DuckDB No clear signal (+6.7%, environment too noisy confidence)
Vortex (geomean): hot 0.945x ➖ · cold 0.923x ➖
Parquet (geomean): hot 0.849x ➖ · cold 0.927x ➖
Shifts: Parquet (control) -15.1% · Median polish -9.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.951x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 212357070 / 212704965 / -0.2% 997163268 / 1028233475 / -3.0% 0.21 / 0.21 / +2.9%
tpch_q02/datafusion:vortex-file-compressed 382595300 / 361980095 / +5.7% 682126293 / 698996216 / -2.4% 0.56 / 0.52 / +8.3%
tpch_q03/datafusion:vortex-file-compressed 387244408 / 421370754 / -8.1% 1183743423 / 1014365493 / +16.7% 0.33 / 0.42 / -21.2%
tpch_q04/datafusion:vortex-file-compressed 288500471 / 242080193 / +19.2% 447837865 / 469339106 / -4.6% 0.64 / 0.52 / +24.9%
tpch_q05/datafusion:vortex-file-compressed 425982556 / 450333710 / -5.4% 626750131 / 749843955 / -16.4% 0.68 / 0.60 / +13.2%
tpch_q06/datafusion:vortex-file-compressed 305225427 / 353025051 / -13.5% 611957338 / 515354958 / +18.7% 0.50 / 0.69 / -27.2%
tpch_q07/datafusion:vortex-file-compressed 397086865 / 434568954 / -8.6% 546799277 / 744913210 / -26.6% 0.73 / 0.58 / +24.5%
tpch_q08/datafusion:vortex-file-compressed 478797813 / 557059740 / -14.0% 764480640 / 742261447 / +3.0% 0.63 / 0.75 / -16.5%
tpch_q09/datafusion:vortex-file-compressed 432173028 / 417172218 / +3.6% 734731991 / 603638507 / +21.7% 0.59 / 0.69 / -14.9%
tpch_q10/datafusion:vortex-file-compressed 440953565 / 422279197 / +4.4% 533810912 / 688023960 / -22.4% 0.83 / 0.61 / +34.6%
tpch_q11/datafusion:vortex-file-compressed 311279956 / 300438923 / +3.6% 423848673 / 586841038 / -27.8% 0.73 / 0.51 / +43.5%
tpch_q12/datafusion:vortex-file-compressed 357663798 / 434129495 / -17.6% 570564547 / 580394698 / -1.7% 0.63 / 0.75 / -16.2%
tpch_q13/datafusion:vortex-file-compressed 141182390 / 139928779 / +0.9% 335694008 / 447264080 / -24.9% 0.42 / 0.31 / +34.4%
tpch_q14/datafusion:vortex-file-compressed 199788014 / 229581058 / -13.0% 425411039 / 391115545 / +8.8% 0.47 / 0.59 / -20.0%
tpch_q15/datafusion:vortex-file-compressed 310963568 / 602314464 / -48.4% 🟢 531214066 / 842648441 / -37.0% 🟢 0.59 / 0.71 / -18.1%
tpch_q16/datafusion:vortex-file-compressed 150388142 / 148167742 / +1.5% 273516021 / 275946299 / -0.9% 0.55 / 0.54 / +2.4%
tpch_q17/datafusion:vortex-file-compressed 329181079 / 394330297 / -16.5% 606516800 / 651886118 / -7.0% 0.54 / 0.60 / -10.3%
tpch_q18/datafusion:vortex-file-compressed 321404767 / 413873678 / -22.3% 523675505 / 540171880 / -3.1% 0.61 / 0.77 / -19.9%
tpch_q19/datafusion:vortex-file-compressed 406823780 / 383414374 / +6.1% 538302269 / 508007933 / +6.0% 0.76 / 0.75 / +0.1%
tpch_q20/datafusion:vortex-file-compressed 323232956 / 302399167 / +6.9% 464318822 / 489170024 / -5.1% 0.70 / 0.62 / +12.6%
tpch_q21/datafusion:vortex-file-compressed 506042003 / 819532916 / -38.3% 🟢 728344355 / 1063614390 / -31.5% 🟢 0.69 / 0.77 / -9.8%
tpch_q22/datafusion:vortex-file-compressed 384947179 / 165889172 / +132.1% 🔴 508645039 / 497778482 / +2.2% 0.76 / 0.33 / +127.1%
datafusion / parquet / ns (0.819x ➖, 7↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 89937817 / 123967871 / -27.5% 327522004 / 350446822 / -6.5% 0.27 / 0.35 / -22.4%
tpch_q02/datafusion:parquet 5497240784 / 5572903672 / -1.4% 6072805032 / 6167098135 / -1.5% 0.91 / 0.90 / +0.2%
tpch_q03/datafusion:parquet 269748527 / 430219825 / -37.3% 🟢 646652260 / 911680671 / -29.1% 0.42 / 0.47 / -11.6%
tpch_q04/datafusion:parquet 230941489 / 267930011 / -13.8% 421959820 / 517640204 / -18.5% 0.55 / 0.52 / +5.7%
tpch_q05/datafusion:parquet 3160716299 / 3178423785 / -0.6% 3549181395 / 3382740904 / +4.9% 0.89 / 0.94 / -5.2%
tpch_q06/datafusion:parquet 84946121 / 267189136 / -68.2% 🟢 250506247 / 310197064 / -19.2% 0.34 / 0.86 / -60.6%
tpch_q07/datafusion:parquet 3113176444 / 3032640522 / +2.7% 3672607147 / 3172685132 / +15.8% 0.85 / 0.96 / -11.3%
tpch_q08/datafusion:parquet 3308347202 / 3269220726 / +1.2% 3060024754 / 3237606549 / -5.5% 1.08 / 1.01 / +7.1%
tpch_q09/datafusion:parquet 3054766748 / 3117700608 / -2.0% 3291801367 / 3101438346 / +6.1% 0.93 / 1.01 / -7.7%
tpch_q10/datafusion:parquet 287893472 / 327910772 / -12.2% 412617685 / 566015675 / -27.1% 0.70 / 0.58 / +20.4%
tpch_q11/datafusion:parquet 5818088620 / 5727902038 / +1.6% 7854797486 / 5735500734 / +37.0% 🔴 0.74 / 1.00 / -25.8%
tpch_q12/datafusion:parquet 191191903 / 357970208 / -46.6% 🟢 390189544 / 667694851 / -41.6% 🟢 0.49 / 0.54 / -8.6%
tpch_q13/datafusion:parquet 192471191 / 374528314 / -48.6% 🟢 278738269 / 484357694 / -42.5% 🟢 0.69 / 0.77 / -10.7%
tpch_q14/datafusion:parquet 175635375 / 168818820 / +4.0% 366935052 / 302717292 / +21.2% 0.48 / 0.56 / -14.2%
tpch_q15/datafusion:parquet 3034852476 / 2748160680 / +10.4% 4362728601 / 3316732522 / +31.5% 🔴 0.70 / 0.83 / -16.0%
tpch_q16/datafusion:parquet 2716264477 / 2725711155 / -0.3% 2836574911 / 2739533498 / +3.5% 0.96 / 0.99 / -3.8%
tpch_q17/datafusion:parquet 341522960 / 488482292 / -30.1% 🟢 567179926 / 968955901 / -41.5% 🟢 0.60 / 0.50 / +19.4%
tpch_q18/datafusion:parquet 352495001 / 514372394 / -31.5% 🟢 459901720 / 708196858 / -35.1% 🟢 0.77 / 0.73 / +5.5%
tpch_q19/datafusion:parquet 165073010 / 186623654 / -11.5% 314955020 / 348394294 / -9.6% 0.52 / 0.54 / -2.2%
tpch_q20/datafusion:parquet 3320080275 / 4509579265 / -26.4% 3128404032 / 3863492283 / -19.0% 1.06 / 1.17 / -9.1%
tpch_q21/datafusion:parquet 3041100301 / 4658712573 / -34.7% 🟢 3928203787 / 5174309794 / -24.1% 0.77 / 0.90 / -14.0%
tpch_q22/datafusion:parquet 625801934 / 355462760 / +76.1% 🔴 1041347365 / 413886050 / +151.6% 🔴 0.60 / 0.86 / -30.0%
duckdb / vortex-file-compressed / ns (0.939x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 237206436 / 269532675 / -12.0% 248802673 / 321488609 / -22.6% 0.95 / 0.84 / +13.7%
tpch_q02/duckdb:vortex-file-compressed 398348297 / 430860400 / -7.5% 415459462 / 480009495 / -13.4% 0.96 / 0.90 / +6.8%
tpch_q03/duckdb:vortex-file-compressed 489198043 / 528085032 / -7.4% 469772495 / 537266075 / -12.6% 1.04 / 0.98 / +5.9%
tpch_q04/duckdb:vortex-file-compressed 299792236 / 326318368 / -8.1% 300614471 / 343706086 / -12.5% 1.00 / 0.95 / +5.0%
tpch_q05/duckdb:vortex-file-compressed 654136090 / 551517165 / +18.6% 653675534 / 626698465 / +4.3% 1.00 / 0.88 / +13.7%
tpch_q06/duckdb:vortex-file-compressed 358804384 / 368310272 / -2.6% 363211584 / 389530486 / -6.8% 0.99 / 0.95 / +4.5%
tpch_q07/duckdb:vortex-file-compressed 461289742 / 431422405 / +6.9% 505368994 / 475600297 / +6.3% 0.91 / 0.91 / +0.6%
tpch_q08/duckdb:vortex-file-compressed 660175083 / 751816815 / -12.2% 699316740 / 626350790 / +11.6% 0.94 / 1.20 / -21.4%
tpch_q09/duckdb:vortex-file-compressed 500034168 / 514992794 / -2.9% 628849040 / 519835027 / +21.0% 0.80 / 0.99 / -19.7%
tpch_q10/duckdb:vortex-file-compressed 517558256 / 576339523 / -10.2% 682905269 / 587340126 / +16.3% 0.76 / 0.98 / -22.8%
tpch_q11/duckdb:vortex-file-compressed 290281398 / 296337029 / -2.0% 306694107 / 363668597 / -15.7% 0.95 / 0.81 / +16.2%
tpch_q12/duckdb:vortex-file-compressed 516364519 / 615202903 / -16.1% 544122513 / 725719175 / -25.0% 0.95 / 0.85 / +11.9%
tpch_q13/duckdb:vortex-file-compressed 198157995 / 207987860 / -4.7% 206942319 / 328462248 / -37.0% 🟢 0.96 / 0.63 / +51.2%
tpch_q14/duckdb:vortex-file-compressed 414256949 / 262296612 / +57.9% 🔴 361737426 / 366173974 / -1.2% 1.15 / 0.72 / +59.9%
tpch_q15/duckdb:vortex-file-compressed 237689150 / 262122058 / -9.3% 302494576 / 269687182 / +12.2% 0.79 / 0.97 / -19.2%
tpch_q16/duckdb:vortex-file-compressed 220756384 / 238191424 / -7.3% 254726389 / 519000708 / -50.9% 🟢 0.87 / 0.46 / +88.8%
tpch_q17/duckdb:vortex-file-compressed 382772828 / 451028789 / -15.1% 418036135 / 439739806 / -4.9% 0.92 / 1.03 / -10.7%
tpch_q18/duckdb:vortex-file-compressed 366800259 / 450942032 / -18.7% 393901511 / 448851681 / -12.2% 0.93 / 1.00 / -7.3%
tpch_q19/duckdb:vortex-file-compressed 432714409 / 488429748 / -11.4% 544777081 / 470595226 / +15.8% 0.79 / 1.04 / -23.5%
tpch_q20/duckdb:vortex-file-compressed 453277539 / 467126927 / -3.0% 508641539 / 589351176 / -13.7% 0.89 / 0.79 / +12.4%
tpch_q21/duckdb:vortex-file-compressed 637192051 / 1010146102 / -36.9% 🟢 729151773 / 713564151 / +2.2% 0.87 / 1.42 / -38.3%
tpch_q22/duckdb:vortex-file-compressed 253041123 / 258219987 / -2.0% 293798735 / 257772289 / +14.0% 0.86 / 1.00 / -14.0%
duckdb / parquet / ns (0.880x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 171013920 / 166596147 / +2.7% 358639572 / 195112957 / +83.8% 🔴 0.48 / 0.85 / -44.2%
tpch_q02/duckdb:parquet 574258968 / 517953498 / +10.9% 572961593 / 540195426 / +6.1% 1.00 / 0.96 / +4.5%
tpch_q03/duckdb:parquet 459516106 / 643814161 / -28.6% 475398142 / 741350044 / -35.9% 🟢 0.97 / 0.87 / +11.3%
tpch_q04/duckdb:parquet 347379078 / 426774522 / -18.6% 377330082 / 466374123 / -19.1% 0.92 / 0.92 / +0.6%
tpch_q05/duckdb:parquet 658559340 / 854130144 / -22.9% 757393294 / 832114656 / -9.0% 0.87 / 1.03 / -15.3%
tpch_q06/duckdb:parquet 190757551 / 183728556 / +3.8% 305053327 / 260653654 / +17.0% 0.63 / 0.70 / -11.3%
tpch_q07/duckdb:parquet 605121570 / 650836683 / -7.0% 656624614 / 755071982 / -13.0% 0.92 / 0.86 / +6.9%
tpch_q08/duckdb:parquet 756086815 / 843300848 / -10.3% 757375768 / 885438233 / -14.5% 1.00 / 0.95 / +4.8%
tpch_q09/duckdb:parquet 637536219 / 691433694 / -7.8% 683151457 / 719420684 / -5.0% 0.93 / 0.96 / -2.9%
tpch_q10/duckdb:parquet 595972961 / 709558258 / -16.0% 660961223 / 709680924 / -6.9% 0.90 / 1.00 / -9.8%
tpch_q11/duckdb:parquet 339576604 / 310092197 / +9.5% 410632201 / 343612738 / +19.5% 0.83 / 0.90 / -8.4%
tpch_q12/duckdb:parquet 313037852 / 450769595 / -30.6% 🟢 419717617 / 527960255 / -20.5% 0.75 / 0.85 / -12.6%
tpch_q13/duckdb:parquet 341012062 / 469195971 / -27.3% 536262474 / 462687012 / +15.9% 0.64 / 1.01 / -37.3%
tpch_q14/duckdb:parquet 333280582 / 377773981 / -11.8% 382603271 / 465140325 / -17.7% 0.87 / 0.81 / +7.3%
tpch_q15/duckdb:parquet 244287178 / 276219747 / -11.6% 305593825 / 299876090 / +1.9% 0.80 / 0.92 / -13.2%
tpch_q16/duckdb:parquet 380198192 / 345646937 / +10.0% 410425706 / 356632189 / +15.1% 0.93 / 0.97 / -4.4%
tpch_q17/duckdb:parquet 384602756 / 329660174 / +16.7% 378631447 / 388646116 / -2.6% 1.02 / 0.85 / +19.8%
tpch_q18/duckdb:parquet 427678623 / 665031993 / -35.7% 🟢 479046232 / 553654047 / -13.5% 0.89 / 1.20 / -25.7%
tpch_q19/duckdb:parquet 301521943 / 342828451 / -12.0% 348671148 / 478856903 / -27.2% 0.86 / 0.72 / +20.8%
tpch_q20/duckdb:parquet 562765851 / 523109073 / +7.6% 630226788 / 541952131 / +16.3% 0.89 / 0.97 / -7.5%
tpch_q21/duckdb:parquet 525478574 / 619730963 / -15.2% 577208654 / 723330640 / -20.2% 0.91 / 0.86 / +6.3%
tpch_q22/duckdb:parquet 327263378 / 529979476 / -38.2% 🟢 461645659 / 840327052 / -45.1% 🟢 0.71 / 0.63 / +12.4%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

action/bench-spatial Run only SpatialBench SQL benchmarks on this PR changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants