Optimize upsert performance for large datasets - #2943

Closed

EnyMan wants to merge 9 commits into

apache:mainfrom

EnyMan:upsert-optimization

Commits on Jan 22, 2026

feat: Optimize upsert process with coarse match filter and vectorized comparisons
EnyMan
committed
a947f0a
feat: Enhance vectorized comparison to handle struct-level nulls and empty structs
EnyMan
committed
4ab5c93
feat: Optimize insert filtering in upsert process using anti-join for matched keys
EnyMan
committed
db39b67
feat: Further optimize the filter for big datasets
EnyMan
committed
e36d994
refactor: Improve code readability with consistent formatting
EnyMan
committed
902fdc3
test: Add type assertions for `Reference` in upsert filter tests
EnyMan
committed
8123826
refactor: Remove redundant imports in upsert filter tests
EnyMan
committed
e605971
refactor: reformated
EnyMan
committed
1d6dad1

Commits on Feb 20, 2026

Merge branch 'main' into upsert-optimization
Fokko
authored
ed0f72f