You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Feature] Support predicate pushdown and optimize selective reads for Vortex #567
I searched the issue tracker. The parent issue tracks overall Vortex format support.
Motivation
Track the Vortex read optimizations proposed in #319. Native scans can apply supported filters, projections, and bitmap selections before materializing data for the C++ reader.
Solution
Push supported comparisons, null checks, and IN / NOT IN predicates into Vortex scans. Preserve physical file row IDs and retain candidate rows for residual filtering when pushdown is unsafe.
Support per-reader limits for membership pushdown and I/O coalescing. Bound Arrow batch materialization for selective reads.
Cover predicate conversion, projections, bitmap selections, row IDs, and residual filtering with Vortex file and table read tests.
Anything else?
Implementation is in #553, continuing the work from #471.
Activity