Skip to content

feat(global-index): add bitmap-legacy index based on bitmap file index - #550

Draft
lxy-9602 wants to merge 2 commits into
apache:mainfrom
lxy-9602:sr-test
Draft

lxy-9602 wants to merge 2 commits into
apache:mainfrom
lxy-9602:sr-test

Conversation

@lxy-9602

Copy link
Copy Markdown
Member

Purpose

Add bitmap-legacy as a global index type by wrapping the existing bitmap file index with the global index reader and writer adapters.

This supports unsorted input and writes one index file per shard. Queries support equality, inequality, IN, NOT IN, and null checks, reusing the existing global index framework for row-ID offsets and merging shard results.

Tests

  • Add factory coverage for bitmap-legacy.
  • Add an integration test that writes and commits four shards using bitmap file index formats v1 and v2, then verifies:
    • Queries across shards and global row-ID offsets.
    • Duplicate values, missing values, nulls, and an all-null shard.
    • Shard pruning with requested row ranges.
    • Unsupported predicates returning no index result.
    • Predicate evaluation followed by reading matching table rows.

API and Format

No public API changes. Adds the bitmap-legacy identifier and reuses the existing bitmap file index v1/v2 formats.

Documentation

Document the new index type, supported predicates, shard behavior, and file index options in the global index user guide.

Generative AI tooling

Generated-by: OpenAI Codex (GPT-6)

@lxy-9602
lxy-9602 marked this pull request as draft November 11, 2026 13:24

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant