Skip to content

[SVS] Add TopKSearchDuringUpdate SVS benchmark#993

Open
rfsaliev wants to merge 1 commit into
mainfrom
rfsaliev/bm-topk-on-update
Open

[SVS] Add TopKSearchDuringUpdate SVS benchmark#993
rfsaliev wants to merge 1 commit into
mainfrom
rfsaliev/bm-topk-on-update

Conversation

@rfsaliev

@rfsaliev rfsaliev commented Jul 10, 2026

Copy link
Copy Markdown
Collaborator

Add benchmark for TopK searches during SVS backend index update

Which issues this PR fixes

  1. #...
  2. MOD...

Main objects this PR modified

  1. ...
  2. ...

Mark if applicable

  • This PR introduces API changes
  • This PR introduces serialization changes

Note

Low Risk
Benchmark-only changes with no API, serialization, or production VecSim logic modifications.

Overview
Adds a new BM_TopKSearchDuringUpdate SVS benchmark to measure real time while parallel TopK queries run alongside a tiered index background update (flat buffer → SVS backend).

The harness pre-fills the flat buffer to one vector below update_threshold, then on each iteration triggers the update with one AddVector, launches n_parallel_searches threads each calling VecSimIndex_TopKQuery (fixed k=100, window_size=200), joins them, and waits for the mock thread pool to finish the update. Benchmark args sweep update_threshold (block size / 5k / 10× block), 10 vs 50 concurrent searches, and 2 vs 4 index thread-pool threads; registration is wired in the fp32 SVS basics init header like the existing tiered benchmarks.

Reviewed by Cursor Bugbot for commit 3110ad0. Bugbot is set up for automated code reviews on this repo. Configure here.

@codecov

codecov Bot commented Jul 10, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 97.10%. Comparing base (6ca08ae) to head (3110ad0).

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #993   +/-   ##
=======================================
  Coverage   97.10%   97.10%           
=======================================
  Files         141      141           
  Lines        8179     8179           
=======================================
  Hits         7942     7942           
  Misses        237      237           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant