Draft: Add single-query many-doc bulk scoring API to VectorUtilSupport (#16556) - #16640
CH-Abhinav wants to merge 2 commits into
Conversation
|
I went ahead and implemented off-heap path to while doing so I did following:-
If everyone is okay with this implementation pipeline then i will go ahead and implement the remaining similarity functions like |
|
Thanks @CH-Abhinav, this looks like the right path to me. I think we should also add equivalent functions to |
|
thanks for the review @kaivalnp I will continue working on PR But regarding So should I do C-library implementations and the FFI calling in this PR or just do SIMD layer and see about native layer later? |
Description
This is Draft PR addressing #16556 and subsequently progressing #15155
This PR is trying to move bulk scoring API down to
VectorUtilSupportlayer, allowing thePanamaVectorUtilSupportto see bulk operations.Current progress (float32 dot product):
void dotProductBulk(float[] query, float[][] docs, float[] results)toVectorUtilSupport.DefaultVectorUtilSupportand pass-through toNativeVectorUtilSupport.PanamaVectorUtilSupportNext steps:
RandomVectorScorerto consume the newVectorUtil.dotProductBulk()method to prove the end-to-end integration.