Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE]Enhancement of nested field query by avoiding copying of parent filter to int array #2217

Open
heemin32 opened this issue Oct 16, 2024 · 1 comment
Open

[FEATURE]Enhancement of nested field query by avoiding copying of parent filter to int array #2217

heemin32 opened this issue Oct 16, 2024 · 1 comment
Labels
enhancement Roadmap:Vector Database/GenAI Project-wide roadmap label

Comments

@heemin32
Copy link
Collaborator

For nested field, OpenSearch convert parent filter bitset to int array before passing it to JNI layer. https://github.com/opensearch-project/k-NN/blob/main/src/main/java/org/opensearch/knn/index/query/KNNWeight.java#L190C19-L190C36

We might be able to use the bitset directly from faiss engine without converting its format. This could save the both cpu and memory usage.
@heemin32 heemin32 added Roadmap:Vector Database/GenAI Project-wide roadmap label and removed untriaged labels Oct 16, 2024
@luyuncheng
Copy link
Collaborator

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement Roadmap:Vector Database/GenAI Project-wide roadmap label
Projects
Vector Search RoadMap
Status: Backlog
Milestone
No milestone
Development

No branches or pull requests
2 participants
@heemin32 @luyuncheng