Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix for gh#14110: stablize BpVectorReordered heuristic #14117

Merged
merged 1 commit into from
Jan 9, 2025

Conversation

msokolov
Copy link
Contributor

@msokolov msokolov commented Jan 8, 2025

It turned out that the initial shuffled order resulted in a left / right split with centroids that were very close together, the heuristic would terminate without doing any swaps, causing the test to fail. The test assumes that at least one swap will happen in the first iteration level. I changed the heuristic to be based on the size of the difference between the two centroids rather than the sum of their sizes.

@msokolov
Copy link
Contributor Author

msokolov commented Jan 8, 2025

BTW this also fixed failures like this one:

FAILED:  org.apache.lucene.misc.index.TestBpVectorReorderer.testQuantizedIndex

Error Message:
java.lang.AssertionError: out of order at 18

Stack Trace:
java.lang.AssertionError: out of order at 18
        at __randomizedtesting.SeedInfo.seed([CC2D27D6F33B8476:7613F311A04F402E]:0)

@msokolov msokolov merged commit b7c7fe0 into apache:main Jan 9, 2025
5 checks passed
@msokolov msokolov deleted the gh-14110 branch January 9, 2025 21:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant