You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@mikemccand mentioned it would be I'd good to have a tooling to measure/benchmark the overall quantization error for a given index or vector dataset. It could go over each float to check the induced error converting float -> quantized half/full byte -> float (rescaled value) the induced error and report the average induced quantization error/noise. Maybe also also playing with the confidenceInterval values and plot some nice looking charts?
The text was updated successfully, but these errors were encountered:
KnnGraphTester.java already reports some interesting stats about the HNSW graph ... maybe it could also measure/aggregate/report the quantization error?
@mikemccand mentioned it would be I'd good to have a tooling to measure/benchmark the overall quantization error for a given index or vector dataset. It could go over each float to check the induced error converting
float
-> quantizedhalf/full byte
->float
(rescaled value) the induced error and report the average induced quantization error/noise. Maybe also also playing with theconfidenceInterval
values and plot some nice looking charts?The text was updated successfully, but these errors were encountered: