This repository has been archived by the owner on Aug 2, 2022. It is now read-only.
Re-write adding footer logic to prevent unnecessary file copying #330
Labels
Enhancements
Improvement on existing component
In order for Lucene to be able to handle the ".hnsw" files correctly, we need to add a footer to the end of them after the graphs are created. Originally, we just copy the data from a temporary file with the graph to a Lucene OutputIndex and then write the footer here.
This copy may not be necessary if we add the footer to the file ourselves:
This could potentially save time during index/merge operations. How much time would need to be checked via testing. Additionally, we would need to test to make sure this is fault tolerant and does not produce any corruptions.
The text was updated successfully, but these errors were encountered: