There is a plan to make the bloom filter persistent, @clement is working on it:
But I agree, it should be considered to delete the files during the walk. The IO pressure can be more balanced with this approach (instead of a higher spike at the end).
There is a plan to make the bloom filter persistent, @clement is working on it:
But I agree, it should be considered to delete the files during the walk. The IO pressure can be more balanced with this approach (instead of a higher spike at the end).