Description
Especially on non-SSD hard drives the TarMK cleanup can be quite expensive given the way it traverses the segment graph by stepping backwards through the tar files. We could considerably speed up the operation by keeping the precompiled graph of all segments within a tar file along with the index that stores the segment locations.
Attachments
Issue Links
- relates to
-
OAK-2723 FileStore does not scale because of precomputed graph on TarReader
- Closed