[SOLR-15329] Improve hdfs directory size calculation

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 9.0
• Assignee: Mike Drob
• Reporter: Andras Salamon
• Created: 09/Apr/21 08:59
• Updated: 12/May/22 00:26
• Resolved: 22/Apr/21 19:42

Description

The current implementation of directory size calculation checks the size of the files one by one which can be very slow on HDFS.

It seems to me, this was sped up in SOLR-9204 but later SOLR-3990 changed it back to the old implementation.

Issue Links

• links to: GitHub Pull Request #67