[HIVE-22609] Reduce number of FS getFileStatus calls in AcidUtils::getHdfsDirSnapshots

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Target Version/s: 4.0.0
• Assignee: Rajesh Balamohan Assign to me
• Reporter: Rajesh Balamohan
• Created: 10/Dec/19 04:03
• Updated: 17/Nov/22 08:50
• Resolved: 07/Jan/20 23:11

Description

https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java#L1380

ACID delta folder contains _orc_acid_version and bucket_00000 files. For both these files, parent dir is the same. Number of getFileStatus in such cases should be reduced by 1/2.