[HIVE-21698] TezSessionState#ensureLocalResources() causes IndexOutOfBoundsException while localizing resources

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.1
• Fix Version/s: 4.0.0, 4.0.0-alpha-1
• Component/s: Query Processor, Tez
• Assignee: Naresh P R
• Reporter: Shubham Chaurasia
• Created: 07/May/19 04:21
• Updated: 22/Mar/22 08:55
• Resolved: 23/Aug/19 15:48

Description

The cause of exception is due to this loops over newFilesNotFromConf and tries to access newResources.get in that.

Size of newResources is determined by utils.localizeTempFiles() here which may return a smaller list depending upon the skipFilesFromConf and this would result in newResources.size() < newFilesNotFromConf.length causing IndexOutOfBounds.