[HIVE-2309] Incorrect regular expression for extracting task id from filename

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.7.1
• Fix Version/s: 0.8.0
• Component/s: Query Processor
• Assignee: Paul Yang
• Reporter: Paul Yang
• Created: 26/Jul/11 22:11
• Updated: 26/Jan/14 17:22
• Resolved: 27/Jul/11 23:23

Description

For producing the correct filenames for bucketed tables, there is a method in Utilities.java that extracts out the task id from the filename and replaces it with the bucket number. There is a bug in the regex that is used to extract this value for attempt numbers >= 10:

>>> re.match("^.*?([0-9]+)(_[0​-9])?(\\..*)?$", 'attempt_201107090429_6496​5_m_001210_10').group(1)
'10'
>>> re.match("^.*?([0-9]+)(_[0​-9])?(\\..*)?$", 'attempt_201107090429_6496​5_m_001210_9').group(1)
'001210'

Issue Links

• relates to: HIVE-6309 Hive incorrectly removes TaskAttempt output files if MRAppMaster fails once