[MAPREDUCE-1806] CombineFileInputFormat does not work with paths not on default FS

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.22.0, 0.23.1
• Fix Version/s: 1.2.0, 2.0.3-alpha, 0.23.5
• Component/s: harchive
• Hadoop Flags: Reviewed
• Assignee: Gera Shegalov
• Reporter: Paul Yang
• Created: 20/May/10 21:48
• Updated: 17/Apr/13 21:43
• Resolved: 30/Oct/12 05:52

Description

In generating the splits in CombineFileInputFormat, the scheme and authority are stripped out. This creates problems when trying to access the files while generating the splits, as without the har:/, the file won't be accessed through the HarFileSystem.

Issue Links

• duplicates: MAPREDUCE-2704 CombineFileInputFormat only works when paths are on the default filesystem
• is related to: MAPREDUCE-5161 Merge MAPREDUCE-1806 from branch-1 to branch-1-win. CombineFileInputFormat fix for paths not on default FS
• relates to: HIVE-3025 Fix Hive ARCHIVE command on 0.22 and 0.23