[PIG-3672] Pig should not check for hardcoded file system implementations

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.0, 0.12.0, 0.11.1
• Fix Version/s: 0.13.0
• Component/s: data, parser
• Hadoop Flags: Reviewed
• Assignee: Rohini Palaniswamy
• Reporter: Suhas Satish
• Created: 16/Jan/14 23:30
• Updated: 07/Jul/14 18:07
• Resolved: 30/Apr/14 14:01

Description

QueryParserUtils.java has the code -
result.add("hdfs://"thisHost":"+uri.getPort());

I propose to make it generic like -
result.add(uri.getScheme() + "://"thisHost":"+uri.getPort());

Similarly jobControlCompiler.java has -
if (!outputPathString.contains("://") || outputPathString.startsWith("hdfs://")) {

I have a patch version which I ran passing unit tests on. Will be uploading it shortly.

Issue Links

• incorporates: PIG-3796 PigStats output bytes written not collected for relative paths