[PIG-3592] Should not try to create success file for non-fs schemes like hbase

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.11.1
• Fix Version/s: 0.12.1, 0.13.0
• Hadoop Flags: Reviewed
• Assignee: Rohini Palaniswamy
• Reporter: Rohini Palaniswamy
• Created: 27/Nov/13 18:15
• Updated: 15/Apr/14 20:45
• Resolved: 18/Dec/13 23:28

Description

Having mapreduce.fileoutputcommitter.marksuccessfuljobs set to true and having both fs path (where you want _SUCCESS file created) and hbase in STORE statements results in

Caused by: java.io.IOException: No FileSystem for scheme: hbase
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2157)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:85)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2194)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2176)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:306)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:194)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.createSuccessFile(MapReduceLauncher.java:651)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:434)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1283)