[PIG-1685] Pig is unable to handle counters for glob paths ?

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.8.0
• Component/s: impl
• Hadoop Flags: Reviewed
• Assignee: Daniel Dai
• Reporter: Mridul Muralidharan
• Created: 18/Oct/10 18:21
• Updated: 17/Dec/10 22:46
• Resolved: 20/Oct/10 18:12

Description

We get the following exception, which seems to be related to processing counters per path :

java.net.URISyntaxException: Illegal character in path at index 71: $path_prefix/20100830_cdxcore_10.7_

{00,01,02,03,04,05,06,07,08}.bz2
at java.net.URI$Parser.fail(URI.java:2809)
at java.net.URI$Parser.checkChars(URI.java:2982)
at java.net.URI$Parser.parseHierarchical(URI.java:3066)
at java.net.URI$Parser.parse(URI.java:3024)
at java.net.URI.<init>(URI.java:578)
at org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
at org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
at org.apache.pig.PigServer.execute(PigServer.java:1189)
at org.apache.pig.PigServer.access$100(PigServer.java:127)
at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
at org.apache.pig.Main.run(Main.java:498)
at org.apache.pig.Main.main(Main.java:107)




It results is (notice -1) among others:

Input(s):
Successfully read -1 records from: "$path_prefix/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}

.bz2"

Thankfully, there is no direct functional impact except for inability to depend on counters.