[PIG-279] Local Pig does not parse globs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.1.0
• Fix Version/s: 0.1.0
• Component/s: impl

Environment

Apache Pig version 0.1.0-dev (r7474)
compiled May 30 2008, 10:21:51

• Assignee: Unassigned
• Reporter: Ian Atha
• Created: 23/Jun/08 21:27
• Updated: 02/May/13 02:29
• Resolved: 24/Jun/08 13:35

Description

The following Pig commands:
===
A = load '/homes/thatha/toy-stats-*' using PigStorage();
dump A;
===
when executed in ``pig -x local'' does not execute properly, unlike pig running on a Hadoop cluster.

It appears that the pig -x local implementation does not support globs.

Caused by: java.io.FileNotFoundException: /homes/thatha/toy-stats-* (No such file or directory)

2008-06-23 20:48:10,599 [main] ERROR org.apache.pig.tools.grunt.GruntParser - java.io.IOException: Unable to open iterator for alias: A
at org.apache.pig.impl.util.WrappedIOException.wrap(WrappedIOException.java:16)
at org.apache.pig.PigServer.openIterator(PigServer.java:343)
at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:265)
at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:162)
at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:73)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:54)
at org.apache.pig.Main.main(Main.java:270)
Caused by: org.apache.pig.backend.executionengine.ExecException: java.io.FileNotFoundException: /homes/thatha/toy-stats-* (No such file or directory)
at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:136)
at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:27)
at org.apache.pig.PigServer.optimizeAndRunQuery(PigServer.java:413)
at org.apache.pig.PigServer.openIterator(PigServer.java:332)
... 5 more
Caused by: java.io.FileNotFoundException: /homes/thatha/toy-stats-* (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:106)
at java.io.FileInputStream.<init>(FileInputStream.java:66)
at org.apache.pig.impl.io.FileLocalizer.open(FileLocalizer.java:217)
at org.apache.pig.backend.local.executionengine.POLoad.open(POLoad.java:69)
at org.apache.pig.backend.local.executionengine.LocalExecutionEngine.execute(LocalExecutionEngine.java:126)
... 8 more

Issue Links

• is depended upon by: PIG-252 Allow multiple paths in the load statement