[PIG-2302] Exception from ILLUSTRATE on FILTER with UDF

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.9.0
• Assignee: Daniel Dai
• Reporter: Doug Daniels
• Created: 23/Sep/11 22:50
• Updated: 26/Oct/11 21:54
• Resolved: 26/Oct/11 21:54

Description

Running ILLUSTRATE on the tutorial script1-hadoop.pig throws the Exception:

2011-09-23 18:43:49,148 [main] ERROR org.apache.pig.pen.AugmentBaseDataVisitor - Error visiting Load during Augmentation phase of Example Generator! Unknown operator in filter predicate
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 0: Error visiting Load during Augmentation phase of Example Generator! Unknown operator in filter predicate
	at org.apache.pig.pen.AugmentBaseDataVisitor.visit(AugmentBaseDataVisitor.java:514)
	at org.apache.pig.newplan.logical.relational.LOFilter.accept(LOFilter.java:64)
	at org.apache.pig.pen.util.PreOrderDepthFirstWalker.depthFirst(PreOrderDepthFirstWalker.java:82)
	at org.apache.pig.pen.util.PreOrderDepthFirstWalker.depthFirst(PreOrderDepthFirstWalker.java:84)
	at org.apache.pig.pen.util.PreOrderDepthFirstWalker.walk(PreOrderDepthFirstWalker.java:66)
	at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
	at org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:180)
	at org.apache.pig.PigServer.getExamples(PigServer.java:1258)
	at org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java:698)
	at org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigScriptParser.java:591)
	at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:306)
	at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
	at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
	at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
	at org.apache.pig.Main.run(Main.java:456)
	at org.apache.pig.Main.main(Main.java:108)

I believe it's happening for the first FILTER statement that uses a UDF:

  clean1 = FILTER raw BY org.apache.pig.tutorial.NonURLDetector(query);