[PIG-4635] NPE while running pig script in tez mode( pig 0.15 with tez 0.7)

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.15.0
• Fix Version/s: 0.16.0, 0.15.1

Environment

Pig: 0.15
Tez: 0.7

• Hadoop Flags: Reviewed
• Assignee: Daniel Dai
• Reporter: Sachin Sabbarwal
• Created: 21/Jul/15 07:22
• Updated: 08/Jun/16 20:48
• Resolved: 25/Sep/15 17:45

Description

I was trying to run (attached) pig script on pig 0.15 in tez mode(with tez 0.7).
I got following NullPointerException. I tried to send a mail to tez user mailing list and was asked to file a jira for this.
Here is the NPE:

5 org.apache.pig.impl.plan.VisitorException: ERROR 0: java.lang.NullPointerException
6 at org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer.ParallelismSetter.visitTezOp(ParallelismSetter.java:201)
7 at org.apache.pig.backend.hadoop.executionengine.tez.plan.TezOperator.visit(TezOperator.java:246)
8 at org.apache.pig.backend.hadoop.executionengine.tez.plan.TezOperator.visit(TezOperator.java:53)
9 at org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:87)
10 at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:46)
11 at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.processLoadAndParallelism(TezLauncher.java:449)
12 at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.launchPig(TezLauncher.java:163)
13 at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:304)
14 at org.apache.pig.PigServer.launchPlan(PigServer.java:1390)
15 at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1375)
16 at org.apache.pig.PigServer.execute(PigServer.java:1364)
17 at org.apache.pig.PigServer.executeBatch(PigServer.java:415)
18 at org.apache.pig.PigServer.executeBatch(PigServer.java:398)
19 at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:171)
20 at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:234)
21 at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
22 at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
23 at org.apache.pig.Main.run(Main.java:502)
24 at org.apache.pig.Main.main(Main.java:177)
25 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
26 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
27 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
28 at java.lang.reflect.Method.invoke(Method.java:606)
29 at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
30 Caused by: java.lang.NullPointerException
31 at org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer.TezOperDependencyParallelismEstimator.estimateParallelism(TezOperDependencyParallelismEstimator.java:114)
32 at org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer.ParallelismSetter.visitTezOp(ParallelismSetter.java:138)
33 ... 23 more