[PIG-3666] Fix store after load

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: tez-branch
• Component/s: tez
• Patch Info: Patch Available
• Hadoop Flags: Reviewed
• Assignee: Daniel Dai
• Reporter: Daniel Dai
• Created: 14/Jan/14 22:41
• Updated: 21/Nov/14 05:59
• Resolved: 14/Jan/14 23:00

Description

Several e2e test fail share the following pattern:

.....
store into 'afile';
a = load 'afile';
......

Stack:
Caused by: java.lang.NullPointerException
at org.apache.pig.impl.plan.OperatorPlan.checkInPlan(OperatorPlan.java:435)
at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:173)
at org.apache.pig.backend.hadoop.executionengine.tez.TezCompiler.compile(TezCompiler.java:328)
at org.apache.pig.backend.hadoop.executionengine.tez.TezCompiler.compile(TezCompiler.java:337)
at org.apache.pig.backend.hadoop.executionengine.tez.TezCompiler.compile(TezCompiler.java:337)
at org.apache.pig.backend.hadoop.executionengine.tez.TezCompiler.compile(TezCompiler.java:215)
at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.compile(TezLauncher.java:152)
at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.launchPig(TezLauncher.java:72)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:344)
... 16 more

It needs to break into two DAGs since the second DAG expect hdfs input produced by the first DAG.

Example of such e2e test failures are: Casts_[1-6]