[PIG-4832] Fix TestPrumeColumn NPE failure

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: spark-branch, 0.16.0
• Hadoop Flags: Reviewed
• Assignee: liyunzhang
• Reporter: liyunzhang
• Created: 08/Mar/16 08:04
• Updated: 08/Jun/16 20:48
• Resolved: 21/Mar/16 21:11

Description

ant clean -Dtestcase=TestPruneColumn -Dexectype=mr -Dhadoopversion=23 test

following tests fail:
testSharedSchemaObject
testMapKey4

Error message:

Testcase: testSharedSchemaObject took 0.133 sec
        Caused an ERROR 
Unable to open iterator for alias C
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias C
        at org.apache.pig.PigServer.openIterator(PigServer.java:957)
        at org.apache.pig.test.TestPruneColumn.testSharedSchemaObject(TestPruneColumn.java:1660)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias C
        at org.apache.pig.PigServer.storeEx(PigServer.java:1060)
        at org.apache.pig.PigServer.store(PigServer.java:1019)
        at org.apache.pig.PigServer.openIterator(PigServer.java:932)
Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 0: java.lang.NullPointerException
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:310)
        at org.apache.pig.PigServer.launchPlan(PigServer.java:1412)
        at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1397)
        at org.apache.pig.PigServer.storeEx(PigServer.java:1056)
Caused by: java.lang.NullPointerException
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.getNextTuple(POStore.java:164)
        at org.apache.pig.backend.hadoop.executionengine.fetch.FetchLauncher.runPipeline(FetchLauncher.java:157)
        at org.apache.pig.backend.hadoop.executionengine.fetch.FetchLauncher.launchPig(FetchLauncher.java:81)
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:302)

Testcase: testMapKey4 took 0.127 sec
        Caused an ERROR
Unable to open iterator for alias C
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias C
        at org.apache.pig.PigServer.openIterator(PigServer.java:957)
        at org.apache.pig.test.TestPruneColumn.testMapKey4(TestPruneColumn.java:1242)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias C
        at org.apache.pig.PigServer.storeEx(PigServer.java:1060)
        at org.apache.pig.PigServer.store(PigServer.java:1019)
        at org.apache.pig.PigServer.openIterator(PigServer.java:932)
Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 0: java.lang.NullPointerException
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:310)
        at org.apache.pig.PigServer.launchPlan(PigServer.java:1412)
        at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1397)
        at org.apache.pig.PigServer.storeEx(PigServer.java:1056)
Caused by: java.lang.NullPointerException
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.getNextTuple(POStore.java:164)
        at org.apache.pig.backend.hadoop.executionengine.fetch.FetchLauncher.runPipeline(FetchLauncher.java:157)
        at org.apache.pig.backend.hadoop.executionengine.fetch.FetchLauncher.launchPig(FetchLauncher.java:81)
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:302)

The reason why they fail is because POStore#sDecorator is null in some cases.

Issue Links

• duplicates: PIG-4831 Fix TestPruneColumn tests