[HIVE-8887] Investigate test failures on auto_join6, auto_join7, auto_join18, auto_join18_multi_distinct [Spark Branch]

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: spark-branch
• Fix Version/s: 1.1.0
• Component/s: Spark
• Assignee: Chao Sun
• Reporter: Chao Sun
• Created: 15/Nov/14 03:12
• Updated: 29/May/15 02:30
• Resolved: 18/Nov/14 22:54

Description

These tests all failed with the same error, see below:

2014-11-14 19:09:11,330 ERROR [main]: ql.Driver (SessionState.java:printError(837)) - FAILED: NullPointerException null
java.lang.NullPointerException
  at org.apache.hadoop.hive.ql.plan.PlanUtils.getFieldSchemasFromColumnList(PlanUtils.java:535)
  at org.apache.hadoop.hive.ql.optimizer.MapJoinProcessor.getMapJoinDesc(MapJoinProcessor.java:1177)
  at org.apache.hadoop.hive.ql.optimizer.MapJoinProcessor.convertJoinOpMapJoinOp(MapJoinProcessor.java:392)
  at org.apache.hadoop.hive.ql.optimizer.spark.SparkMapJoinOptimizer.convertJoinMapJoin(SparkMapJoinOptimizer.java:412)
  at org.apache.hadoop.hive.ql.optimizer.spark.SparkMapJoinOptimizer.process(SparkMapJoinOptimizer.java:165)
  at org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
  at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:94)
  at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:78)
  at org.apache.hadoop.hive.ql.lib.ForwardWalker.walk(ForwardWalker.java:61)
  at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:109)
  at org.apache.hadoop.hive.ql.parse.spark.SparkCompiler.optimizeOperatorPlan(SparkCompiler.java:131)
  at org.apache.hadoop.hive.ql.parse.TaskCompiler.compile(TaskCompiler.java:99)
  at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10169)
  at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:221)
  at org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:74)
  at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:221)
  at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:419)
  at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:305)
  at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1107)
  at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1169)
  at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1044)
  at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1034)
  at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:247)
  at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:199)
  at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:410)
  at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:783)
  at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677)
  at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:606)
  at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

This happens at compile time.