[HIVE-14264] ArrayIndexOutOfBoundsException when cbo is enabled

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.1.0
• Component/s: Query Processor
• Assignee: Gabor Szadovszky
• Reporter: Amareshwari Sriramadasu
• Created: 18/Jul/16 10:36
• Updated: 28/Jul/16 05:56

Description

We have noticed ArrayIndexOutOfBoundsException for queries with IS NOT NULL filter. Exception goes away when hive.cbo.enable=false

Here is a stacktrace in our production environment :

Caused by: java.lang.ArrayIndexOutOfBoundsException: -1
        at java.util.ArrayList.elementData(ArrayList.java:418) ~[na:1.8.0_72]
        at java.util.ArrayList.set(ArrayList.java:446) ~[na:1.8.0_72]
        at org.apache.hadoop.hive.ql.optimizer.physical.MapJoinResolver$LocalMapJoinTaskDispatcher.processCurrentTask(MapJoinResolver.java:173) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.optimizer.physical.MapJoinResolver$LocalMapJoinTaskDispatcher.dispatch(MapJoinResolver.java:239) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.dispatch(TaskGraphWalker.java:111) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.walk(TaskGraphWalker.java:180) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.startWalking(TaskGraphWalker.java:125) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.optimizer.physical.MapJoinResolver.resolve(MapJoinResolver.java:81) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer.optimize(PhysicalOptimizer.java:107) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.parse.MapReduceCompiler.optimizeTaskPlan(MapReduceCompiler.java:271) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.parse.TaskCompiler.compile(TaskCompiler.java:274) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10764) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:234) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:250) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:436) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:328) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1156) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1143) ~[hive-exec-2.1.2-inm.jar:2.1.2-inm]
        at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:147) ~[hive-service-2.1.2-inm.jar:2.1.2-inm]