XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      Following exception is being observed. The query is a 4-way map join with 1 fact table and 4 dimension tables.

      13/10/18 14:52:29 ERROR ql.Driver: FAILED: RuntimeException java.lang.reflect.InvocationTargetException
      java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
      at org.apache.hadoop.hive.ql.exec.OperatorFactory.getVectorOperator(OperatorFactory.java:143)
      at org.apache.hadoop.hive.ql.optimizer.physical.Vectorizer.vectorizeOperator(Vectorizer.java:658)
      at org.apache.hadoop.hive.ql.optimizer.physical.Vectorizer$VectorizationNodeProcessor.process(Vectorizer.java:439)
      at org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
      at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:94)
      at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:78)
      at org.apache.hadoop.hive.ql.lib.PreOrderWalker.walk(PreOrderWalker.java:54)
      at org.apache.hadoop.hive.ql.lib.PreOrderWalker.walk(PreOrderWalker.java:59)
      at org.apache.hadoop.hive.ql.lib.PreOrderWalker.walk(PreOrderWalker.java:59)
      at org.apache.hadoop.hive.ql.lib.PreOrderWalker.walk(PreOrderWalker.java:59)
      at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:109)
      at org.apache.hadoop.hive.ql.optimizer.physical.Vectorizer$VectorizationDispatcher.vectorizeMRTask(Vectorizer.java:335)
      at org.apache.hadoop.hive.ql.optimizer.physical.Vectorizer$VectorizationDispatcher.dispatch(Vectorizer.java:276)
      at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.dispatch(TaskGraphWalker.java:111)
      at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.walk(TaskGraphWalker.java:194)
      at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.startWalking(TaskGraphWalker.java:139)
      at org.apache.hadoop.hive.ql.optimizer.physical.Vectorizer.resolve(Vectorizer.java:472)
      at org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer.optimize(PhysicalOptimizer.java:97)
      at org.apache.hadoop.hive.ql.parse.MapReduceCompiler.compile(MapReduceCompiler.java:300)
      at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:8410)
      at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:284)
      at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:451)
      at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:351)
      at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1004)
      at org.apache.hadoop.hive.ql.Driver.run(Driver.java:915)
      at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
      at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
      at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:422)
      at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:357)
      at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:455)
      at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:465)
      at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:125)
      at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:422)
      at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:790)
      at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:684)
      at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:623)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
      Caused by: java.lang.reflect.InvocationTargetException
      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
      at org.apache.hadoop.hive.ql.exec.OperatorFactory.getVectorOperator(OperatorFactory.java:136)
      ... 40 more
      Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Column _col7 is already mapped to 31. Cannot remap to 37.
      at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.addToColumnMap(VectorizationContext.java:2130)
      at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.addOutputColumn(VectorizationContext.java:2150)
      at org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator.<init>(VectorMapJoinOperator.java:122)
      ... 45 more

        Attachments

        1. HIVE-5594.1.patch
          1.0 kB
          Jitendra Nath Pandey

          Activity

            People

            • Assignee:
              jnp Jitendra Nath Pandey
              Reporter:
              jnp Jitendra Nath Pandey
            • Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: