Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-10308

Vectorization execution throws java.lang.IllegalArgumentException: Unsupported complex type: MAP

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.13.1, 0.14.0, 1.1.0, 1.2.0
    • 1.3.0, 2.0.0
    • Vectorization
    • None

    Description

      Steps to reproduce:

      CREATE TABLE test_orc (a INT, b MAP<INT, STRING>) STORED AS ORC;
      INSERT OVERWRITE TABLE test_orc SELECT 1, MAP(1, "one", 2, "two") FROM src LIMIT 1;
      CREATE TABLE test(key INT) ;
      INSERT OVERWRITE TABLE test SELECT 1 FROM src LIMIT 1;
      
      set hive.vectorized.execution.enabled=true;
      set hive.auto.convert.join=false;
      
      select l.key from test l left outer join test_orc r on (l.key= r.a) where r.a is not null;
      

      Stack trace:

      Caused by: java.lang.IllegalArgumentException: Unsupported complex type: MAP
      	at org.apache.hadoop.hive.ql.exec.vector.expressions.VectorExpressionWriterFactory.genVectorExpressionWritable(VectorExpressionWriterFactory.java:456)
      	at org.apache.hadoop.hive.ql.exec.vector.expressions.VectorExpressionWriterFactory.processVectorInspector(VectorExpressionWriterFactory.java:1191)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator.initializeOp(VectorReduceSinkOperator.java:58)
      	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:362)
      	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:481)
      	at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:438)
      	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
      	at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:442)
      	at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:198)
      

      Attachments

        1. HIVE-10308.1.patch
          1 kB
          Selina Zhang

        Activity

          People

            mmccline Matt McCline
            selinazh Selina Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: