Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13280

Error when more than 1 mapper for HBase storage handler

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: 2.0.0
    • Fix Version/s: None
    • Component/s: HBase Handler
    • Labels:
      None

      Description

      With a simple query (select from orc table and insert into HBase external table):

      insert into table register.register  select * from aa_temp
      

      The aa_temp table have 45 orc files. It generate 45 mappers.
      Some mappers fail with this error:

      Caused by: java.lang.IllegalArgumentException: Must specify table name
              at org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:188)
              at org.apache.hive.common.util.ReflectionUtil.setConf(ReflectionUtil.java:101)
              at org.apache.hive.common.util.ReflectionUtil.newInstance(ReflectionUtil.java:87)
              at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveOutputFormat(HiveFileFormatUtils.java:300)
              at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveOutputFormat(HiveFileFormatUtils.java:290)
              at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createHiveOutputFormat(FileSinkOperator.java:1126)
              ... 25 more
      ]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:35, Vertex vertex_1457964631631_0015_3_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0 (state=08S01,code=2)
      

      If I do an ALTER CONCATENATE for aa_temp. And redo the query. Everything is fine because there are only one mapper.

        Attachments

          Activity

            People

            • Assignee:
              damien.carol Damien Carol
              Reporter:
              damien.carol Damien Carol
            • Votes:
              2 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: