Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7017

Insertion into Parquet tables fails under Tez

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.13.0
    • Fix Version/s: 0.14.0
    • Component/s: Tez
    • Labels:
      None
    • Environment:

      Hive 0.13.0, CentOS 6

      Description

      It seems Parquet tables cannot be written to in Tez mode. CREATE TABLE foo STORED AS PARQUET SELECT ... queries fail with:

      	java.lang.IllegalArgumentException: TaskAttemptId string : task1396892688715_80817_m_000076_3 is not properly formed
      		at org.apache.hadoop.mapreduce.TaskAttemptID.forName(TaskAttemptID.java:201)
      		at org.apache.hadoop.hive.ql.io.parquet.write.ParquetRecordWriterWrapper.<init>(ParquetRecordWriterWrapper.java:49)
      

      The same queries work fine after setting hive.execution.engine=mr.

        Attachments

        1. HIVE-7017.1.patch.txt
          1 kB
          Navis Ryu

          Activity

            People

            • Assignee:
              ccondit Craig Condit
              Reporter:
              ccondit Craig Condit
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: