Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13185

orc.ReaderImp.ensureOrcFooter() method fails on small text files with IndexOutOfBoundsException

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.1.0
    • Fix Version/s: 2.1.0
    • Component/s: ORC
    • Labels:
      None

      Description

      Steps to reproduce:
      1. Create a Text source table with one line of data:

      create table src (id int);
      insert overwrite table src values (1);
      

      2. Create a target table:

      create table trg (id int);
      

      3. Try to load small text file to the target table:

      load data inpath 'user/hive/warehouse/src/000000_0' into table trg;
      

      Error message:

      FAILED: SemanticException Unable to load data to destination table. Error: java.lang.IndexOutOfBoundsException

      Stack trace:

      org.apache.hadoop.hive.ql.parse.SemanticException: Unable to load data to destination table. Error: java.lang.IndexOutOfBoundsException
      	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.ensureFileFormatsMatch(LoadSemanticAnalyzer.java:340)
      	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:224)
      	at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:242)
      	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:481)
      	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:317)
      	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1190)
      	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1285)
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1116)
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1104)
      ...
      

        Attachments

        1. HIVE-13185.1.patch
          7 kB
          Illya Yalovyy

          Issue Links

            Activity

              People

              • Assignee:
                yalovyyi Illya Yalovyy
                Reporter:
                yalovyyi Illya Yalovyy
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: