Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13185

orc.ReaderImp.ensureOrcFooter() method fails on small text files with IndexOutOfBoundsException

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.1.0
    • 2.1.0
    • ORC
    • None

    Description

      Steps to reproduce:
      1. Create a Text source table with one line of data:

      create table src (id int);
      insert overwrite table src values (1);
      

      2. Create a target table:

      create table trg (id int);
      

      3. Try to load small text file to the target table:

      load data inpath 'user/hive/warehouse/src/000000_0' into table trg;
      

      Error message:

      FAILED: SemanticException Unable to load data to destination table. Error: java.lang.IndexOutOfBoundsException

      Stack trace:

      org.apache.hadoop.hive.ql.parse.SemanticException: Unable to load data to destination table. Error: java.lang.IndexOutOfBoundsException
      	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.ensureFileFormatsMatch(LoadSemanticAnalyzer.java:340)
      	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:224)
      	at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:242)
      	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:481)
      	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:317)
      	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1190)
      	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1285)
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1116)
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1104)
      ...
      

      Attachments

        1. HIVE-13185.1.patch
          7 kB
          Illya Yalovyy

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            yalovyyi Illya Yalovyy Assign to me
            yalovyyi Illya Yalovyy
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment