Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      HDFS with the hflush ensures the bytes are visible, but doesn't update the file length on the NameNode. Currently the Orc reader will only read up to the length on the NameNode. If the user specified a length from a flush_length file, the Orc reader should trust it to be right.

      1. HIVE-6759.patch
        7 kB
        Owen O'Malley

        Activity

        Hide
        Owen O'Malley added a comment -

        This patch fixes the problem by using the supplied length rather that the stat from the NameNode.

        Show
        Owen O'Malley added a comment - This patch fixes the problem by using the supplied length rather that the stat from the NameNode.
        Hide
        Sergey Shelukhin added a comment -

        +1, just skimmed the test

        Show
        Sergey Shelukhin added a comment - +1, just skimmed the test
        Hide
        Harish Butani added a comment -

        +1 for 0.13

        Show
        Harish Butani added a comment - +1 for 0.13
        Hide
        Owen O'Malley added a comment -

        Thanks for the review, Sergey and Harish. Thejas ran the unit tests internally and they passed.

        I just committed this.

        Show
        Owen O'Malley added a comment - Thanks for the review, Sergey and Harish. Thejas ran the unit tests internally and they passed. I just committed this.

          People

          • Assignee:
            Owen O'Malley
            Reporter:
            Owen O'Malley
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development