Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      HDFS with the hflush ensures the bytes are visible, but doesn't update the file length on the NameNode. Currently the Orc reader will only read up to the length on the NameNode. If the user specified a length from a flush_length file, the Orc reader should trust it to be right.

      1. HIVE-6759.patch
        7 kB
        Owen O'Malley

        Activity

        Hide
        owen.omalley Owen O'Malley added a comment -

        Thanks for the review, Sergey and Harish. Thejas ran the unit tests internally and they passed.

        I just committed this.

        Show
        owen.omalley Owen O'Malley added a comment - Thanks for the review, Sergey and Harish. Thejas ran the unit tests internally and they passed. I just committed this.
        Hide
        rhbutani Harish Butani added a comment -

        +1 for 0.13

        Show
        rhbutani Harish Butani added a comment - +1 for 0.13
        Hide
        sershe Sergey Shelukhin added a comment -

        +1, just skimmed the test

        Show
        sershe Sergey Shelukhin added a comment - +1, just skimmed the test
        Hide
        owen.omalley Owen O'Malley added a comment -

        This patch fixes the problem by using the supplied length rather that the stat from the NameNode.

        Show
        owen.omalley Owen O'Malley added a comment - This patch fixes the problem by using the supplied length rather that the stat from the NameNode.

          People

          • Assignee:
            owen.omalley Owen O'Malley
            Reporter:
            owen.omalley Owen O'Malley
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development