Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      HDFS with the hflush ensures the bytes are visible, but doesn't update the file length on the NameNode. Currently the Orc reader will only read up to the length on the NameNode. If the user specified a length from a flush_length file, the Orc reader should trust it to be right.

      1. HIVE-6759.patch
        7 kB
        Owen O'Malley

        Activity

        Owen O'Malley created issue -
        Hide
        Owen O'Malley added a comment -

        This patch fixes the problem by using the supplied length rather that the stat from the NameNode.

        Show
        Owen O'Malley added a comment - This patch fixes the problem by using the supplied length rather that the stat from the NameNode.
        Owen O'Malley made changes -
        Field Original Value New Value
        Attachment HIVE-6759.patch [ 12637177 ]
        Owen O'Malley made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Assignee Owen O'Malley [ owen.omalley ]
        Owen O'Malley made changes -
        Fix Version/s 0.13.0 [ 12324986 ]
        Priority Major [ 3 ] Critical [ 2 ]
        Hide
        Sergey Shelukhin added a comment -

        +1, just skimmed the test

        Show
        Sergey Shelukhin added a comment - +1, just skimmed the test
        Hide
        Harish Butani added a comment -

        +1 for 0.13

        Show
        Harish Butani added a comment - +1 for 0.13
        Hide
        Owen O'Malley added a comment -

        Thanks for the review, Sergey and Harish. Thejas ran the unit tests internally and they passed.

        I just committed this.

        Show
        Owen O'Malley added a comment - Thanks for the review, Sergey and Harish. Thejas ran the unit tests internally and they passed. I just committed this.
        Owen O'Malley made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            Owen O'Malley
            Reporter:
            Owen O'Malley
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development