Hive
  1. Hive
  2. HIVE-2429

skip corruption bug that cause data not decompressed

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None

      Description

      1. HIVE-2429.patch
        9 kB
        Ramkumar Vadali

        Activity

        Hide
        Ramkumar Vadali added a comment -

        Patch with test

        Show
        Ramkumar Vadali added a comment - Patch with test
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/1738/
        -----------------------------------------------------------

        Review request for Yongqiang He.

        Summary
        -------

        Fix for lazy decompression

        This addresses bug HIVE-2429.
        https://issues.apache.org/jira/browse/HIVE-2429

        Diffs


        trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java 1166283
        trunk/ql/src/test/queries/clientpositive/rcfile_toleratecorruptions.q PRE-CREATION
        trunk/ql/src/test/results/clientpositive/rcfile_toleratecorruptions.q.out PRE-CREATION

        Diff: https://reviews.apache.org/r/1738/diff

        Testing
        -------

        Added unit test

        Thanks,

        Ramkumar

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1738/ ----------------------------------------------------------- Review request for Yongqiang He. Summary ------- Fix for lazy decompression This addresses bug HIVE-2429 . https://issues.apache.org/jira/browse/HIVE-2429 Diffs trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java 1166283 trunk/ql/src/test/queries/clientpositive/rcfile_toleratecorruptions.q PRE-CREATION trunk/ql/src/test/results/clientpositive/rcfile_toleratecorruptions.q.out PRE-CREATION Diff: https://reviews.apache.org/r/1738/diff Testing ------- Added unit test Thanks, Ramkumar
        Hide
        He Yongqiang added a comment -

        +1, will commit after tests pass

        Show
        He Yongqiang added a comment - +1, will commit after tests pass
        Hide
        He Yongqiang added a comment -

        committed, thanks Ramkumar Vadali!

        Show
        He Yongqiang added a comment - committed, thanks Ramkumar Vadali!
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-h0.21 #943 (See https://builds.apache.org/job/Hive-trunk-h0.21/943/)
        HIVE-2429: skip corruption bug that cause data not decompressed (Ramkumar Vadali via He Yongqiang)

        heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1166922
        Files :

        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java
        • /hive/trunk/ql/src/test/queries/clientpositive/rcfile_toleratecorruptions.q
        • /hive/trunk/ql/src/test/results/clientpositive/rcfile_toleratecorruptions.q.out
        Show
        Hudson added a comment - Integrated in Hive-trunk-h0.21 #943 (See https://builds.apache.org/job/Hive-trunk-h0.21/943/ ) HIVE-2429 : skip corruption bug that cause data not decompressed (Ramkumar Vadali via He Yongqiang) heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1166922 Files : /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java /hive/trunk/ql/src/test/queries/clientpositive/rcfile_toleratecorruptions.q /hive/trunk/ql/src/test/results/clientpositive/rcfile_toleratecorruptions.q.out

          People

          • Assignee:
            Ramkumar Vadali
            Reporter:
            He Yongqiang
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development