Hive
  1. Hive
  2. HIVE-3018

Make the new header for RC Files introduced in HIVE-2711 optional

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.10.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HIVE-2711 introduced a new header for RC files. This breaks a number of things, for example, copying data from a cluster running a post-HIVE-2711 version of Hive to a cluster running a pre-HIVE-2711 version of Hive.

      Make this optional.

        Activity

        Show
        Kevin Wilfong added a comment - https://reviews.facebook.net/D3165
        Hide
        Namit Jain added a comment -

        +1

        running tests

        Show
        Namit Jain added a comment - +1 running tests
        Hide
        Namit Jain added a comment -

        Committed. Thanks Kevin

        Show
        Namit Jain added a comment - Committed. Thanks Kevin
        Hide
        Namit Jain added a comment -

        Committed. Thanks Kevin

        Show
        Namit Jain added a comment - Committed. Thanks Kevin
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-h0.21 #1428 (See https://builds.apache.org/job/Hive-trunk-h0.21/1428/)
        HIVE-3018 Make the new header for RC Files introduced in HIVE-2711 optional
        (Kevin Wilfong via namit) (Revision 1337937)

        Result = FAILURE
        namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1337937
        Files :

        • /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java
        • /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-h0.21 #1428 (See https://builds.apache.org/job/Hive-trunk-h0.21/1428/ ) HIVE-3018 Make the new header for RC Files introduced in HIVE-2711 optional (Kevin Wilfong via namit) (Revision 1337937) Result = FAILURE namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1337937 Files : /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java
        Hide
        Owen O'Malley added a comment -

        Sorry for messing up your cross-cluster compatibility. I am curious how long the period is for rolling new versions of Hive at Facebook. In other words, how long is it from when the first Facebook cluster gets a specific version of Hive until the last cluster is at that version or higher?

        Show
        Owen O'Malley added a comment - Sorry for messing up your cross-cluster compatibility. I am curious how long the period is for rolling new versions of Hive at Facebook. In other words, how long is it from when the first Facebook cluster gets a specific version of Hive until the last cluster is at that version or higher?
        Hide
        Namit Jain added a comment -

        Typically, it takes around ~4 weeks

        Show
        Namit Jain added a comment - Typically, it takes around ~4 weeks
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/)
        HIVE-3018 Make the new header for RC Files introduced in HIVE-2711 optional
        (Kevin Wilfong via namit) (Revision 1337937)

        Result = ABORTED
        namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1337937
        Files :

        • /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java
        • /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java
        Show
        Hudson added a comment - Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/ ) HIVE-3018 Make the new header for RC Files introduced in HIVE-2711 optional (Kevin Wilfong via namit) (Revision 1337937) Result = ABORTED namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1337937 Files : /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java
        Hide
        Ashutosh Chauhan added a comment -

        This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

        Show
        Ashutosh Chauhan added a comment - This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

          People

          • Assignee:
            Kevin Wilfong
            Reporter:
            Kevin Wilfong
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development