HBase
  1. HBase
  2. HBASE-7834

Document Hadoop version support matrix in the book

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.95.0
    • Component/s: documentation
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Lets do a support matrix in the book for HBase versions x Hadoop versions, and some cleanup in the Hadoop section.

      1. hbase-book-hadoop.txt
        3 kB
        Enis Soztutar
      2. hbase-7834_v2.patch
        11 kB
        Enis Soztutar
      3. hbase-7834_v1.patch
        11 kB
        Enis Soztutar

        Issue Links

          Activity

          Hide
          Enis Soztutar added a comment -

          Attaching a text, which can replace the Hadoop section in the book. http://hbase.apache.org/book/configuration.html#hadoop

          Does add the support matrix and some cleanup. We are not in the hadoop distro selection business.
          If we can agree on the text, I'll provide a patch.

          Show
          Enis Soztutar added a comment - Attaching a text, which can replace the Hadoop section in the book. http://hbase.apache.org/book/configuration.html#hadoop Does add the support matrix and some cleanup. We are not in the hadoop distro selection business. If we can agree on the text, I'll provide a patch.
          Hide
          Jonathan Hsieh added a comment -

          Missing hadoop 0.23, https://github.com/apache/hbase/blob/0.92/pom.xml#L1744 . Probably should be listed as NT for 0.92, 0.94, and we can decide on X or NT for 0.96.

          0.94 could probably be 'S' – when I +1'ed the 0.94.x release candidates, I tested on top of hadoop 2.0.

          Show
          Jonathan Hsieh added a comment - Missing hadoop 0.23, https://github.com/apache/hbase/blob/0.92/pom.xml#L1744 . Probably should be listed as NT for 0.92, 0.94, and we can decide on X or NT for 0.96. 0.94 could probably be 'S' – when I +1'ed the 0.94.x release candidates, I tested on top of hadoop 2.0.
          Hide
          stack added a comment -

          Text is great. Cleaner than what was there before.

          Your sentence on our not bieng in the hadoop distro business should be included in the text.

          You think we should drop the punt to vendors section altogether and just hold to apache versions? Vendors bundle their own hbase so issue of "Cloudera bundles 0.92 but I want to run 0.94 on CDH4 – will it work?" ... and our answer will be NT always?

          +1 on commit.

          Show
          stack added a comment - Text is great. Cleaner than what was there before. Your sentence on our not bieng in the hadoop distro business should be included in the text. You think we should drop the punt to vendors section altogether and just hold to apache versions? Vendors bundle their own hbase so issue of "Cloudera bundles 0.92 but I want to run 0.94 on CDH4 – will it work?" ... and our answer will be NT always? +1 on commit.
          Hide
          Enis Soztutar added a comment -

          Missing hadoop 0.23. Probably should be listed as NT for 0.92, 0.94, and we can decide on X or NT for 0.96.

          Thanks for the reminder. Will update with 0.23. Yahoo is the main consumer of 23, and AFAIK, they should be running a released version. Francis Liu care to chime in. I would be ok with X, X, NT respectively.

          You think we should drop the punt to vendors section altogether and just hold to apache versions.

          Yes.

          Cloudera bundles 0.92 but I want to run 0.94 on CDH4 – will it work?... and our answer will be NT always?

          If those issues come up in mailing list, etc, I don't see any problem of explaining the testing done, or redirecting them to vendor specific mailing lists / forums. My main concern is that, explaining the intricacies of base versions of vendor products which include Hadoop is out of scope. Maybe we can add a link to Powered-By pages of Hadoop and HBase.

          Show
          Enis Soztutar added a comment - Missing hadoop 0.23. Probably should be listed as NT for 0.92, 0.94, and we can decide on X or NT for 0.96. Thanks for the reminder. Will update with 0.23. Yahoo is the main consumer of 23, and AFAIK, they should be running a released version. Francis Liu care to chime in. I would be ok with X, X, NT respectively. You think we should drop the punt to vendors section altogether and just hold to apache versions. Yes. Cloudera bundles 0.92 but I want to run 0.94 on CDH4 – will it work?... and our answer will be NT always? If those issues come up in mailing list, etc, I don't see any problem of explaining the testing done, or redirecting them to vendor specific mailing lists / forums. My main concern is that, explaining the intricacies of base versions of vendor products which include Hadoop is out of scope. Maybe we can add a link to Powered-By pages of Hadoop and HBase.
          Hide
          Francis Liu added a comment -

          Thanks for the reminder. Will update with 0.23. Yahoo is the main consumer of 23, and AFAIK, they should be running a released version. Francis Liu care to chime in. I would be ok with X, X, NT respectively.

          I can vouch for 0.94 compatibility with 0.23 as that is what we run with all our deployments. And would be glad to support it until we move to 2.0. We didn't try 0.92. So we could change things to: X,S,NT.

          BTW we should probably add a dimension for JDK version support (at least 6 & 7).

          Show
          Francis Liu added a comment - Thanks for the reminder. Will update with 0.23. Yahoo is the main consumer of 23, and AFAIK, they should be running a released version. Francis Liu care to chime in. I would be ok with X, X, NT respectively. I can vouch for 0.94 compatibility with 0.23 as that is what we run with all our deployments. And would be glad to support it until we move to 2.0. We didn't try 0.92. So we could change things to: X,S,NT. BTW we should probably add a dimension for JDK version support (at least 6 & 7).
          Hide
          stack added a comment -

          Enis Soztutar Sounds good to me. Sounds like then you could commit w/ 0.23 added as per Francis Liu and Jon's vouching for 2.0 If you want me to do the docbook weaving so you don't have to figure it, just say and I'll have a go, np.

          Show
          stack added a comment - Enis Soztutar Sounds good to me. Sounds like then you could commit w/ 0.23 added as per Francis Liu and Jon's vouching for 2.0 If you want me to do the docbook weaving so you don't have to figure it, just say and I'll have a go, np.
          Hide
          Enis Soztutar added a comment -

          Thanks Stack. I did start the docbook work before your offer

          Attaching a candidate patch. Main differences from earlier text:

          Show
          Enis Soztutar added a comment - Thanks Stack. I did start the docbook work before your offer Attaching a candidate patch. Main differences from earlier text: Added 0.23 column, with X, S, NT Changed 0.94 to officially support hadoop-2 (now 0.94 supports every Hadoop version on paper!). See HBASE-7833 . Added link to http://wiki.apache.org/hadoop/Distributions%20and%20Commercial%20Support .
          Hide
          Jonathan Hsieh added a comment -

          In v1, can we update the statement that "0.94 has not been tested much with hadoop-2.x series" to match the table? Nearly all my testing (and several of my colleagues') has been on top of hadoop 2.x versions. (this is also missing 0.23).

          +	<para>HBase 0.92 and 0.94 versions can work with Hadoop versions, 0.20.205, 0.22.x, 1.0.x and 1.1.x. 0.94 has not been tested much with Hadoop-2.x series although you can compile the code with using the maven profile (see top level pom.xml)</para>
          
          Show
          Jonathan Hsieh added a comment - In v1, can we update the statement that "0.94 has not been tested much with hadoop-2.x series" to match the table? Nearly all my testing (and several of my colleagues') has been on top of hadoop 2.x versions. (this is also missing 0.23). + <para>HBase 0.92 and 0.94 versions can work with Hadoop versions, 0.20.205, 0.22.x, 1.0.x and 1.1.x. 0.94 has not been tested much with Hadoop-2.x series although you can compile the code with using the maven profile (see top level pom.xml)</para>
          Hide
          stack added a comment -

          +1 for commit (w/ Jon above suggestion). Thanks for doing this Enis.

          Show
          stack added a comment - +1 for commit (w/ Jon above suggestion). Thanks for doing this Enis.
          Hide
          Enis Soztutar added a comment -

          Committed the patch with the changes about 0.94 and Hadoop-2 wording. Thanks Jonathan and Stack.

          Show
          Enis Soztutar added a comment - Committed the patch with the changes about 0.94 and Hadoop-2 wording. Thanks Jonathan and Stack.
          Hide
          Hudson added a comment -

          Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #408 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/408/)
          HBASE-7834. Document Hadoop version support matrix in the book (Revision 1446379)

          Result = FAILURE
          enis :
          Files :

          • /hbase/trunk/src/docbkx/configuration.xml
          Show
          Hudson added a comment - Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #408 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/408/ ) HBASE-7834 . Document Hadoop version support matrix in the book (Revision 1446379) Result = FAILURE enis : Files : /hbase/trunk/src/docbkx/configuration.xml
          Hide
          Hudson added a comment -

          Integrated in HBase-TRUNK #3880 (See https://builds.apache.org/job/HBase-TRUNK/3880/)
          HBASE-7834. Document Hadoop version support matrix in the book (Revision 1446379)

          Result = FAILURE
          enis :
          Files :

          • /hbase/trunk/src/docbkx/configuration.xml
          Show
          Hudson added a comment - Integrated in HBase-TRUNK #3880 (See https://builds.apache.org/job/HBase-TRUNK/3880/ ) HBASE-7834 . Document Hadoop version support matrix in the book (Revision 1446379) Result = FAILURE enis : Files : /hbase/trunk/src/docbkx/configuration.xml
          Hide
          stack added a comment -

          Marking closed.

          Show
          stack added a comment - Marking closed.

            People

            • Assignee:
              Enis Soztutar
              Reporter:
              Enis Soztutar
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development