Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.2.1
    • Component/s: hbase
    • Labels:
      None

      Description

      I'm unsure if this should be considered Major or Critical. Adjust as needed.
      HBase 1.1.3 (master, regionserver, and shell) from bigtop-1.2 works fine on x86_64. It does not work at all on ppc64le.

      My setup is a power8 running ubuntu 16.04, but I suspect this would affect all non-intel arches:

      $ cat /etc/issue
      Ubuntu 16.04.2 LTS \n \l

      $ uname -a
      Linux 4.4.0-72-generic #93-Ubuntu SMP Fri Mar 31 14:05:15 UTC 2017 ppc64le ppc64le ppc64le GNU/Linux

      The hbase-master log fails like this:

      http://paste.ubuntu.com/24376562/

      The hbase shell has a similar error (same missing class):

      $ hbase shell
      OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
      NameError: cannot link Java class org.apache.hadoop.hbase.HConstants, probable missing dependency: Could not initialize class org.apache.hadoop.hbase.util.Bytes$LexicographicalComparerHolder$UnsafeComparer
      get_proxy_or_package_under_package at org/jruby/javasupport/JavaUtilities.java:54
      method_missing at file:/usr/lib/hbase/lib/jruby-complete-1.6.8.jar!/builtin/javasupport/java.rb:51
      HBaseConstants at /usr/lib/hbase/lib/ruby/hbase.rb:39
      (root) at /usr/lib/hbase/lib/ruby/hbase.rb:34
      require at org/jruby/RubyKernel.java:1062
      (root) at /usr/lib/hbase/bin/hirb.rb:105

      This was reported in HBASE-15322 and fixed in hbase-1.1.4:

      https://issues.apache.org/jira/browse/HBASE-15322

        Issue Links

          Activity

          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user kwmonroe opened a pull request:

          https://github.com/apache/bigtop/pull/196

          BIGTOP-2740: hbase 1.1.3 does not work on ppc64le

          HBase 1.1.x was broken on non-Intel arches until v1.1.4 (HBASE-15322(https://issues.apache.org/jira/browse/HBASE-15322)).

          Pick up this fix by bumping to v1.1.9, the latest stable release from the 1.1 branch. This is a super simple bump as I did not see any config or other changes needed from the upstream 1.1 branch.

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/juju-solutions/bigtop bug/BIGTOP-2740/hbase-1.1.9

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/bigtop/pull/196.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #196


          commit 96b4a6d932ce956ef6c35237844ebe6c270a4cc2
          Author: Kevin W Monroe <kevin.monroe@canonical.com>
          Date: 2017-04-17T22:41:08Z

          BIGTOP-2740: bump hbase to 1.1.9


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user kwmonroe opened a pull request: https://github.com/apache/bigtop/pull/196 BIGTOP-2740 : hbase 1.1.3 does not work on ppc64le HBase 1.1.x was broken on non-Intel arches until v1.1.4 ( HBASE-15322 ( https://issues.apache.org/jira/browse/HBASE-15322 )). Pick up this fix by bumping to v1.1.9, the latest stable release from the 1.1 branch. This is a super simple bump as I did not see any config or other changes needed from the upstream 1.1 branch. You can merge this pull request into a Git repository by running: $ git pull https://github.com/juju-solutions/bigtop bug/ BIGTOP-2740 /hbase-1.1.9 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/bigtop/pull/196.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #196 commit 96b4a6d932ce956ef6c35237844ebe6c270a4cc2 Author: Kevin W Monroe <kevin.monroe@canonical.com> Date: 2017-04-17T22:41:08Z BIGTOP-2740 : bump hbase to 1.1.9
          Hide
          kwmonroe Kevin W Monroe added a comment -

          Bumping up to critical as HBase is unusable on ppc64le.

          When building with the associated PR, v1.1.9 of HMaster, RegionServer, and shell looked good on ubuntu 16.04/x86_64. HM and RS look good on 16.04/ppc64le (which is a significant improvement over the total failure with 1.1.3), but hbase shell requires an additional workaround. I've opened BIGTOP-2743 to address that issue.

          Show
          kwmonroe Kevin W Monroe added a comment - Bumping up to critical as HBase is unusable on ppc64le. When building with the associated PR, v1.1.9 of HMaster, RegionServer, and shell looked good on ubuntu 16.04/x86_64. HM and RS look good on 16.04/ppc64le (which is a significant improvement over the total failure with 1.1.3), but hbase shell requires an additional workaround. I've opened BIGTOP-2743 to address that issue.
          Hide
          rvs Roman Shaposhnik added a comment -

          As per Olaf Flebbe it looks like proposing to upgrade HBase to 1.1.x with x >= 4 would be sufficient.

          Show
          rvs Roman Shaposhnik added a comment - As per Olaf Flebbe it looks like proposing to upgrade HBase to 1.1.x with x >= 4 would be sufficient.
          Hide
          kwmonroe Kevin W Monroe added a comment -

          Indeed Roman Shaposhnik. The linked PR brings HBase to 1.1.9, which is the latest stable in the 1.1 branch. It was astonishingly simple to patch, which makes me nervous that I may have missed something. I did test the resultant 1.1.9 pkgs on x86 and ppc64le with mostly successful results (aside from BIGTOP-2743 for ppc64le).

          Both you and Olaf used the "proposing to upgrade" language. I don't know the process to do that other than to open a jira and attach a PR/patch. If there's a more formal proposal required, lmk and I'll happily do it. Thanks!

          Show
          kwmonroe Kevin W Monroe added a comment - Indeed Roman Shaposhnik . The linked PR brings HBase to 1.1.9, which is the latest stable in the 1.1 branch. It was astonishingly simple to patch, which makes me nervous that I may have missed something. I did test the resultant 1.1.9 pkgs on x86 and ppc64le with mostly successful results (aside from BIGTOP-2743 for ppc64le). Both you and Olaf used the "proposing to upgrade" language. I don't know the process to do that other than to open a jira and attach a PR/patch. If there's a more formal proposal required, lmk and I'll happily do it. Thanks!
          Hide
          evans_ye Evans Ye added a comment - - edited

          I see no reason to not upgrade to the latest minor version if it's that simple and indeed it solves the problem.
          For the proposal thing, I think it's fine. We can discuss here.
          Unless we'll run into some special issues. Andrew Purtell can you comment here for upgrading HBase to 1.1.9?

          Show
          evans_ye Evans Ye added a comment - - edited I see no reason to not upgrade to the latest minor version if it's that simple and indeed it solves the problem. For the proposal thing, I think it's fine. We can discuss here. Unless we'll run into some special issues. Andrew Purtell can you comment here for upgrading HBase to 1.1.9?
          Hide
          apurtell Andrew Purtell added a comment -

          No concerns.
          Wait a few days, we will have a 1.1.10 release. Vote is underway, should pass today.

          Show
          apurtell Andrew Purtell added a comment - No concerns. Wait a few days, we will have a 1.1.10 release. Vote is underway, should pass today.
          Hide
          oflebbe Olaf Flebbe added a comment -

          committed, thanks!

          Show
          oflebbe Olaf Flebbe added a comment - committed, thanks!
          Show
          githubbot ASF GitHub Bot added a comment - Github user kwmonroe commented on the issue: https://github.com/apache/bigtop/pull/196 Closed in https://github.com/apache/bigtop/commit/905bfe464864c8d77393b6dcf6788f3866e887fa
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user kwmonroe closed the pull request at:

          https://github.com/apache/bigtop/pull/196

          Show
          githubbot ASF GitHub Bot added a comment - Github user kwmonroe closed the pull request at: https://github.com/apache/bigtop/pull/196

            People

            • Assignee:
              kwmonroe Kevin W Monroe
              Reporter:
              kwmonroe Kevin W Monroe
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development