HBase
  1. HBase
  2. HBASE-5279

NPE in Master after upgrading to 0.92.0

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.92.0
    • Fix Version/s: 0.92.1
    • Component/s: master
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I have upgraded my environment from 0.90.4 to 0.92.0

      after the table migration I get the following error in the master (permanent)

      2012-01-25 18:23:48,648 FATAL master-namenode,60000,1327512209588 org.apache.hadoop.hbase.master.HMaster - Unhandled exception. Starting shutdown.
      java.lang.NullPointerException
              at org.apache.hadoop.hbase.master.AssignmentManager.rebuildUserRegions(AssignmentManager.java:2190)
              at org.apache.hadoop.hbase.master.AssignmentManager.joinCluster(AssignmentManager.java:323)
              at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:501)
              at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:326)
              at java.lang.Thread.run(Thread.java:662)
      2012-01-25 18:23:48,650 INFO namenode,60000,1327512209588 org.apache.hadoop.hbase.master.HMaster - Aborting
      

      I think that's because I had a hard crash in the cluster a while ago - and the following WARN since then

      2012-01-25 21:20:47,121 WARN namenode,60000,1327513078123-CatalogJanitor org.apache.hadoop.hbase.master.CatalogJanitor - REGIONINFO_QUALIFIER is empty in keyvalues={emails,,xxx./info:server/1314336400471/Put/vlen=38, emails,,1314189353300.xxx./info:serverstartcode/1314336400471/Put/vlen=8}
      

      my patch was simple to go around the NPE (as the other code around the lines)
      but I don't know if that's correct

      1. HBASE-5279-v2.patch
        1 kB
        stack
      2. HBASE-5279.patch
        2 kB
        Tobias Herbert

        Activity

        Hide
        stack added a comment -

        Skipping should be fine. You have a scan of .META. from before upgrade?

        Are you up now?

        Show
        stack added a comment - Skipping should be fine. You have a scan of .META. from before upgrade? Are you up now?
        Hide
        Tobias Herbert added a comment -

        unfortunately I have no scan from .META. from before the upgrade.
        but with this patch I am up now

        Show
        Tobias Herbert added a comment - unfortunately I have no scan from .META. from before the upgrade. but with this patch I am up now
        Hide
        stack added a comment -

        Consider this for inclusion in 0.92.1

        Show
        stack added a comment - Consider this for inclusion in 0.92.1
        Hide
        stack added a comment -

        Version of patch that will work w/ hadoopqa

        Show
        stack added a comment - Version of patch that will work w/ hadoopqa
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12515016/HBASE-5279-v2.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 javadoc. The javadoc tool appears to have generated -136 warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        -1 findbugs. The patch appears to introduce 158 new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests:
        org.apache.hadoop.hbase.mapreduce.TestImportTsv
        org.apache.hadoop.hbase.mapred.TestTableMapReduce
        org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat

        Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/982//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/982//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/982//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12515016/HBASE-5279-v2.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 javadoc. The javadoc tool appears to have generated -136 warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 158 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: org.apache.hadoop.hbase.mapreduce.TestImportTsv org.apache.hadoop.hbase.mapred.TestTableMapReduce org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/982//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/982//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/982//console This message is automatically generated.
        Hide
        stack added a comment -

        Committed to 0.92 and to TRUNK. Thanks for the patch Tobias.

        Show
        stack added a comment - Committed to 0.92 and to TRUNK. Thanks for the patch Tobias.
        Hide
        Hudson added a comment -

        Integrated in HBase-0.92 #288 (See https://builds.apache.org/job/HBase-0.92/288/)
        HBASE-5279 NPE in Master after upgrading to 0.92.0 (Revision 1245769)

        Result = SUCCESS
        stack :
        Files :

        • /hbase/branches/0.92/CHANGES.txt
        • /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/catalog/MetaReader.java
        • /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
        Show
        Hudson added a comment - Integrated in HBase-0.92 #288 (See https://builds.apache.org/job/HBase-0.92/288/ ) HBASE-5279 NPE in Master after upgrading to 0.92.0 (Revision 1245769) Result = SUCCESS stack : Files : /hbase/branches/0.92/CHANGES.txt /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/catalog/MetaReader.java /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
        Hide
        Hudson added a comment -

        Integrated in HBase-TRUNK-security #114 (See https://builds.apache.org/job/HBase-TRUNK-security/114/)
        HBASE-5279 NPE in Master after upgrading to 0.92.0 – REVERT OVERCOMMIT TO HREGION (Revision 1245768)
        HBASE-5279 NPE in Master after upgrading to 0.92.0 (Revision 1245767)

        Result = FAILURE
        stack :
        Files :

        • /hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java

        stack :
        Files :

        • /hbase/trunk/src/main/java/org/apache/hadoop/hbase/catalog/MetaReader.java
        • /hbase/trunk/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
        • /hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
        Show
        Hudson added a comment - Integrated in HBase-TRUNK-security #114 (See https://builds.apache.org/job/HBase-TRUNK-security/114/ ) HBASE-5279 NPE in Master after upgrading to 0.92.0 – REVERT OVERCOMMIT TO HREGION (Revision 1245768) HBASE-5279 NPE in Master after upgrading to 0.92.0 (Revision 1245767) Result = FAILURE stack : Files : /hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java stack : Files : /hbase/trunk/src/main/java/org/apache/hadoop/hbase/catalog/MetaReader.java /hbase/trunk/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java /hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
        Hide
        Hudson added a comment -

        Integrated in HBase-TRUNK #2665 (See https://builds.apache.org/job/HBase-TRUNK/2665/)
        HBASE-5279 NPE in Master after upgrading to 0.92.0 – REVERT OVERCOMMIT TO HREGION (Revision 1245768)
        HBASE-5279 NPE in Master after upgrading to 0.92.0 (Revision 1245767)

        Result = FAILURE
        stack :
        Files :

        • /hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java

        stack :
        Files :

        • /hbase/trunk/src/main/java/org/apache/hadoop/hbase/catalog/MetaReader.java
        • /hbase/trunk/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
        • /hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
        Show
        Hudson added a comment - Integrated in HBase-TRUNK #2665 (See https://builds.apache.org/job/HBase-TRUNK/2665/ ) HBASE-5279 NPE in Master after upgrading to 0.92.0 – REVERT OVERCOMMIT TO HREGION (Revision 1245768) HBASE-5279 NPE in Master after upgrading to 0.92.0 (Revision 1245767) Result = FAILURE stack : Files : /hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java stack : Files : /hbase/trunk/src/main/java/org/apache/hadoop/hbase/catalog/MetaReader.java /hbase/trunk/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java /hbase/trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
        Hide
        Hudson added a comment -

        Integrated in HBase-0.92-security #91 (See https://builds.apache.org/job/HBase-0.92-security/91/)
        HBASE-5279 NPE in Master after upgrading to 0.92.0 (Revision 1245769)

        Result = FAILURE
        stack :
        Files :

        • /hbase/branches/0.92/CHANGES.txt
        • /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/catalog/MetaReader.java
        • /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
        Show
        Hudson added a comment - Integrated in HBase-0.92-security #91 (See https://builds.apache.org/job/HBase-0.92-security/91/ ) HBASE-5279 NPE in Master after upgrading to 0.92.0 (Revision 1245769) Result = FAILURE stack : Files : /hbase/branches/0.92/CHANGES.txt /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/catalog/MetaReader.java /hbase/branches/0.92/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java

          People

          • Assignee:
            Tobias Herbert
            Reporter:
            Tobias Herbert
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development