HBase
  1. HBase
  2. HBASE-8374

NullPointerException when launching the balancer due to unknown region location

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.95.0
    • Fix Version/s: 0.98.0, 0.95.1
    • Component/s: Balancer
    • Labels:
      None
    • Environment:

      AWS / real cluster with 3 nodes + master

    • Hadoop Flags:
      Reviewed

      Description

      I don't reproduce this all the time, but I had it on a fairly clean env.
      It occurs every 5 minutes (i.e. the balancer period). Impact is severe: the balancer does not run. When it starts to occurs, it occurs all the time. I haven't tried to restart the master, but I think it should be enough.
      Now, looking at the code, the NPE is strange.

      2013-04-18 08:09:52,079 ERROR [box,60000,1366281581983-BalancerChore] org.apache.hadoop.hbase.master.balancer.BalancerChore: Caught exception
      java.lang.NullPointerException
      	at org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer$Cluster.<init>(BaseLoadBalancer.java:145)
      	at org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer.balanceCluster(StochasticLoadBalancer.java:194)
      	at org.apache.hadoop.hbase.master.HMaster.balance(HMaster.java:1295)
      	at org.apache.hadoop.hbase.master.balancer.BalancerChore.chore(BalancerChore.java:48)
      	at org.apache.hadoop.hbase.Chore.run(Chore.java:81)
      	at java.lang.Thread.run(Thread.java:662)
      2013-04-18 08:09:52,103 DEBUG [box,60000,1366281581983-CatalogJanitor] org.apache.hadoop.hbase.client.ClientScanner: Creating scanner over .META. starting at key ''
      
                if (regionFinder != null) {
                  //region location
                  List<ServerName> loc = regionFinder.getTopBlockLocations(region);
                  regionLocations[regionIndex] = new int[loc.size()];
                  for (int i=0; i < loc.size(); i++) {
                    regionLocations[regionIndex][i] = serversToIndex.get(loc.get(i));  // <========= NPE here
                  }
                }
      

      pinging Enis Soztutar, just in case.

      1. 8374-trunk-v5.txt
        2 kB
        Ted Yu
      2. 8374-trunk-v4.txt
        3 kB
        Ted Yu
      3. 8374-trunk-v3.txt
        0.9 kB
        Ted Yu
      4. 8374-trunk-v2.txt
        0.8 kB
        Ted Yu
      5. 8374-trunk.txt
        1 kB
        Ted Yu

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Ted Yu
            Reporter:
            Nicolas Liochon
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development