HBase
  1. HBase
  2. HBASE-5875

Process RIT and Master restart may remove an online server considering it as a dead server

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.92.1
    • Fix Version/s: 0.94.1, 0.95.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      If on master restart it finds the ROOT/META to be in RIT state, master tries to assign the ROOT region through ProcessRIT.

      Master will trigger the assignment and next will try to verify the Root Region Location.
      Root region location verification is done seeing if the RS has the region in its online list.
      If the master triggered assignment has not yet been completed in RS then the verify root region location will fail.
      Because it failed

      splitLogAndExpireIfOnline(currentRootServer);
      

      we do split log and also remove the server from online server list. Ideally here there is nothing to do in splitlog as no region server was restarted.

      So master, though the server is online, master just invalidates the region server.
      In a special case, if i have only one RS then my cluster will become non operative.

      1. HBASE-5875v2.patch
        3 kB
        chunhui shen
      2. HBASE-5875.patch
        2 kB
        ramkrishna.s.vasudevan
      3. HBASE-5875_trunk.patch
        3 kB
        rajeshbabu
      4. HBASE-5875_trunk.patch
        3 kB
        rajeshbabu
      5. HBASE-5875_trunk_1.patch
        3 kB
        ramkrishna.s.vasudevan
      6. HBASE-5875_0.94.patch
        17 kB
        ramkrishna.s.vasudevan
      7. HBASE-5875_0.94_2.patch
        4 kB
        ramkrishna.s.vasudevan
      8. HBASE-5875_0.94_1.patch
        17 kB
        ramkrishna.s.vasudevan

        Activity

        Lars Hofhansl made changes -
        Fix Version/s 0.94.1 [ 12320257 ]
        Fix Version/s 0.94.0 [ 12316419 ]
        Lars Hofhansl made changes -
        Fix Version/s 0.94.0 [ 12316419 ]
        stack made changes -
        Fix Version/s 0.95.0 [ 12324094 ]
        Fix Version/s 0.96.0 [ 12320040 ]
        Fix Version/s 0.94.1 [ 12320257 ]
        Lars Hofhansl made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        ramkrishna.s.vasudevan made changes -
        Fix Version/s 0.96.0 [ 12320040 ]
        ramkrishna.s.vasudevan made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        ramkrishna.s.vasudevan made changes -
        Attachment HBASE-5875_trunk_1.patch [ 12533348 ]
        ramkrishna.s.vasudevan made changes -
        Attachment HBASE-5875_0.94_2.patch [ 12533347 ]
        rajeshbabu made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        rajeshbabu made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        rajeshbabu made changes -
        Attachment HBASE-5875_trunk.patch [ 12533223 ]
        rajeshbabu made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        rajeshbabu made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        rajeshbabu made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        rajeshbabu made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        rajeshbabu made changes -
        Attachment HBASE-5875_trunk.patch [ 12532879 ]
        Ted Yu made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hadoop Flags Reviewed [ 10343 ]
        chunhui shen made changes -
        Attachment HBASE-5875v2.patch [ 12525969 ]
        ramkrishna.s.vasudevan made changes -
        Attachment HBASE-5875_0.94_1.patch [ 12525875 ]
        ramkrishna.s.vasudevan made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        ramkrishna.s.vasudevan made changes -
        Attachment HBASE-5875_0.94.patch [ 12525640 ]
        ramkrishna.s.vasudevan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        ramkrishna.s.vasudevan made changes -
        Attachment HBASE-5875.patch [ 12525060 ]
        ramkrishna.s.vasudevan made changes -
        Fix Version/s 0.94.1 [ 12320257 ]
        Fix Version/s 0.94.0 [ 12316419 ]
        ramkrishna.s.vasudevan made changes -
        Field Original Value New Value
        Assignee ramkrishna.s.vasudevan [ ram_krish ]
        ramkrishna.s.vasudevan created issue -

          People

          • Assignee:
            ramkrishna.s.vasudevan
            Reporter:
            ramkrishna.s.vasudevan
          • Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development