Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-1636 disable and drop of table is flakey still
  3. HBASE-2065

Cannot disable a table if any of its region is opening at the same time

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.2
    • Fix Version/s: 0.20.3, 0.90.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Also found with the test in the parent jira:

      2009-12-21 18:31:44,411 INFO  [IPC Server handler 0 on 60000] master.RegionManager(331): Assigning region table113,,1261449026166 to 10.10.1.54,60853,1261448823301
      2009-12-21 18:31:44,411 INFO  [IPC Server handler 0 on 60000] master.RegionManager(331): Assigning region table121,,1261449041385 to 10.10.1.54,60853,1261448823301
      2009-12-21 18:31:44,411 INFO  [RegionServer:1] regionserver.HRegionServer(475): MSG_REGION_OPEN: table113,,1261449026166
      2009-12-21 18:31:44,411 INFO  [RegionServer:1] regionserver.HRegionServer(475): MSG_REGION_OPEN: table121,,1261449041385
      ...
      2009-12-21 18:31:44,418 INFO  [RegionServer:1.worker] regionserver.HRegion(343): region table113,,1261449026166/21044806 available; sequence id is 0
      ...
      2009-12-21 18:31:44,445 DEBUG [IPC Server handler 4 on 60000] master.ChangeTableState(121): Adding region table113,,1261449026166 to setClosing list
      2009-12-21 18:31:44,446 DEBUG [main] zookeeper.ZooKeeperWrapper(392): Read ZNode /hbase/root-region-server got 10.10.1.54:608532009-12-21 18:31:44,447 DEBUG [main] client.HConnectionManager$TableServers(990): Found ROOT at 10.10.1.54:60853
      2009-12-21 18:31:44,447 DEBUG [main] client.HConnectionManager$TableServers(899): Cached location for .META.,,1 is 10.10.1.54:608552009-12-21 18:31:44,453 DEBUG [main] client.HConnectionManager$TableServers(554): Rowscanned=1, rowsOffline=0
      2009-12-21 18:31:44,454 DEBUG [main] client.HBaseAdmin(397): Sleep. Waiting for all regions to be disabled from table1132009-12-21 18:31:44,554 DEBUG [main] client.HBaseAdmin(406): Wake. Waiting for all regions to be disabled from table113
      ...
      2009-12-21 18:31:44,642 INFO  [RegionServer:0] regionserver.HRegionServer(475): MSG_REGION_CLOSE: table113,,1261449026166
      ...
      2009-12-21 18:31:44,642 INFO  [RegionServer:0.worker] regionserver.HRegionServer$Worker(1332): Worker: MSG_REGION_CLOSE: table113,,1261449026166
      ...
      2009-12-21 18:31:44,664 INFO  [IPC Server handler 0 on 60000] master.ServerManager(421): Processing MSG_REPORT_PROCESS_OPEN: table113,,1261449026166 from 10.10.1.54,60853,1261448823301; 1 of 4
      ...
      2009-12-21 18:31:44,664 INFO  [IPC Server handler 0 on 60000] master.ServerManager(421): Processing MSG_REPORT_OPEN: table113,,1261449026166 from 10.10.1.54,60853,1261448823301; 3 of 4
      2009-12-21 18:31:44,664 DEBUG [IPC Server handler 0 on 60000] master.ServerManager(562): region server 10.10.1.54:60853 should not have opened region table113,,1261449026166
      2009-12-21 18:31:44,666 INFO  [RegionServer:1] regionserver.HRegionServer(475): MSG_REGION_CLOSE_WITHOUT_REPORT: table113,,1261449026166: Duplicate assignment
      2009-12-21 18:31:44,666 INFO  [RegionServer:1.worker] regionserver.HRegionServer$Worker(1332): Worker: MSG_REGION_CLOSE_WITHOUT_REPORT: table113,,1261449026166: Duplicate assignment
      

      Here the master reassigned table13 and told the old region server to close the region before the new one was able to report that it opened it. At the end the new region server (good one) is also told to close it After that my test times out, table13 is not disabled neither it is deployed.

        Attachments

        1. HBASE-2065.patch
          8 kB
          Jean-Daniel Cryans
        2. HBASE-2065-2.patch
          7 kB
          Jean-Daniel Cryans
        3. HBASE-2065-2-branch.patch
          5 kB
          Jean-Daniel Cryans
        4. HBASE-2065-branch.patch
          3 kB
          Jean-Daniel Cryans

          Activity

            People

            • Assignee:
              jdcryans Jean-Daniel Cryans
              Reporter:
              jdcryans Jean-Daniel Cryans
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: