Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-5179

Concurrent processing of processFaileOver and ServerShutdownHandler may cause region to be assigned before log splitting is completed, causing data loss

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.90.2
    • Fix Version/s: 0.92.3
    • Component/s: master
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      If master's processing its failover and ServerShutdownHandler's processing happen concurrently, it may appear following case.
      1.master completed splitLogAfterStartup()
      2.RegionserverA restarts, and ServerShutdownHandler is processing.
      3.master starts to rebuildUserRegions, and RegionserverA is considered as dead server.
      4.master starts to assign regions of RegionserverA because it is a dead server by step3.

      However, when doing step4(assigning region), ServerShutdownHandler may be doing split log, Therefore, it may cause data loss.

        Attachments

        1. hbase-5179v9.patch
          14 kB
          chunhui shen
        2. hbase-5179v8.patch
          12 kB
          chunhui shen
        3. hbase-5179v7.patch
          10 kB
          chunhui shen
        4. hbase-5179v6.patch
          9 kB
          chunhui shen
        5. hbase-5179v5.patch
          8 kB
          chunhui shen
        6. hbase-5179v17.patch
          21 kB
          Ted Yu
        7. hbase-5179v12.patch
          20 kB
          chunhui shen
        8. hbase-5179v10.patch
          19 kB
          chunhui shen
        9. hbase-5179.patch
          7 kB
          chunhui shen
        10. Errorlog
          28 kB
          gaojinchao
        11. 5179-v4.txt
          7 kB
          Ted Yu
        12. 5179-v3.txt
          7 kB
          Ted Yu
        13. 5179-v2.txt
          7 kB
          Ted Yu
        14. 5179-v11-92.txt
          17 kB
          Ted Yu
        15. 5179-v11.txt
          18 kB
          Ted Yu
        16. 5179-92v17.patch
          20 kB
          Ted Yu
        17. 5179-90v9.patch
          20 kB
          chunhui shen
        18. 5179-90v8.patch
          19 kB
          chunhui shen
        19. 5179-90v7.patch
          17 kB
          chunhui shen
        20. 5179-90v6.patch
          17 kB
          chunhui shen
        21. 5179-90v5.patch
          14 kB
          chunhui shen
        22. 5179-90v4.patch
          9 kB
          gaojinchao
        23. 5179-90v3.patch
          14 kB
          gaojinchao
        24. 5179-90v2.patch
          9 kB
          chunhui shen
        25. 5179-90v18.txt
          24 kB
          Ted Yu
        26. 5179-90v17.txt
          24 kB
          Ted Yu
        27. 5179-90v16.patch
          24 kB
          chunhui shen
        28. 5179-90v15.patch
          24 kB
          chunhui shen
        29. 5179-90v14.patch
          22 kB
          chunhui shen
        30. 5179-90v13.txt
          22 kB
          Ted Yu
        31. 5179-90v12.patch
          22 kB
          chunhui shen
        32. 5179-90v11.patch
          19 kB
          Ted Yu
        33. 5179-90v10.patch
          20 kB
          Ted Yu
        34. 5179-90.txt
          8 kB
          Ted Yu

          Issue Links

          There are no Sub-Tasks for this issue.

            Activity

              People

              • Assignee:
                zjushch chunhui shen
                Reporter:
                zjushch chunhui shen
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: