Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-5179

Concurrent processing of processFaileOver and ServerShutdownHandler may cause region to be assigned before log splitting is completed, causing data loss

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.90.2
    • 0.92.3
    • master
    • None
    • Reviewed

    Description

      If master's processing its failover and ServerShutdownHandler's processing happen concurrently, it may appear following case.
      1.master completed splitLogAfterStartup()
      2.RegionserverA restarts, and ServerShutdownHandler is processing.
      3.master starts to rebuildUserRegions, and RegionserverA is considered as dead server.
      4.master starts to assign regions of RegionserverA because it is a dead server by step3.

      However, when doing step4(assigning region), ServerShutdownHandler may be doing split log, Therefore, it may cause data loss.

      Attachments

        1. hbase-5179.patch
          7 kB
          Chunhui Shen
        2. 5179-v2.txt
          7 kB
          Ted Yu
        3. 5179-90.txt
          8 kB
          Ted Yu
        4. 5179-v3.txt
          7 kB
          Ted Yu
        5. 5179-v4.txt
          7 kB
          Ted Yu
        6. hbase-5179v5.patch
          8 kB
          Chunhui Shen
        7. 5179-90v2.patch
          9 kB
          Chunhui Shen
        8. 5179-90v3.patch
          14 kB
          gaojinchao
        9. 5179-90v4.patch
          9 kB
          gaojinchao
        10. hbase-5179v6.patch
          9 kB
          Chunhui Shen
        11. hbase-5179v7.patch
          10 kB
          Chunhui Shen
        12. 5179-90v5.patch
          14 kB
          Chunhui Shen
        13. 5179-90v6.patch
          17 kB
          Chunhui Shen
        14. 5179-90v7.patch
          17 kB
          Chunhui Shen
        15. 5179-90v8.patch
          19 kB
          Chunhui Shen
        16. hbase-5179v8.patch
          12 kB
          Chunhui Shen
        17. 5179-90v9.patch
          20 kB
          Chunhui Shen
        18. hbase-5179v9.patch
          14 kB
          Chunhui Shen
        19. hbase-5179v10.patch
          19 kB
          Chunhui Shen
        20. 5179-v11.txt
          18 kB
          Ted Yu
        21. 5179-v11-92.txt
          17 kB
          Ted Yu
        22. 5179-90v10.patch
          20 kB
          Ted Yu
        23. 5179-90v11.patch
          19 kB
          Ted Yu
        24. 5179-90v12.patch
          22 kB
          Chunhui Shen
        25. hbase-5179v12.patch
          20 kB
          Chunhui Shen
        26. Errorlog
          28 kB
          gaojinchao
        27. 5179-90v13.txt
          22 kB
          Ted Yu
        28. 5179-90v14.patch
          22 kB
          Chunhui Shen
        29. 5179-90v15.patch
          24 kB
          Chunhui Shen
        30. 5179-90v16.patch
          24 kB
          Chunhui Shen
        31. 5179-90v17.txt
          24 kB
          Ted Yu
        32. hbase-5179v17.patch
          21 kB
          Ted Yu
        33. 5179-92v17.patch
          20 kB
          Ted Yu
        34. 5179-90v18.txt
          24 kB
          Ted Yu

        Issue Links

          Activity

            People

              zjushch Chunhui Shen
              zjushch Chunhui Shen
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: