Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-5179

Concurrent processing of processFaileOver and ServerShutdownHandler may cause region to be assigned before log splitting is completed, causing data loss

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.90.2
    • 0.92.3
    • master
    • None
    • Reviewed

    Description

      If master's processing its failover and ServerShutdownHandler's processing happen concurrently, it may appear following case.
      1.master completed splitLogAfterStartup()
      2.RegionserverA restarts, and ServerShutdownHandler is processing.
      3.master starts to rebuildUserRegions, and RegionserverA is considered as dead server.
      4.master starts to assign regions of RegionserverA because it is a dead server by step3.

      However, when doing step4(assigning region), ServerShutdownHandler may be doing split log, Therefore, it may cause data loss.

      Attachments

        1. 5179-90.txt
          8 kB
          Ted Yu
        2. 5179-90v10.patch
          20 kB
          Ted Yu
        3. 5179-90v11.patch
          19 kB
          Ted Yu
        4. 5179-90v12.patch
          22 kB
          Chunhui Shen
        5. 5179-90v13.txt
          22 kB
          Ted Yu
        6. 5179-90v14.patch
          22 kB
          Chunhui Shen
        7. 5179-90v15.patch
          24 kB
          Chunhui Shen
        8. 5179-90v16.patch
          24 kB
          Chunhui Shen
        9. 5179-90v17.txt
          24 kB
          Ted Yu
        10. 5179-90v18.txt
          24 kB
          Ted Yu
        11. 5179-90v2.patch
          9 kB
          Chunhui Shen
        12. 5179-90v3.patch
          14 kB
          gaojinchao
        13. 5179-90v4.patch
          9 kB
          gaojinchao
        14. 5179-90v5.patch
          14 kB
          Chunhui Shen
        15. 5179-90v6.patch
          17 kB
          Chunhui Shen
        16. 5179-90v7.patch
          17 kB
          Chunhui Shen
        17. 5179-90v8.patch
          19 kB
          Chunhui Shen
        18. 5179-90v9.patch
          20 kB
          Chunhui Shen
        19. 5179-92v17.patch
          20 kB
          Ted Yu
        20. 5179-v11.txt
          18 kB
          Ted Yu
        21. 5179-v11-92.txt
          17 kB
          Ted Yu
        22. 5179-v2.txt
          7 kB
          Ted Yu
        23. 5179-v3.txt
          7 kB
          Ted Yu
        24. 5179-v4.txt
          7 kB
          Ted Yu
        25. Errorlog
          28 kB
          gaojinchao
        26. hbase-5179.patch
          7 kB
          Chunhui Shen
        27. hbase-5179v10.patch
          19 kB
          Chunhui Shen
        28. hbase-5179v12.patch
          20 kB
          Chunhui Shen
        29. hbase-5179v17.patch
          21 kB
          Ted Yu
        30. hbase-5179v5.patch
          8 kB
          Chunhui Shen
        31. hbase-5179v6.patch
          9 kB
          Chunhui Shen
        32. hbase-5179v7.patch
          10 kB
          Chunhui Shen
        33. hbase-5179v8.patch
          12 kB
          Chunhui Shen
        34. hbase-5179v9.patch
          14 kB
          Chunhui Shen

        Issue Links

          Activity

            People

              zjushch Chunhui Shen
              zjushch Chunhui Shen
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: