HBase
  1. HBase
  2. HBASE-5179

Concurrent processing of processFaileOver and ServerShutdownHandler may cause region to be assigned before log splitting is completed, causing data loss

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.90.2
    • Fix Version/s: 0.92.3
    • Component/s: master
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      If master's processing its failover and ServerShutdownHandler's processing happen concurrently, it may appear following case.
      1.master completed splitLogAfterStartup()
      2.RegionserverA restarts, and ServerShutdownHandler is processing.
      3.master starts to rebuildUserRegions, and RegionserverA is considered as dead server.
      4.master starts to assign regions of RegionserverA because it is a dead server by step3.

      However, when doing step4(assigning region), ServerShutdownHandler may be doing split log, Therefore, it may cause data loss.

      1. hbase-5179.patch
        7 kB
        chunhui shen
      2. 5179-v2.txt
        7 kB
        Ted Yu
      3. 5179-90.txt
        8 kB
        Ted Yu
      4. 5179-v3.txt
        7 kB
        Ted Yu
      5. 5179-v4.txt
        7 kB
        Ted Yu
      6. hbase-5179v5.patch
        8 kB
        chunhui shen
      7. 5179-90v2.patch
        9 kB
        chunhui shen
      8. 5179-90v3.patch
        14 kB
        gaojinchao
      9. 5179-90v4.patch
        9 kB
        gaojinchao
      10. hbase-5179v6.patch
        9 kB
        chunhui shen
      11. hbase-5179v7.patch
        10 kB
        chunhui shen
      12. 5179-90v5.patch
        14 kB
        chunhui shen
      13. 5179-90v6.patch
        17 kB
        chunhui shen
      14. 5179-90v7.patch
        17 kB
        chunhui shen
      15. 5179-90v8.patch
        19 kB
        chunhui shen
      16. hbase-5179v8.patch
        12 kB
        chunhui shen
      17. 5179-90v9.patch
        20 kB
        chunhui shen
      18. hbase-5179v9.patch
        14 kB
        chunhui shen
      19. hbase-5179v10.patch
        19 kB
        chunhui shen
      20. 5179-v11.txt
        18 kB
        Ted Yu
      21. 5179-v11-92.txt
        17 kB
        Ted Yu
      22. 5179-90v10.patch
        20 kB
        Ted Yu
      23. 5179-90v11.patch
        19 kB
        Ted Yu
      24. 5179-90v12.patch
        22 kB
        chunhui shen
      25. hbase-5179v12.patch
        20 kB
        chunhui shen
      26. Errorlog
        28 kB
        gaojinchao
      27. 5179-90v13.txt
        22 kB
        Ted Yu
      28. 5179-90v14.patch
        22 kB
        chunhui shen
      29. 5179-90v15.patch
        24 kB
        chunhui shen
      30. 5179-90v16.patch
        24 kB
        chunhui shen
      31. 5179-90v17.txt
        24 kB
        Ted Yu
      32. hbase-5179v17.patch
        21 kB
        Ted Yu
      33. 5179-92v17.patch
        20 kB
        Ted Yu
      34. 5179-90v18.txt
        24 kB
        Ted Yu

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              chunhui shen
              Reporter:
              chunhui shen
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development