HBase
  1. HBase
  2. HBASE-5179

Concurrent processing of processFaileOver and ServerShutdownHandler may cause region to be assigned before log splitting is completed, causing data loss

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.90.2
    • Fix Version/s: 0.92.3
    • Component/s: master
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      If master's processing its failover and ServerShutdownHandler's processing happen concurrently, it may appear following case.
      1.master completed splitLogAfterStartup()
      2.RegionserverA restarts, and ServerShutdownHandler is processing.
      3.master starts to rebuildUserRegions, and RegionserverA is considered as dead server.
      4.master starts to assign regions of RegionserverA because it is a dead server by step3.

      However, when doing step4(assigning region), ServerShutdownHandler may be doing split log, Therefore, it may cause data loss.

      1. 5179-90.txt
        8 kB
        Ted Yu
      2. 5179-90v10.patch
        20 kB
        Ted Yu
      3. 5179-90v11.patch
        19 kB
        Ted Yu
      4. 5179-90v12.patch
        22 kB
        chunhui shen
      5. 5179-90v13.txt
        22 kB
        Ted Yu
      6. 5179-90v14.patch
        22 kB
        chunhui shen
      7. 5179-90v15.patch
        24 kB
        chunhui shen
      8. 5179-90v16.patch
        24 kB
        chunhui shen
      9. 5179-90v17.txt
        24 kB
        Ted Yu
      10. 5179-90v18.txt
        24 kB
        Ted Yu
      11. 5179-90v2.patch
        9 kB
        chunhui shen
      12. 5179-90v3.patch
        14 kB
        gaojinchao
      13. 5179-90v4.patch
        9 kB
        gaojinchao
      14. 5179-90v5.patch
        14 kB
        chunhui shen
      15. 5179-90v6.patch
        17 kB
        chunhui shen
      16. 5179-90v7.patch
        17 kB
        chunhui shen
      17. 5179-90v8.patch
        19 kB
        chunhui shen
      18. 5179-90v9.patch
        20 kB
        chunhui shen
      19. 5179-92v17.patch
        20 kB
        Ted Yu
      20. 5179-v11.txt
        18 kB
        Ted Yu
      21. 5179-v11-92.txt
        17 kB
        Ted Yu
      22. 5179-v2.txt
        7 kB
        Ted Yu
      23. 5179-v3.txt
        7 kB
        Ted Yu
      24. 5179-v4.txt
        7 kB
        Ted Yu
      25. Errorlog
        28 kB
        gaojinchao
      26. hbase-5179.patch
        7 kB
        chunhui shen
      27. hbase-5179v10.patch
        19 kB
        chunhui shen
      28. hbase-5179v12.patch
        20 kB
        chunhui shen
      29. hbase-5179v17.patch
        21 kB
        Ted Yu
      30. hbase-5179v5.patch
        8 kB
        chunhui shen
      31. hbase-5179v6.patch
        9 kB
        chunhui shen
      32. hbase-5179v7.patch
        10 kB
        chunhui shen
      33. hbase-5179v8.patch
        12 kB
        chunhui shen
      34. hbase-5179v9.patch
        14 kB
        chunhui shen

        Issue Links

        There are no Sub-Tasks for this issue.

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              chunhui shen
              Reporter:
              chunhui shen
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development