Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-16488

Starting namespace and quota services in master startup asynchronously

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 1.3.0, 1.0.3, 1.4.0, 1.1.5, 1.2.2, 2.0.0
    • None
    • master
    • None
    • Reviewed
    • Hide
      Provide an option to start namespace service in asynchronized manner without blocking master startup. This can avoid master initialization failed due to namespace table region takes long time to assign (eg. sometimes split log takes long time or hanging; or sometimes RS is temporarily not available; sometimes due to some unknown assignment issue).
      Show
      Provide an option to start namespace service in asynchronized manner without blocking master startup. This can avoid master initialization failed due to namespace table region takes long time to assign (eg. sometimes split log takes long time or hanging; or sometimes RS is temporarily not available; sometimes due to some unknown assignment issue).

    Description

      From time to time, during internal IT test and from customer, we often see master initialization failed due to namespace table region takes long time to assign (eg. sometimes split log takes long time or hanging; or sometimes RS is temporarily not available; sometimes due to some unknown assignment issue). In the past, there was some proposal to improve this situation, eg. HBASE-13556 / HBASE-14190 (Assign system tables ahead of user region assignment) or HBASE-13557 (Special WAL handling for system tables) or HBASE-14623 (Implement dedicated WAL for system tables).

      This JIRA proposes another way to solve this master initialization fail issue: namespace service is only used by a handful operations (eg. create table / namespace DDL / get namespace API / some RS group DDL). Only quota manager depends on it and quota management is off by default. Therefore, namespace service is not really needed for master to be functional. So we could start namespace service asynchronizely without blocking master startup.

      Attachments

        1. HBASE-16488.v1-master.patch
          28 kB
          Stephen Yuan Jiang
        2. HBASE-16488.v1-branch-1.patch
          19 kB
          Stephen Yuan Jiang
        3. HBASE-16488.v2-branch-1.patch
          20 kB
          Stephen Yuan Jiang
        4. HBASE-16488.v2-branch-1.patch
          20 kB
          Stephen Yuan Jiang
        5. HBASE-16488.v3-branch-1.patch
          26 kB
          Stephen Yuan Jiang
        6. HBASE-16488.v3-branch-1.patch
          26 kB
          Stephen Yuan Jiang
        7. HBASE-16488.v4-branch-1.patch
          20 kB
          Stephen Yuan Jiang
        8. HBASE-16488.v5-branch-1.patch
          28 kB
          Stephen Yuan Jiang
        9. HBASE-16488.v6-branch-1.patch
          29 kB
          Stephen Yuan Jiang
        10. HBASE-16488.v7-branch-1.patch
          29 kB
          Stephen Yuan Jiang
        11. HBASE-16488.v8-branch-1.patch
          33 kB
          Stephen Yuan Jiang
        12. HBASE-16488.v9-branch-1.patch
          33 kB
          Stephen Yuan Jiang
        13. HBASE-16488.v10-branch-1.patch
          30 kB
          Stephen Yuan Jiang
        14. HBASE-16488.revisit.v11-branch-1.patch
          38 kB
          Xu Cang
        15. HBASE-16488.branch-1.012.patch
          38 kB
          Xu Cang
        16. HBASE-16488.branch-1.012.patch
          38 kB
          Xu Cang
        17. HBASE-16488.branch-1.013.patch
          38 kB
          Xu Cang
        18. HBASE-16488.branch-1.013.patch
          38 kB
          Xu Cang
        19. HBASE-16488.branch-1.014.patch
          39 kB
          Xu Cang
        20. HBASE-16488.branch-1.015.patch
          38 kB
          Xu Cang
        21. HBASE-16488.branch-1.016.patch
          40 kB
          Xu Cang
        22. HBASE-16488.branch-1.017.patch
          40 kB
          Xu Cang
        23. HBASE-16488.branch-1.018.patch
          40 kB
          Xu Cang

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-22263 Master creates duplicate ServerCrashProcedure on initialization, leading to assignment hanging in region-dense clusters

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-18810 TestClientScannerRPCTimeout failing in branch-1 / branch-1.4

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-22521 TestOfflineMetaRebuildBase#testHMasterStartupOnMetaRebuild failing (branch-1)

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HBASE-22533 TestAccessController3 is flaky (branch-1)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              syuanjiang Stephen Yuan Jiang
              Votes:
              0 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: