Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-16488

Starting namespace and quota services in master startup asynchronously

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.3.0, 1.0.3, 1.4.0, 1.1.5, 1.2.2, 2.0.0
    • Fix Version/s: None
    • Component/s: master
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Provide an option to start namespace service in asynchronized manner without blocking master startup. This can avoid master initialization failed due to namespace table region takes long time to assign (eg. sometimes split log takes long time or hanging; or sometimes RS is temporarily not available; sometimes due to some unknown assignment issue).
      Show
      Provide an option to start namespace service in asynchronized manner without blocking master startup. This can avoid master initialization failed due to namespace table region takes long time to assign (eg. sometimes split log takes long time or hanging; or sometimes RS is temporarily not available; sometimes due to some unknown assignment issue).

      Description

      From time to time, during internal IT test and from customer, we often see master initialization failed due to namespace table region takes long time to assign (eg. sometimes split log takes long time or hanging; or sometimes RS is temporarily not available; sometimes due to some unknown assignment issue). In the past, there was some proposal to improve this situation, eg. HBASE-13556 / HBASE-14190 (Assign system tables ahead of user region assignment) or HBASE-13557 (Special WAL handling for system tables) or HBASE-14623 (Implement dedicated WAL for system tables).

      This JIRA proposes another way to solve this master initialization fail issue: namespace service is only used by a handful operations (eg. create table / namespace DDL / get namespace API / some RS group DDL). Only quota manager depends on it and quota management is off by default. Therefore, namespace service is not really needed for master to be functional. So we could start namespace service asynchronizely without blocking master startup.

        Attachments

        1. HBASE-16488.branch-1.012.patch
          38 kB
          Xu Cang
        2. HBASE-16488.branch-1.012.patch
          38 kB
          Xu Cang
        3. HBASE-16488.branch-1.013.patch
          38 kB
          Xu Cang
        4. HBASE-16488.branch-1.013.patch
          38 kB
          Xu Cang
        5. HBASE-16488.branch-1.014.patch
          39 kB
          Xu Cang
        6. HBASE-16488.branch-1.015.patch
          38 kB
          Xu Cang
        7. HBASE-16488.branch-1.016.patch
          40 kB
          Xu Cang
        8. HBASE-16488.branch-1.017.patch
          40 kB
          Xu Cang
        9. HBASE-16488.branch-1.018.patch
          40 kB
          Xu Cang
        10. HBASE-16488.revisit.v11-branch-1.patch
          38 kB
          Xu Cang
        11. HBASE-16488.v10-branch-1.patch
          30 kB
          Stephen Yuan Jiang
        12. HBASE-16488.v1-branch-1.patch
          19 kB
          Stephen Yuan Jiang
        13. HBASE-16488.v1-master.patch
          28 kB
          Stephen Yuan Jiang
        14. HBASE-16488.v2-branch-1.patch
          20 kB
          Stephen Yuan Jiang
        15. HBASE-16488.v2-branch-1.patch
          20 kB
          Stephen Yuan Jiang
        16. HBASE-16488.v3-branch-1.patch
          26 kB
          Stephen Yuan Jiang
        17. HBASE-16488.v3-branch-1.patch
          26 kB
          Stephen Yuan Jiang
        18. HBASE-16488.v4-branch-1.patch
          20 kB
          Stephen Yuan Jiang
        19. HBASE-16488.v5-branch-1.patch
          28 kB
          Stephen Yuan Jiang
        20. HBASE-16488.v6-branch-1.patch
          29 kB
          Stephen Yuan Jiang
        21. HBASE-16488.v7-branch-1.patch
          29 kB
          Stephen Yuan Jiang
        22. HBASE-16488.v8-branch-1.patch
          33 kB
          Stephen Yuan Jiang
        23. HBASE-16488.v9-branch-1.patch
          33 kB
          Stephen Yuan Jiang

          Issue Links

            Activity

              People

              • Assignee:
                xucang Xu Cang
                Reporter:
                syuanjiang Stephen Yuan Jiang
              • Votes:
                0 Vote for this issue
                Watchers:
                18 Start watching this issue

                Dates

                • Created:
                  Updated: