Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-5487

Generic framework for Master-coordinated tasks

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Critical
    • Resolution: Implemented
    • 0.94.0
    • None
    • master, regionserver, Zookeeper
    • None

    Description

      Need a framework to execute master-coordinated tasks in a fault-tolerant manner.

      Master-coordinated tasks such as online-scheme change and delete-range (deleting region(s) based on start/end key) can make use of this framework.

      The advantages of framework are
      1. Eliminate repeated code in Master, ZooKeeper tracker and Region-server for master-coordinated tasks
      2. Ability to abstract the common functions across Master -> ZK and RS -> ZK
      3. Easy to plugin new master-coordinated tasks without adding code to core components

      Attachments

        1. Region management in Master5.docx
          208 kB
          Sergey Shelukhin
        2. Region management in Master.pdf
          134 kB
          Sergey Shelukhin
        3. Is the FATE of Assignment Manager FATE.pdf
          225 kB
          Jeffrey Zhong
        4. hbckMasterV2-long.pdf
          546 kB
          Jonathan Hsieh
        5. hbckMasterV2b-long.pdf
          549 kB
          Jonathan Hsieh
        6. Entity management in Master - part 1.pdf
          125 kB
          Sergey Shelukhin
        7. Entity management in Master - part 1.pdf
          138 kB
          Sergey Shelukhin

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HBASE-7629 Master initiated automatic region merges

          • Major - Major loss of function.
          • Closed
          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-5494 Introduce a zk hosted table-wide read/write lock so only one table operation at a time

          • Major - Major loss of function.
          • Closed
          is related to

          New Feature - A new feature of the product, which has yet to be developed. HBASE-7404 Bucket Cache:A solution about CMS,Heap Fragment and Big Cache on HBASE

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HBASE-11608 Add synchronous split

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-4991 Provide capability to delete named region

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-10569 Co-locate meta and master

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. HBASE-7254 Refactor AccessController ZK-mediated permissions cache into a generic mechanism

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue HBASE-6571 Generic multi-thread/cross-process error handling framework

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HBASE-10136 the table-lock of TableEventHandler is released too early because reOpenAllRegions() is asynchronous

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HBASE-7403 Online Merge

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-10544 Surface completion state of global administrative actions

          • Major - Major loss of function.
          • Closed

          Brainstorming - A place to record back and forth on notions not yet formed enough to make a 'New Feature' or 'Task' HBASE-9726 Proposal for a new master design for assignment

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              mubarakseyed Mubarak Seyed
              Votes:
              0 Vote for this issue
              Watchers:
              48 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: