Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10569

Co-locate meta and master

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.99.0
    • master, Region Assignment
    • None
    • Reviewed
    • Hide
      With this patch, HMaster is also a HRegionServer. Active master can serve some small tables per configuration (by default, it doesn't). Backup masters don't serve any region.

      HMaster and HRegionServer share the same RPC server. That's transparent to clients since the master information is in ZK. The master and the regionserver also shares the same web UI server.

      There is no protocol, or API change. So this feature is backward compatible, and rolling upgradable. In case it's needed, some configurations (HBASE-10815) will be added so that (1) we can have two web UI servers in the master (and backup masters), one for the master, and the other for the region server; (2) we can leave backup masters alone and don't put any regions on them. So that things are the same as before.

      With this patch, the following configurations are removed (and not used any more):

      hbase.master.dns.interface
      hbase.master.dns.nameserver
      hbase.master.port
      hbase.master.ipc.address
      hbase.master.zksession.recover.timeout
      fail.fast.expired.active.master
      hbase.master.handler.count



      Show
      With this patch, HMaster is also a HRegionServer. Active master can serve some small tables per configuration (by default, it doesn't). Backup masters don't serve any region. HMaster and HRegionServer share the same RPC server. That's transparent to clients since the master information is in ZK. The master and the regionserver also shares the same web UI server. There is no protocol, or API change. So this feature is backward compatible, and rolling upgradable. In case it's needed, some configurations ( HBASE-10815 ) will be added so that (1) we can have two web UI servers in the master (and backup masters), one for the master, and the other for the region server; (2) we can leave backup masters alone and don't put any regions on them. So that things are the same as before. With this patch, the following configurations are removed (and not used any more): hbase.master.dns.interface hbase.master.dns.nameserver hbase.master.port hbase.master.ipc.address hbase.master.zksession.recover.timeout fail.fast.expired.active.master hbase.master.handler.count

    Description

      I was thinking simplifying/improving the region assignments. The first step is to co-locate the meta and the master as many people agreed on HBASE-5487.

      Attachments

        1. Co-locateMetaAndMasterHBASE-10569.pdf
          200 kB
          Michael Stack
        2. hbase-10569_v1.patch
          654 kB
          Jimmy Xiang
        3. hbase-10569_v2.patch
          674 kB
          Jimmy Xiang
        4. hbase-10569_v3.1.patch
          660 kB
          Jimmy Xiang
        5. hbase-10569_v3.patch
          660 kB
          Jimmy Xiang
        6. master_rs.pdf
          72 kB
          Jimmy Xiang

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HBASE-14644 Region in transition metric is broken

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-12034 If I kill single RS in branch-1, all regions end up on Master!

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-10923 Control where to put meta region

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-11146 HMaster instantiates both MasterCoprocessorHost and RegionServerCoprocessorHost

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HBASE-5487 Generic framework for Master-coordinated tasks

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              jxiang Jimmy Xiang
              jxiang Jimmy Xiang
              Votes:
              0 Vote for this issue
              Watchers:
              34 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: