Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10569

Co-locate meta and master

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.99.0
    • master, Region Assignment
    • None
    • Reviewed
    • Hide
      With this patch, HMaster is also a HRegionServer. Active master can serve some small tables per configuration (by default, it doesn't). Backup masters don't serve any region.

      HMaster and HRegionServer share the same RPC server. That's transparent to clients since the master information is in ZK. The master and the regionserver also shares the same web UI server.

      There is no protocol, or API change. So this feature is backward compatible, and rolling upgradable. In case it's needed, some configurations (HBASE-10815) will be added so that (1) we can have two web UI servers in the master (and backup masters), one for the master, and the other for the region server; (2) we can leave backup masters alone and don't put any regions on them. So that things are the same as before.

      With this patch, the following configurations are removed (and not used any more):

      hbase.master.dns.interface
      hbase.master.dns.nameserver
      hbase.master.port
      hbase.master.ipc.address
      hbase.master.zksession.recover.timeout
      fail.fast.expired.active.master
      hbase.master.handler.count



      Show
      With this patch, HMaster is also a HRegionServer. Active master can serve some small tables per configuration (by default, it doesn't). Backup masters don't serve any region. HMaster and HRegionServer share the same RPC server. That's transparent to clients since the master information is in ZK. The master and the regionserver also shares the same web UI server. There is no protocol, or API change. So this feature is backward compatible, and rolling upgradable. In case it's needed, some configurations ( HBASE-10815 ) will be added so that (1) we can have two web UI servers in the master (and backup masters), one for the master, and the other for the region server; (2) we can leave backup masters alone and don't put any regions on them. So that things are the same as before. With this patch, the following configurations are removed (and not used any more): hbase.master.dns.interface hbase.master.dns.nameserver hbase.master.port hbase.master.ipc.address hbase.master.zksession.recover.timeout fail.fast.expired.active.master hbase.master.handler.count

    Description

      I was thinking simplifying/improving the region assignments. The first step is to co-locate the meta and the master as many people agreed on HBASE-5487.

      Attachments

        1. hbase-10569_v1.patch
          654 kB
          Jimmy Xiang
        2. hbase-10569_v2.patch
          674 kB
          Jimmy Xiang
        3. hbase-10569_v3.patch
          660 kB
          Jimmy Xiang
        4. hbase-10569_v3.1.patch
          660 kB
          Jimmy Xiang
        5. Co-locateMetaAndMasterHBASE-10569.pdf
          200 kB
          Michael Stack
        6. master_rs.pdf
          72 kB
          Jimmy Xiang

        Issue Links

          Activity

            People

              jxiang Jimmy Xiang
              jxiang Jimmy Xiang
              Votes:
              0 Vote for this issue
              Watchers:
              34 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: