Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.99.0
    • Component/s: master, Region Assignment
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      With this patch, HMaster is also a HRegionServer. Active master can serve some small tables per configuration (by default, it doesn't). Backup masters don't serve any region.

      HMaster and HRegionServer share the same RPC server. That's transparent to clients since the master information is in ZK. The master and the regionserver also shares the same web UI server.

      There is no protocol, or API change. So this feature is backward compatible, and rolling upgradable. In case it's needed, some configurations (HBASE-10815) will be added so that (1) we can have two web UI servers in the master (and backup masters), one for the master, and the other for the region server; (2) we can leave backup masters alone and don't put any regions on them. So that things are the same as before.

      With this patch, the following configurations are removed (and not used any more):

      hbase.master.dns.interface
      hbase.master.dns.nameserver
      hbase.master.port
      hbase.master.ipc.address
      hbase.master.zksession.recover.timeout
      fail.fast.expired.active.master
      hbase.master.handler.count



      Show
      With this patch, HMaster is also a HRegionServer. Active master can serve some small tables per configuration (by default, it doesn't). Backup masters don't serve any region. HMaster and HRegionServer share the same RPC server. That's transparent to clients since the master information is in ZK. The master and the regionserver also shares the same web UI server. There is no protocol, or API change. So this feature is backward compatible, and rolling upgradable. In case it's needed, some configurations ( HBASE-10815 ) will be added so that (1) we can have two web UI servers in the master (and backup masters), one for the master, and the other for the region server; (2) we can leave backup masters alone and don't put any regions on them. So that things are the same as before. With this patch, the following configurations are removed (and not used any more): hbase.master.dns.interface hbase.master.dns.nameserver hbase.master.port hbase.master.ipc.address hbase.master.zksession.recover.timeout fail.fast.expired.active.master hbase.master.handler.count

      Description

      I was thinking simplifying/improving the region assignments. The first step is to co-locate the meta and the master as many people agreed on HBASE-5487.

        Attachments

        1. hbase-10569_v1.patch
          654 kB
          Jimmy Xiang
        2. hbase-10569_v2.patch
          674 kB
          Jimmy Xiang
        3. hbase-10569_v3.patch
          660 kB
          Jimmy Xiang
        4. hbase-10569_v3.1.patch
          660 kB
          Jimmy Xiang
        5. Co-locateMetaAndMasterHBASE-10569.pdf
          200 kB
          stack
        6. master_rs.pdf
          72 kB
          Jimmy Xiang

          Issue Links

          There are no Sub-Tasks for this issue.

            Activity

              People

              • Assignee:
                jxiang Jimmy Xiang
                Reporter:
                jxiang Jimmy Xiang
              • Votes:
                0 Vote for this issue
                Watchers:
                35 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: