Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.99.0
    • Component/s: master, Region Assignment
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      With this patch, HMaster is also a HRegionServer. Active master can serve some small tables per configuration (by default, it doesn't). Backup masters don't serve any region.

      HMaster and HRegionServer share the same RPC server. That's transparent to clients since the master information is in ZK. The master and the regionserver also shares the same web UI server.

      There is no protocol, or API change. So this feature is backward compatible, and rolling upgradable. In case it's needed, some configurations (HBASE-10815) will be added so that (1) we can have two web UI servers in the master (and backup masters), one for the master, and the other for the region server; (2) we can leave backup masters alone and don't put any regions on them. So that things are the same as before.

      With this patch, the following configurations are removed (and not used any more):

      hbase.master.dns.interface
      hbase.master.dns.nameserver
      hbase.master.port
      hbase.master.ipc.address
      hbase.master.zksession.recover.timeout
      fail.fast.expired.active.master
      hbase.master.handler.count



      Show
      With this patch, HMaster is also a HRegionServer. Active master can serve some small tables per configuration (by default, it doesn't). Backup masters don't serve any region. HMaster and HRegionServer share the same RPC server. That's transparent to clients since the master information is in ZK. The master and the regionserver also shares the same web UI server. There is no protocol, or API change. So this feature is backward compatible, and rolling upgradable. In case it's needed, some configurations ( HBASE-10815 ) will be added so that (1) we can have two web UI servers in the master (and backup masters), one for the master, and the other for the region server; (2) we can leave backup masters alone and don't put any regions on them. So that things are the same as before. With this patch, the following configurations are removed (and not used any more): hbase.master.dns.interface hbase.master.dns.nameserver hbase.master.port hbase.master.ipc.address hbase.master.zksession.recover.timeout fail.fast.expired.active.master hbase.master.handler.count

      Description

      I was thinking simplifying/improving the region assignments. The first step is to co-locate the meta and the master as many people agreed on HBASE-5487.

      1. master_rs.pdf
        72 kB
        Jimmy Xiang
      2. Co-locateMetaAndMasterHBASE-10569.pdf
        200 kB
        stack
      3. hbase-10569_v3.1.patch
        660 kB
        Jimmy Xiang
      4. hbase-10569_v3.patch
        660 kB
        Jimmy Xiang
      5. hbase-10569_v2.patch
        674 kB
        Jimmy Xiang
      6. hbase-10569_v1.patch
        654 kB
        Jimmy Xiang

        Issue Links

          Activity

            People

            • Assignee:
              Jimmy Xiang
              Reporter:
              Jimmy Xiang
            • Votes:
              0 Vote for this issue
              Watchers:
              34 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development