HBase
  1. HBase
  2. HBASE-9892

Add info port to ServerName to support multi instances in a node

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.98.0, 0.99.0
    • Component/s: None
    • Labels:
      None

      Description

      The full GC time of regionserver with big heap(> 30G ) usually can not be controlled in 30s. At the same time, the servers with 64G memory are normal. So we try to deploy multi rs instances(2-3 ) in a single node and the heap of each rs is about 20G ~ 24G.

      Most of the things works fine, except the hbase web ui. The master get the RS info port from conf, which is suitable for this situation of multi rs instances in a node. So we add info port to ServerName.
      a. at the startup, rs report it's info port to Hmaster.
      b, For root region, rs write the servername with info port ro the zookeeper root-region-server node.
      c, For meta regions, rs write the servername with info port to root region
      d. For user regions, rs write the servername with info port to meta regions

      So hmaster and client can get info port from the servername.
      To test this feature, I change the rs num from 1 to 3 in standalone mode, so we can test it in standalone mode,

      I think Hoya(hbase on yarn) will encounter the same problem. Anyone knows how Hoya handle this problem?

      PS: There are different formats for servername in zk node and meta table, i think we need to unify it and refactor the code.

      1. HBASE-9892-0.94-v6.diff
        34 kB
        Liu Shaohui
      2. HBASE-9892-trunk-v3.diff
        37 kB
        Liu Shaohui
      3. HBASE-9892-trunk-v2.patch
        37 kB
        Liu Shaohui
      4. HBASE-9892-trunk-v1.patch
        38 kB
        stack
      5. HBASE-9892-trunk-v1.patch
        38 kB
        stack
      6. HBASE-9892-trunk-v1.diff
        38 kB
        Liu Shaohui
      7. HBASE-9892-v5.txt
        37 kB
        stack
      8. HBASE-9892-0.94-v5.diff
        35 kB
        Liu Shaohui
      9. HBASE-9892-0.94-v4.diff
        34 kB
        Liu Shaohui
      10. HBASE-9892-0.94-v3.diff
        17 kB
        Liu Shaohui
      11. HBASE-9892-0.94-v2.diff
        14 kB
        Liu Shaohui
      12. HBASE-9892-0.94-v1.diff
        28 kB
        Liu Shaohui

        Issue Links

          Activity

            People

            • Assignee:
              Liu Shaohui
              Reporter:
              Liu Shaohui
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development