Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-9892

Add info port to ServerName to support multi instances in a node

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 0.98.0, 0.99.0
    • None
    • None

    Description

      The full GC time of regionserver with big heap(> 30G ) usually can not be controlled in 30s. At the same time, the servers with 64G memory are normal. So we try to deploy multi rs instances(2-3 ) in a single node and the heap of each rs is about 20G ~ 24G.

      Most of the things works fine, except the hbase web ui. The master get the RS info port from conf, which is suitable for this situation of multi rs instances in a node. So we add info port to ServerName.
      a. at the startup, rs report it's info port to Hmaster.
      b, For root region, rs write the servername with info port ro the zookeeper root-region-server node.
      c, For meta regions, rs write the servername with info port to root region
      d. For user regions, rs write the servername with info port to meta regions

      So hmaster and client can get info port from the servername.
      To test this feature, I change the rs num from 1 to 3 in standalone mode, so we can test it in standalone mode,

      I think Hoya(hbase on yarn) will encounter the same problem. Anyone knows how Hoya handle this problem?

      PS: There are different formats for servername in zk node and meta table, i think we need to unify it and refactor the code.

      Attachments

        1. HBASE-9892-0.94-v1.diff
          28 kB
          Shaohui Liu
        2. HBASE-9892-0.94-v2.diff
          14 kB
          Shaohui Liu
        3. HBASE-9892-0.94-v3.diff
          17 kB
          Shaohui Liu
        4. HBASE-9892-0.94-v4.diff
          34 kB
          Shaohui Liu
        5. HBASE-9892-0.94-v5.diff
          35 kB
          Shaohui Liu
        6. HBASE-9892-0.94-v6.diff
          34 kB
          Shaohui Liu
        7. HBASE-9892-trunk-v1.diff
          38 kB
          Shaohui Liu
        8. HBASE-9892-trunk-v1.patch
          38 kB
          Michael Stack
        9. HBASE-9892-trunk-v1.patch
          38 kB
          Michael Stack
        10. HBASE-9892-trunk-v2.patch
          37 kB
          Shaohui Liu
        11. HBASE-9892-trunk-v3.diff
          37 kB
          Shaohui Liu
        12. HBASE-9892-v5.txt
          37 kB
          Michael Stack

        Issue Links

          Activity

            People

              liushaohui Shaohui Liu
              liushaohui Shaohui Liu
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: