Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-26149 Further improvements on ConnectionRegistry implementations
  3. HBASE-26220

Use P2P communicate between region servers to sync the list for bootstrap node

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-2
    • master, regionserver
    • None
    • Reviewed
    • To reduce the load of master, especially on large clusters, now region servers will contact each other to exchange the live region server list which will be returned as bootstrap nodes to client.

    Description

      For returning bootstrap nodes to client, we do not need to always track exactly the current live region server. But now, we just set a watcher on zookeeper to watch all the live region servers, on every region server, for large cluster, it will be a big pressure for zookeeper.

      So here I think, we could let region servers to communicate with each other to sync the available bootstrap node, like a P2P network.

      Will put a simple design doc soon.

      Attachments

        Activity

          People

            zhangduo Duo Zhang
            zhangduo Duo Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: