Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-1800

Too many ZK connections

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.0, 0.90.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently we open tons of new connections to Zookeeper, like every time we instantiate a new HTable. There is a maximum number of client connections as described here:

        <property>
          <name>hbase.zookeeper.property.maxClientCnxns</name>
          <value>30</value>
          <description>Property from ZooKeeper's config zoo.cfg.
          Limit on number of concurrent connections (at the socket level) that a
          single client, identified by IP address, may make to a single member of
          the ZooKeeper ensemble. Set high to avoid zk connection issues running
          standalone and pseudo-distributed.
          </description>
        </property>
      

      If you hit that max number, ZK will just refuse your connections. Suppose you have 4 maps running on a server hosting a RS, you may actually lose your connection in the RS and eventually hit a session timeout. Maybe we should singleton ZKW?

        Attachments

        1. HBASE-1800-v3.patch
          8 kB
          Jean-Daniel Cryans
        2. HBASE-1800-v2.patch
          7 kB
          Jean-Daniel Cryans
        3. HBASE-1800-v1.patch
          6 kB
          Jean-Daniel Cryans

          Activity

            People

            • Assignee:
              jdcryans Jean-Daniel Cryans
              Reporter:
              jdcryans Jean-Daniel Cryans
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: