Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Trivial Trivial
    • Resolution: Fixed
    • Affects Version/s: 3.2.2
    • Fix Version/s: 3.4.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The default for maxClientCnxns is 10, which is too low for many applications. For example, HBase users often run MR jobs where each task needs to use ZooKeeper to talk to HBase. This means that each slot on the tasktracker will have at least one ZK connection. With today's beefy machines, that's easily 20+ connections per node.

      I would suggest bumping the default to 60, which will still protect against runaway nodes (eg a leak in a tight loop) but won't impact MR jobs that need to talk to ZK.

      1. zk-1030.txt
        2 kB
        Todd Lipcon
      2. zk-1030.txt
        3 kB
        Todd Lipcon

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          19m 16s 1 Todd Lipcon 25/Mar/11 22:56
          Patch Available Patch Available Resolved Resolved
          14d 45m 1 Patrick Hunt 09/Apr/11 00:41
          Resolved Resolved Closed Closed
          228d 19h 40m 1 Mahadev konar 23/Nov/11 19:22
          Hide
          rulinma added a comment -

          mark。

          Show
          rulinma added a comment - mark。
          Mahadev konar made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Hide
          Hudson added a comment -

          Integrated in ZooKeeper-trunk #1236 (See https://builds.apache.org/job/ZooKeeper-trunk/1236/)
          ZOOKEEPER-1073. address a documentation issue in ZOOKEEPER-1030. (phunt via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1143688
          Files :

          • /zookeeper/trunk/docs/zookeeperOver.html
          • /zookeeper/trunk/docs/zookeeperStarted.pdf
          • /zookeeper/trunk/docs/zookeeperProgrammers.html
          • /zookeeper/trunk/docs/zookeeperObservers.html
          • /zookeeper/trunk/docs/releasenotes.pdf
          • /zookeeper/trunk/docs/zookeeperTutorial.pdf
          • /zookeeper/trunk/docs/zookeeperJMX.html
          • /zookeeper/trunk/docs/skin/screen.css
          • /zookeeper/trunk/docs/zookeeperAdmin.pdf
          • /zookeeper/trunk/docs/index.pdf
          • /zookeeper/trunk/docs/zookeeperAdmin.html
          • /zookeeper/trunk/docs/zookeeperJMX.pdf
          • /zookeeper/trunk/docs/zookeeperInternals.pdf
          • /zookeeper/trunk/docs/javaExample.html
          • /zookeeper/trunk/docs/skin/basic.css
          • /zookeeper/trunk/docs/bookkeeperStarted.html
          • /zookeeper/trunk/docs/zookeeperObservers.pdf
          • /zookeeper/trunk/docs/zookeeperProgrammers.pdf
          • /zookeeper/trunk/docs/zookeeperStarted.html
          • /zookeeper/trunk/docs/bookkeeperOverview.html
          • /zookeeper/trunk/docs/linkmap.html
          • /zookeeper/trunk/docs/bookkeeperOverview.pdf
          • /zookeeper/trunk/docs/linkmap.pdf
          • /zookeeper/trunk/docs/bookkeeperProgrammer.html
          • /zookeeper/trunk/docs/recipes.pdf
          • /zookeeper/trunk/docs/bookkeeperStarted.pdf
          • /zookeeper/trunk/docs/zookeeperQuotas.pdf
          • /zookeeper/trunk/docs/javaExample.pdf
          • /zookeeper/trunk/docs/bookkeeperStream.pdf
          • /zookeeper/trunk/docs/zookeeperInternals.html
          • /zookeeper/trunk/docs/bookkeeperConfig.pdf
          • /zookeeper/trunk/docs/zookeeperHierarchicalQuorums.pdf
          • /zookeeper/trunk/docs/index.html
          • /zookeeper/trunk/docs/zookeeperHierarchicalQuorums.html
          • /zookeeper/trunk/docs/bookkeeperConfig.html
          • /zookeeper/trunk/docs/zookeeperTutorial.html
          • /zookeeper/trunk/docs/bookkeeperStream.html
          • /zookeeper/trunk/CHANGES.txt
          • /zookeeper/trunk/docs/releasenotes.html
          • /zookeeper/trunk/docs/zookeeperQuotas.html
          • /zookeeper/trunk/src/docs/src/documentation/content/xdocs/zookeeperAdmin.xml
          • /zookeeper/trunk/docs/recipes.html
          • /zookeeper/trunk/docs/bookkeeperProgrammer.pdf
          • /zookeeper/trunk/docs/zookeeperOver.pdf
          Show
          Hudson added a comment - Integrated in ZooKeeper-trunk #1236 (See https://builds.apache.org/job/ZooKeeper-trunk/1236/ ) ZOOKEEPER-1073 . address a documentation issue in ZOOKEEPER-1030 . (phunt via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1143688 Files : /zookeeper/trunk/docs/zookeeperOver.html /zookeeper/trunk/docs/zookeeperStarted.pdf /zookeeper/trunk/docs/zookeeperProgrammers.html /zookeeper/trunk/docs/zookeeperObservers.html /zookeeper/trunk/docs/releasenotes.pdf /zookeeper/trunk/docs/zookeeperTutorial.pdf /zookeeper/trunk/docs/zookeeperJMX.html /zookeeper/trunk/docs/skin/screen.css /zookeeper/trunk/docs/zookeeperAdmin.pdf /zookeeper/trunk/docs/index.pdf /zookeeper/trunk/docs/zookeeperAdmin.html /zookeeper/trunk/docs/zookeeperJMX.pdf /zookeeper/trunk/docs/zookeeperInternals.pdf /zookeeper/trunk/docs/javaExample.html /zookeeper/trunk/docs/skin/basic.css /zookeeper/trunk/docs/bookkeeperStarted.html /zookeeper/trunk/docs/zookeeperObservers.pdf /zookeeper/trunk/docs/zookeeperProgrammers.pdf /zookeeper/trunk/docs/zookeeperStarted.html /zookeeper/trunk/docs/bookkeeperOverview.html /zookeeper/trunk/docs/linkmap.html /zookeeper/trunk/docs/bookkeeperOverview.pdf /zookeeper/trunk/docs/linkmap.pdf /zookeeper/trunk/docs/bookkeeperProgrammer.html /zookeeper/trunk/docs/recipes.pdf /zookeeper/trunk/docs/bookkeeperStarted.pdf /zookeeper/trunk/docs/zookeeperQuotas.pdf /zookeeper/trunk/docs/javaExample.pdf /zookeeper/trunk/docs/bookkeeperStream.pdf /zookeeper/trunk/docs/zookeeperInternals.html /zookeeper/trunk/docs/bookkeeperConfig.pdf /zookeeper/trunk/docs/zookeeperHierarchicalQuorums.pdf /zookeeper/trunk/docs/index.html /zookeeper/trunk/docs/zookeeperHierarchicalQuorums.html /zookeeper/trunk/docs/bookkeeperConfig.html /zookeeper/trunk/docs/zookeeperTutorial.html /zookeeper/trunk/docs/bookkeeperStream.html /zookeeper/trunk/CHANGES.txt /zookeeper/trunk/docs/releasenotes.html /zookeeper/trunk/docs/zookeeperQuotas.html /zookeeper/trunk/src/docs/src/documentation/content/xdocs/zookeeperAdmin.xml /zookeeper/trunk/docs/recipes.html /zookeeper/trunk/docs/bookkeeperProgrammer.pdf /zookeeper/trunk/docs/zookeeperOver.pdf
          Patrick Hunt made changes -
          Link This issue relates to ZOOKEEPER-1073 [ ZOOKEEPER-1073 ]
          Patrick Hunt made changes -
          Hadoop Flags [Reviewed]
          Patrick Hunt made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hide
          Hudson added a comment -

          Integrated in ZooKeeper-trunk #1146 (See https://hudson.apache.org/hudson/job/ZooKeeper-trunk/1146/)
          ZOOKEEPER-1030: Increase default for maxClientCnxns (missed docs) (Todd Lipcon via breed/mahadev/phunt)
          ZOOKEEPER-1030: Increase default for maxClientCnxns (Todd Lipcon via breed/mahadev/phunt)

          Show
          Hudson added a comment - Integrated in ZooKeeper-trunk #1146 (See https://hudson.apache.org/hudson/job/ZooKeeper-trunk/1146/ ) ZOOKEEPER-1030 : Increase default for maxClientCnxns (missed docs) (Todd Lipcon via breed/mahadev/phunt) ZOOKEEPER-1030 : Increase default for maxClientCnxns (Todd Lipcon via breed/mahadev/phunt)
          Hide
          Patrick Hunt added a comment -

          committed to trunk. Thanks Todd!

          Show
          Patrick Hunt added a comment - committed to trunk. Thanks Todd!
          Hide
          Benjamin Reed added a comment -

          +1 looks good

          Show
          Benjamin Reed added a comment - +1 looks good
          Mahadev konar made changes -
          Assignee Todd Lipcon [ tlipcon ]
          Fix Version/s 3.4.0 [ 12314469 ]
          Fix Version/s 3.2.3 [ 12314847 ]
          Hide
          Mahadev konar added a comment -

          thanks Todd,

          We actually do not have a 3.2.3 slated for release. 3.4 is the upcoming release. Marking this for 3.4.

          Show
          Mahadev konar added a comment - thanks Todd, We actually do not have a 3.2.3 slated for release. 3.4 is the upcoming release. Marking this for 3.4.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12474673/zk-1030.txt
          against trunk revision 1082362.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed core unit tests.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://hudson.apache.org/hudson/job/PreCommit-ZOOKEEPER-Build/204//testReport/
          Findbugs warnings: https://hudson.apache.org/hudson/job/PreCommit-ZOOKEEPER-Build/204//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Console output: https://hudson.apache.org/hudson/job/PreCommit-ZOOKEEPER-Build/204//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12474673/zk-1030.txt against trunk revision 1082362. +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: https://hudson.apache.org/hudson/job/PreCommit-ZOOKEEPER-Build/204//testReport/ Findbugs warnings: https://hudson.apache.org/hudson/job/PreCommit-ZOOKEEPER-Build/204//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://hudson.apache.org/hudson/job/PreCommit-ZOOKEEPER-Build/204//console This message is automatically generated.
          Todd Lipcon made changes -
          Attachment zk-1030.txt [ 12474673 ]
          Hide
          Todd Lipcon added a comment -

          Oops, I had an out of date checkout. Take 2.

          Show
          Todd Lipcon added a comment - Oops, I had an out of date checkout. Take 2.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12474672/zk-1030.txt
          against trunk revision 1082362.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          -1 patch. The patch command could not apply the patch.

          Console output: https://hudson.apache.org/hudson/job/PreCommit-ZOOKEEPER-Build/202//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12474672/zk-1030.txt against trunk revision 1082362. +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://hudson.apache.org/hudson/job/PreCommit-ZOOKEEPER-Build/202//console This message is automatically generated.
          Todd Lipcon made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Todd Lipcon made changes -
          Field Original Value New Value
          Attachment zk-1030.txt [ 12474672 ]
          Hide
          Todd Lipcon added a comment -

          Trivial patch to change default to 60

          Show
          Todd Lipcon added a comment - Trivial patch to change default to 60
          Todd Lipcon created issue -

            People

            • Assignee:
              Todd Lipcon
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development