Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-2935 Implement HiveServer2
  3. HIVE-4132

Connection to Zookeeper is created for each client of HS2

    XMLWordPrintableJSON

    Details

      Description

      Currently when concurrency is enabled and HS2 is used each client will have a connection to Zookeeper. Zookeeper has a property, maxClientCnxns, in the zoo.cfg which limits the number of connections per host to a low number like 50. The stack trace of the threads accessing zookeeper is below for reference.

      - org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.lock(java.util.List, boolean) @bci=94, line=220 (Interpreted frame)
       - org.apache.hadoop.hive.ql.Driver.acquireReadWriteLocks() @bci=428, line=834 (Interpreted frame)
       - org.apache.hadoop.hive.ql.Driver.run(java.lang.String) @bci=453, line=944 (Interpreted frame)
       - org.apache.hive.service.cli.operation.SQLOperation.run() @bci=126, line=95 (Interpreted frame)
       - org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(java.lang.String, java.util.Map) @bci=19, line=168 (Interpreted frame)
       - org.apache.hive.service.cli.CLIService.executeStatement(org.apache.hive.service.cli.SessionHandle, java.lang.String, java.util.Map) @bci=10, line=153 (Interpreted frame)
       - org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(org.apache.hive.service.cli.thrift.TExecuteStatementReq) @bci=41, line=190 (Interpreted frame)
       - org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(org.apache.hive.service.cli.thrift.TCLIService$Iface, org.apache.hive.service.cli.thrift.TCLIService$ExecuteStatement_args) @bci=14, line=1133 (Interpreted frame)
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Ferd Ferdinand Xu
                Reporter:
                brocknoland Brock Noland
              • Votes:
                2 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated: