Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7800

Reject or timeout new incoming connections once --fe_service_threads limit is reached

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 3.0, Impala 2.12.0
    • Fix Version/s: Impala 3.3.0
    • Component/s: Clients
    • Labels:
      None

      Description

      Currently, the number of frontend service threads is controlled by --fe_service_threads. Once this limit is reached, the worker threads of connection_setup_pool will block until some of the service threads exit. New incoming connections will be buffered in a queue in connection_setup_pool until it fills up. Currently, there is no time out for all these buffered connections in the queue. Consequently, if the number of frontend service threads max'ed out for an extended period of time, a client trying to connect to Impala will feel "stuck" until a front end service thread is available.

      We should consider either rejecting any new connections once --fe_service_threads limit is reached or imposing a tunable upper bound on the wait time for connections in the queue to improve the users' experience. cc'ing Zoram Thanga

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zoram Zoram Thanga
                Reporter:
                kwho Michael Ho
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: