Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10682

impala-shell is slow with hs2-http

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: Impala 4.0
    • Component/s: Clients
    • Labels:
      None
    • Epic Color:
      ghx-label-11

      Description

      The following command takes 1.5 sec with hs2 and 8.5 sec with hs2-http ptotocol on my dev machine:

      shell/impala_shell.py -B -q "select * from tpch_parquet.lineitem limit 100000;" --protocol hs2-http > /dev/null
      

      Profiling has shown that the main culprit is calling socket.recv() 2809090 times. The root cause is the lack of buffering in our current http client implementation.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                csringhofer Csaba Ringhofer
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: