Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9378

CPU usage for runtime profiles with multithreading

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Backend

      Description

      David Rorke reports that significant amounts of time can be spent on the runtime profile with higher values of mt_dop. This can impact query performance from the client's point of view since profile serialisation is on the critical path for closing the query. Also serialising the profile for the webserver holds the ClientRequestState's lock, so can block query progress.

      We should figure out how to make this more efficient.

        Attachments

        1. coord_q5_dop0.svg
          357 kB
          Tim Armstrong
        2. coord_q5_dop16.svg
          888 kB
          Tim Armstrong

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                tarmstrong Tim Armstrong
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated: