Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4492

Print start timestamps for every fragment in query profile

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.5.0
    • Fix Version/s: None
    • Component/s: Distributed Exec
    • Labels:

      Description

      Trying to hunt down some slow executions consistently happening about 1/4 of the time (about 7x slower than normal).

      Comparing summaries of normal and slow queries the 'Max Time' column shows about the same for all fragments. Furthermore in the timeline the slow query takes most of the entire runtime between 'ready to start fragments' and 'all fragments started'. But there is no way to know which fragments on which nodes started late without timestamps, and no way to pinpoint a problematic node.

      Ready to start 121 remote fragments: 36ms (4ms)
      All 121 remote fragments started: 6.57s (6.53s)
      

      For more details see this discussion

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              maristir_impala_cf3d Mauricio Aristizabal
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: