Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7819

Scanners should include "storage wait time" per scan node

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Impala 3.2.0
    • Component/s: Backend
    • Labels:
      None

      Description

      We have TotalStorageWaitTime per fragment instance, which aggregates various things like times spent waiting for the I/O manager and time spent in the Kudu client. This is useful but often we want to understand why a specific scan is slow. This is tricky because TotalStorageWaitTime and the various scanner thread timers in the profile are in different subsections and don't measure comparable things if there are multiple scans in the profile.

      We should also include this timings in the scan profile to address this.

        Attachments

          Activity

            People

            • Assignee:
              tarmstrong Tim Armstrong
              Reporter:
              tarmstrong Tim Armstrong
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: