Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5870

Partial sort profile counters don't make sense for partial sort

    Details

      Description

      The profile counters for the partial sort don't all make sense:

            SORT_NODE (id=2):(Total: 13s492ms, non-child: 2s098ms, % non-child: 15.55%)
               - InMemorySortTime: 880.839ms
               - InitialRunsCreated: 1 (1)
               - PeakMemoryUsage: 93.48 MB (98016393)
               - RowsReturned: 804.95K (804951)
               - RowsReturnedRate: 59.53 K/sec
               - SortDataSize: 89.40 MB (93742171)
               - SpilledRuns: 0 (0)
               - TotalMergesPerformed: 0 (0)
      

      We should probably indicate this is a partial sort, and consider:

      • rename/remove InitialRunsCreated/SpilledRuns - we care here about the number of partial sorts, not sure how to phrase that
      • check if this makes sense: SortDataSize
      • remove TotalMergesPerformed

      We should also address misleading info in the plan (in addition to the profile mentioned above). See Juan Yu's comment.

        Attachments

          Activity

            People

            • Assignee:
              twmarshall Thomas Tauber-Marshall
              Reporter:
              mjacobs Matthew Jacobs
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: