Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5669

Partial sort node should have a maximum reservation set by default.

    XMLWordPrintableJSON

    Details

      Description

      A change currently in review, IMPALA-5498, adds a new exec node PartialSortNode. Initially, it will just allocate memory up to the query memory limit, but once the new buffer management work in IMPALA-3200 goes in, it should be modified to operate within a memory constraint.

      PartialSortNode can operate with essentially any amount of memory, with the tradeoff that a smaller limit leads to a "lower quality", more random sort. We should investigate the performance implications of different limits, and consider making the limit configurable.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tadam Adam Tamas
                Reporter:
                twmarshall Thomas Tauber-Marshall
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: