Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3706

Planner should set min/max per-node buffer pool reservations to optimize query performance

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Later
    • Impala 2.7.0
    • None
    • Frontend

    Description

      Once we have the appropriate min/max reservation mechanisms in-place (IMPALA-3200), we should make use of them to optimise for query performance given a memory budget.

      E.g. we should preferentially allocate memory to merge aggregations over preaggregations to reduce or avoid spilling.

      Attachments

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-3200 Replace BufferedBlockMgr with new buffer pool

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. IMPALA-3700 Introduce upper limit to hash table size or HashBuckets for Streaming agg

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              tarmstrong Tim Armstrong
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: