Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5644

Fail queries early when their minimum reservation is too high to execute within the given mem_limit

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 2.10.0
    • Fix Version/s: Impala 2.10.0
    • Component/s: Frontend
    • Labels:
      None

      Description

      With the initial version of IMPALA-3200, we won't check whether the minimum reservation fits within the query memory limit until fragment startup time.

      There are a couple of decisions to make here:

      • How to deal with the RESERVATION_MEM_FRACTION/RESERVATION_MEM_MIN_REMAINING heuristic that limits reservation relative to the query mem_limit
      • Where to actually reject the query

      This is a bit tricky since it needs to happen after we've determined the applicable memory limit (which depends on resolving the request pool). Admission control would be one place but admission control can be disabled.

        Attachments

          Activity

            People

            • Assignee:
              mjacobs Matthew Jacobs
              Reporter:
              tarmstrong Tim Armstrong
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: