Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-288

Excessive mem usage for certain queries which are very selective

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 0.7
    • Impala 1.0
    • None
    • None

    Description

      We changed how row batches when row batches are used from the scanner threads to the scan node. They used to be pushed eagerly, causing row batches which have few tuples. Now they are pushed when the row batch is full, accumulating external (mem pool, io buffers) until they are full. For queries that return very few rows, the accumulated resources cause excessive resource usage.

      Attachments

        Activity

          People

            nong_impala_60e1 Nong Li
            nong_impala_60e1 Nong Li
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: