Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7446

Queries can spill earlier than necessary because of accumulation of free buffers and clean pages

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: Impala 2.10.0, Impala 2.11.0, Impala 3.0, Impala 2.12.0
    • Fix Version/s: Impala 3.2.0
    • Component/s: Backend

      Description

      See IMPALA-7442 for an example where the query started to spill even when memory could have been made available by freeing buffers or evicting clean pages. Usually this would just result in spilling earlier than necessary, but in the case of IMPALA-7442 it lead to a query failure.

      My original intent was that BufferPool::ReleaseMemory() should be called in situations like this, but that was not done.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tarmstrong Tim Armstrong
                Reporter:
                tarmstrong Tim Armstrong
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: