Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3610

Track non-RPC memory from global runtime filters on the coordinator

    XMLWordPrintableJSON

    Details

      Description

      When running queries on a 1000x node cluster I noticed that the coordinator memory spikes due to global runtime filters, much of this memory is untracked and can easily cause the coordinator to the hit process memory limit.

      NOTE: the fix for this issue did not fully solve the problem because it didn't track RPC payloads. See IMPALA-6412 for future work on the problem

        Attachments

        1. TPC-DS Q25 Bolt 200.txt
          5.74 MB
          Mostafa Mokhtar

          Issue Links

            Activity

              People

              • Assignee:
                sailesh Sailesh Mukil
                Reporter:
                mmokhtar Mostafa Mokhtar
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: