Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5073

Considering bypassing TCMalloc by default for buffer pool

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.9.0
    • Fix Version/s: None
    • Component/s: Backend

      Description

      There would be some advantages to switch from from allocating buffers via TCMalloc and instead using mmap directly - e.g. less contention for the page heap lock.

      There are also downsides - virtual memory consumption could increase and we may end up mapping and unmapping memory more frequently.

      We would also need to wire up the MemTrackers so they include this memory in the process estimate.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                tarmstrong Tim Armstrong
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: