[IMPALA-6784] Upgrade gperftools to 2.6.90 or beyond

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 2.13.0
• Component/s: Backend
• Target Version: Product Backlog
• Epic Color: ghx-label-9
• Assignee: Joe McDonnell
• Reporter: Michael Ho
• Created: 31/Mar/18 00:58
• Updated: 03/Nov/22 03:46

Description

There are some pretty good improvements to TCMalloc in 2.6.90. Previous attempt to upgrade to 2.6.3 was reverted due to IMPALA-6414 which has been fixed since then.

gperftools 2.7rc is out!

Changes:

Most notable change in this release is that very large allocations (>1MiB) are now handled be O(log n) implementation. This is contributed by Todd Lipcon based on earlier work by Aliaksei Kandratsenka and James Golick. Special thanks to Alexey Serbin for contributing OSX fix for that commit.

detection of sized deallocation support is improved. Which should fix another set of issues building on OSX. Much thanks to Alexey Serbin for reporting the issue, suggesting a fix and verifying it.

Todd Lipcon made a change to extend page heaps freelists to 1 MiB (up from 1MiB - 8KiB). This may help a little for some workloads.

Ishan Arora contributed typo fix to docs

Issue Links

• relates to: IMPALA-8732 tcmalloc contention in Coordinator::BackendState::Exec()
• relates to: IMPALA-8737 Patch gperftools to fix O(n) scaling in PageHeap::AllocLarge()