[IMPALA-911] Create maintenance thread for tcmalloc

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 1.3
• Fix Version/s: Impala 1.3.1
• Assignee: Nong Li
• Reporter: Nong Li
• Created: 20/Mar/14 21:32
• Updated: 26/Mar/14 18:23
• Resolved: 26/Mar/14 18:23

Description

Tcmalloc's returning of free memory is not ideal for impala's allocation patterns causing excess memory to be stuck in tcmalloc instead of returned to the OS.

We should run something in the background that fixes this. This thread should also sync the process mem tracker to tcmallocs usage and deal with the memory used in the jvm.