Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
Impala 3.4.0
-
None
-
None
-
ghx-label-9
Description
Currently, the memory used to track metadata for the data cache is untracked. When comparing cache eviction algorithms (or just monitoring the cache), the metadata size is a useful metric for comparison.
The cache implementation contains a kudu MemTracker ( https://github.com/apache/impala/blob/master/be/src/util/cache/cache.cc#L154 ). This MemTracker does not integrate with Impala's MemTracker hierarchy, and it tracks the usage in the cache (not the metadata size). This should be modified to track metadata size and integrate with Impala's MemTracker hierarchy.