[IMPALA-9472] Keep metrics about the performance of the IO device used for the data cache

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 3.4.0
• Fix Version/s: Impala 4.0.0
• Component/s: Backend
• Epic Link: Improve data cache metrics
• Epic Color: ghx-label-7
• Assignee: Joe McDonnell
• Reporter: Joe McDonnell
• Created: 06/Mar/20 18:53
• Updated: 04/Apr/20 00:10
• Resolved: 04/Apr/20 00:10

Description

The performance of the cache will be related to the performance of the underlying disk. It is useful to add metrics to track how long it takes to read, write, and eviction entries for the cache. This should be tracked on a per-partition basis. In the case of reads, the performance can give an indication of how often the OS has kept a cache entry in buffer cache or not.