[IMPALA-6644] Add last heartbeat timestamp into Statestore metric

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: Impala 2.11.0
• Fix Version/s: Impala 3.1.0
• Component/s: Backend
• Labels: ramp-up supportability
• Flags: Important
• Epic Color: ghx-label-9
• Assignee: Pooja Nilangekar
• Reporter: Mala Chikka Kempanna
• Created: 12/Mar/18 21:56
• Updated: 30/Aug/18 16:47
• Resolved: 30/Aug/18 16:47

Description

In the latest and previous versions, statestore in it's default logging reports only when it fails to send heartbeat to any host.

There is no way to confirm if Statestore is indeed continuing to heartbeat in all passing conditions, except for turning on debug logs, which becomes too noisy. But at the same time its important to know statestore is indeed heartbeating.

The suggestion here is to add a metric in statestore metric page and also print the same in log every once in a minute(or any configurable time-frequency), reporting the last heartbeat timestamp and last heartbeat host(optional).

 

 

 

Issue Links

• relates to: IMPALA-6747 Add a diagnostics collection script