[HIVE-24824] Define metrics for compaction observability

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0
• Labels: pull-request-available
• Assignee: Denys Kuzmenko
• Reporter: Peter Varga
• Created: 24/Feb/21 17:44
• Updated: 09/Sep/24 11:59
• Resolved: 09/Sep/24 11:59

Description

Many times if there are failures in the Compaction background processes (Initiator, Worker, Cleaner) it is hard notice the problem until it causes serious performance degradation.
We should create new JMX metrics, that would make it easier to monitor the compaction health. Examples are:

• number of failed / initiated compaction
• number of aborted txns, oldest aborted txns
• tables with disabled compactions and writes
• Initiator and Cleaner cycle runtime
• Size of ACID metadata tables that should have ~ constant rows (txn_to_writeId, completed_txns)

 

Issue Links

• links to: GitHub Pull Request #2016