Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-24824

Define metrics for compaction observability

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Many times if there are failures in the Compaction background processes (Initiator, Worker, Cleaner) it is hard notice the problem until it causes serious performance degradation.
      We should create new JMX metrics, that would make it easier to monitor the compaction health. Examples are:

      • number of failed / initiated compaction
      • number of aborted txns, oldest aborted txns
      • tables with disabled compactions and writes
      • Initiator and Cleaner cycle runtime
      • Size of ACID metadata tables that should have ~ constant rows (txn_to_writeId, completed_txns)

       

      Attachments

        Issue Links

          There are no Sub-Tasks for this issue.

          Activity

            People

              dkuzmenko Denys Kuzmenko
              pvargacl Peter Varga
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 32h 40m
                  32h 40m