Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-7011

a metric to indicate whether rollback has occurred in final compaction state

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 1.0.0-beta1
    • None

    Description

      add a metric to indicate whether rollback has occurred in final compaction state to warn people check flink job.

      currently, when flink job start async compaction on a mor table, the metrics in org.apache.hudi.metrics.FlinkCompactionMetrics 
      will update including pendingCompactionCount,compactionDelay,compactionCost.

      However, when a compaction failed need a metric to
      tell user a specific instant whether the final compaction has occured rollback.

      so attemp to add a metric named compactionFailedState in org.apache.hudi.sink.compact.CompactionCommitSink to record the instance
      happend rollback, which also means the current compaction failed in current time

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              GoTT jack Lei
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: