Details
-
Improvement
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
None
-
None
Description
add a metric to indicate whether rollback has occurred in final compaction state to warn people check flink job.
currently, when flink job start async compaction on a mor table, the metrics in org.apache.hudi.metrics.FlinkCompactionMetrics
will update including pendingCompactionCount,compactionDelay,compactionCost.
However, when a compaction failed need a metric to
tell user a specific instant whether the final compaction has occured rollback.
so attemp to add a metric named compactionFailedState in org.apache.hudi.sink.compact.CompactionCommitSink to record the instance
happend rollback, which also means the current compaction failed in current time
Attachments
Issue Links
- links to