[FLINK-25557] Introduce incremental/full checkpoint size stats

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.15.0
• Component/s: Runtime / Checkpointing, Runtime / Metrics, Runtime / REST, Runtime / State Backends
• Labels: pull-request-available
• Release Note: Introduce metrics of persistent bytes within each checkpoint (via REST API and UI), which could help users to know how much data size had been persisted during the incremental or change-log based checkpoint.
• Assignee: Yun Tang
• Reporter: Yun Tang
• Created: 06/Jan/22 12:29
• Updated: 27/Jul/22 06:53
• Resolved: 27/Jan/22 01:16

Description

Currently, the "checkpointed data size" would be incremental checkpoint size if incremental checkpoint is enabled, otherwise full checkpoint size. This is not friendly for users to know the exact incremental/full checkpoint size.

Issue Links

• causes: FLINK-26231 [Changelog] Incorrect MaterializationID passed to ChangelogStateBackendHandleImpl
• causes: FLINK-26464 Introduce new metrics to represent full checkpoint size
• causes: FLINK-28577 1.15.1 web ui console report error about checkpoint size
• is duplicated by: FLINK-25470 Add/Expose/Differentiate metrics of checkpoint size between changelog size vs materialization size
• links to: GitHub Pull Request #18324