[HUDI-1587] Add latency and freshness metrics for commits

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 0.8.0
• Component/s: writer-core
• Labels: pull-request-available
• Assignee: Raymond Xu
• Reporter: Raymond Xu
• Created: 05/Feb/21 10:12
• Updated: 23/Mar/21 14:16
• Resolved: 23/Mar/21 14:16

Description

For each commit, it will be useful to calculate latency (earliest record) and freshness (latest record).

Discussion thread

Issue Links

• relates to: HUDI-1654 Persist written records' latency as histogram in commit metadata
• links to: GitHub Pull Request #2541