[KAFKA-17220] Define new metrics for MirrorMaker2

• Type: New Feature
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: mirrormaker
• Labels: needs-kip
• Assignee: PoAn Yang
• Reporter: Greg Harris
• Created: 30/Jul/24 15:52
• Updated: 17/Sep/24 12:44

Description

MirrorMaker2 provides some observability into it's operation, but lacks observability in the following areas:

• Number of replicated topics/partitions
• Number of consumer groups & consumer offsets
• Background job success/failure/latency/duration
• Checkpoint task startup time
• Consumer group translation lag/expected redelivered data
• Error metrics for failed offset translations

These concepts should be more clearly defined and included in a general observability KIP for MM2.