[SAMZA-539] Add generic lag metric from high watermark - last processed message

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.9.0
• Component/s: metrics
• Labels: newbie++
• Assignee: Unassigned
• Reporter: Yan Fang
• Created: 29/Jan/15 18:32
• Updated: 05/Mar/16 18:18

Description

This is a follow-up ticket for SAMZA-503 .

The gauge is to show the lag between the offset of the most recent message on the incoming stream and the offset of the most recent message that the StreamTask has processed.

As discussed in SAMZA-503, we could add a IncomingMessageEnvelope.getMaxOffset() API .

Issue Links

• relates to: SAMZA-503 Lag gauge very slow to update for slow jobs