[FLINK-15202] Increment metric when Interval Join record is late

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: API / DataStream
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Chris Gillespie
• Created: 11/Dec/19 17:22
• Updated: 27/Nov/21 03:40

Description

Currently an interval join will silently drop late records. I think it would be quite useful to have the metric numLateRecordsDropped incremented when this happens. Window Join already does this, so it would make sense to have it happen for both types of joins.

Mailing List Idea: https://lists.apache.org/thread.html/f463d81db3777a529d1764723189a57c33d601a6c142441fb5036ff9%40%3Cuser.flink.apache.org%3E

Window Join:
https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperator.java#L424

Interval Join:
https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/co/IntervalJoinOperator.java#L222