[FLINK-33524] IntervalJoinOperator 's judgment on late data has bug

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.18.0
• Component/s: API / DataStream

Environment

Due to the Watermark calculation method :

public void onPeriodicEmit(WatermarkOutput output) {
            output.emitWatermark(new Watermark(maxTs - delayTime - 1L));
        }

 data that was delayed by 1 millisecond in this method was incorrectly determined

private boolean isLate(long timestamp) {
    long currentWatermark = internalTimerService.currentWatermark();
    return timestamp < currentWatermark;
} 

 

Language

Java

• Assignee: Unassigned
• Reporter: ZhangTao
• Created: 11/Nov/23 03:50
• Updated: 11/Nov/23 07:18

Description

package:
org.apache.flink.streaming.api.operators.co;
 
class: IntervalJoinOperator
 
method:
isLate
 
When data with a 1-millisecond delay enters the judgment, an incorrect value will be returned

private boolean isLate(long timestamp) {
    long currentWatermark = internalTimerService.currentWatermark();
    return timestamp < currentWatermark;
} 

Issue Links

• links to: GitHub Pull Request #23699