[FLINK-31005] Release Testing: Verify FLIP-281 Supports speculative execution of sinks

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Done
• Fix Version/s: 1.17.0
• Component/s: Runtime / Coordination
• Assignee: Lijie Wang
• Reporter: Zhu Zhu
• Created: 10/Feb/23 04:01
• Updated: 21/Feb/23 07:54
• Resolved: 21/Feb/23 07:54

Description

This task aims to verify FLIP-281 Supports speculative execution of sinks.
The documentation can be found here .

Things to verify:
1. If a sink implements the decorative interface {{SupportsConcurrentExecutionAttempts}, Speculative executions can be performed, otherwise not. Sinks to verify includes SinkFunction, OutputFormat and Sink(V2).
2. These built-in sinks supports speculative execution: DiscardingSink, PrintSinkFunction, PrintSink, FileSink, FileSystemOutputFormat, HiveTableSink

It's important to verify that the final data produced are correct and the operator chain is as expected, i.e. no unexpected chain-break.

If it's hard to construct a case that speculative execution would happen, especially for those built-in sinks, the speculative execution configuration can be tuned to allow it easier to happen, e.g. set slow-task-detector.execution-time.baseline-lower-bound and slow-task-detector.execution-time.baseline-ratio to 0.

Issue Links

• is caused by: FLINK-30725 FLIP-281: Sink Supports Speculative Execution For Batch Job