[FLINK-30725] FLIP-281: Sink Supports Speculative Execution For Batch Job - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Release Note:

Hide
Flink now allows sinks which implement decorative interface SupportsConcurrentExecutionAttempts to do speculative execution. If a sink(including Sink V2, SinkFunction and OutputFormat) can work properly when multiple attempts are executing at the same time, it can implement SupportsConcurrentExecutionAttempts.
Some built in sinks are enabled to do speculative execution, including DiscardingSink, PrintSinkFunction, PrintSink, FileSink, FileSystemOutputFormat and HiveTableSink.

More details can be found at https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/speculative_execution.

Show
Flink now allows sinks which implement decorative interface SupportsConcurrentExecutionAttempts to do speculative execution. If a sink(including Sink V2, SinkFunction and OutputFormat) can work properly when multiple attempts are executing at the same time, it can implement SupportsConcurrentExecutionAttempts. Some built in sinks are enabled to do speculative execution, including DiscardingSink, PrintSinkFunction, PrintSink, FileSink, FileSystemOutputFormat and HiveTableSink. More details can be found at https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/speculative_execution .