Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-30725

FLIP-281: Sink Supports Speculative Execution For Batch Job

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Done
    • None
    • 1.17.0
    • Runtime / Coordination
    • None
    • Hide
      Flink now allows sinks which implement decorative interface SupportsConcurrentExecutionAttempts to do speculative execution. If a sink(including Sink V2, SinkFunction and OutputFormat) can work properly when multiple attempts are executing at the same time, it can implement SupportsConcurrentExecutionAttempts.
      Some built in sinks are enabled to do speculative execution, including DiscardingSink, PrintSinkFunction, PrintSink, FileSink, FileSystemOutputFormat and HiveTableSink.

      More details can be found at https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/speculative_execution.
      Show
      Flink now allows sinks which implement decorative interface SupportsConcurrentExecutionAttempts to do speculative execution. If a sink(including Sink V2, SinkFunction and OutputFormat) can work properly when multiple attempts are executing at the same time, it can implement SupportsConcurrentExecutionAttempts. Some built in sinks are enabled to do speculative execution, including DiscardingSink, PrintSinkFunction, PrintSink, FileSink, FileSystemOutputFormat and HiveTableSink. More details can be found at https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/speculative_execution .

    Description

      This is the umbrella issue of FLIP-281. More details can be found in https://cwiki.apache.org/confluence/display/FLINK/FLIP-281+Sink+Supports+Speculative+Execution+For+Batch+Job.

      Attachments

        Issue Links

          There are no Sub-Tasks for this issue.

          Activity

            People

              SleePy Biao Liu
              SleePy Biao Liu
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: