Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-22902

Port KafkaSink to new Unified Sink API (FLIP-143)

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Hide
      `KafkaSink` supersedes `FlinkKafkaProducer` and provides efficient exactly-once and at-least-once writing with the new unified sink interface supporting both batch and streaming mode of DataStream API. To upgrade, please stop with savepoint. `KafkaSink` needs a user-configured and unique transaction prefix, such that transactions of different applications do not interfere with each other.
      Show
      `KafkaSink` supersedes `FlinkKafkaProducer` and provides efficient exactly-once and at-least-once writing with the new unified sink interface supporting both batch and streaming mode of DataStream API. To upgrade, please stop with savepoint. `KafkaSink` needs a user-configured and unique transaction prefix, such that transactions of different applications do not interfere with each other.

    Description

      As one of the most commonly connectors, Kafka sink should be ported to the new interfaces as quickly as possible such that Flink would support batch queries on Kafka.

      The implementation should probably follow the current implementation as close as possible.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            fpaul Fabian Paul
            arvid Arvid Heise
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment