Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-31121

KafkaSink should be able to catch and ignore exp via config on/off

    XMLWordPrintableJSON

Details

    Description

      It is a common requirement for users to catch and ignore exp while sinking the event to to downstream system like Kafka. It will be convenient for some use cases, if Flink Sink can provide built-in functionality and config to turn it on and off, especially for cases that data consistency is not very important or the stream contains dirty events. [1][2]

      First of all, consider doing it for KafkaSink. Long term, a common solution that can be used by any connector would be even better.

       

      [1]https://lists.apache.org/thread/wy31s8wb9qnskq29wn03kp608z4vrwv8

      [2]https://stackoverflow.com/questions/52308911/how-to-handle-exceptions-in-kafka-sink

       

       

      Attachments

        Issue Links

          Activity

            People

              zjureel Fang Yong
              jingge Jing Ge
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: