Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4155

Get Kafka producer partition info in open method instead of constructor

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.0.3, 1.1.0
    • 1.2.0
    • Connectors / Kafka
    • None

    Description

      Currently the Flink Kafka producer does not really do any error handling if something is wrong with the partition metadata as it is serialized with the user function.

      This means that in some cases the job can go into an error loop when using the checkpoints. Getting the partition info in the open method would solve this problem (like restarting from a savepoint which re-runs the constructor).

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-4023 Move Kafka consumer partition discovery from constructor to open()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #2681

          Activity

            People

              tzulitai Tzu-Li (Gordon) Tai
              gyfora Gyula Fora
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: