Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20194

KafkaSourceFetcherManager.commitOffsets() should handle the case when there is no split fetcher.

    XMLWordPrintableJSON

    Details

      Description

      The KafkaSourceFetcherManager.commitOffsets() may throw NPE when there is no split fetcher. Given that such cases should usually be rare and only happens when the source is shutting down or just started. We can create a new KafkaPartitionSplitReader to commit offset and close it immediately. The main thread maybe blocked for some time, but given that there is no event to process at that point, there should be no performance concerns.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                becket_qin Jiangjie Qin
                Reporter:
                becket_qin Jiangjie Qin
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: