Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-24277

Offset commit should be disabled if consumer group ID is not specified in KafkaSource

    XMLWordPrintableJSON

    Details

      Description

      FLINK-24051 made "group.id" an optional configuration in KafkaSource. However, KafkaSource will generate a random group id if user doesn't specify one, and this random ID is inconsistent after failover, and not even human readable.

      A solution will be adding a configuration for offset commit on checkpoint, make it as true by default, and disable offset commit if group id is not specified. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                renqs Qingsheng Ren
                Reporter:
                renqs Qingsheng Ren
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: