Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-9760

KafkaIO supports consumer group?

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • io-java-kafka
    • None

    Description

      It seems only assign method of Kafka Consumer class is called in org.apache.beam.sdk.io.kafka.ConsumerSpEL class. According to documentation of org.apache.kafka.clients.consumer.KafkaConsumer,  manual topic assignment through this assign method does not use the consumer's group management functionality.

      May I ask if KafkaIO will be enhanced to support consumer's group management with using Kafka consumer's subscribe method?

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            wongkawah Ka Wah WONG
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: