Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6217

Allow consumers to read messages from LEO

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • consumer, core
    • None

    Description

      we have a use case(real time customer facing application) to support high throughput(reduced latency) & high volume of transactions through Kafka. During performance testing, we noted that consumer listening to single replicated partition topics get messages faster than the consumers listening to replicated partitions.

      Make messages to be visible immediately to consumer rather than waiting for high water mark. Make change in consumer & core, based on consumer configuration, LEO messages to be visible to consumer like followers. It is the risk of consumer to lose messages during fail over of leader for which we are OK.

      Attachments

        Activity

          People

            Unassigned Unassigned
            asumailme Ashok Bala
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: