Description
we have a use case(real time customer facing application) to support high throughput(reduced latency) & high volume of transactions through Kafka. During performance testing, we noted that consumer listening to single replicated partition topics get messages faster than the consumers listening to replicated partitions.
Make messages to be visible immediately to consumer rather than waiting for high water mark. Make change in consumer & core, based on consumer configuration, LEO messages to be visible to consumer like followers. It is the risk of consumer to lose messages during fail over of leader for which we are OK.