[KAFKA-3062] Read from kafka replication to get data likely Version based

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: replication
• Assignee: Unassigned
• Reporter: xingang
• Created: 04/Jan/16 23:18
• Updated: 19/Jul/18 20:03

Description

Since Kafka require all the reading happen in the leader for the consistency.

in case, for large volume data of a Topic have a number of consumers, among them, some consumers are Not latency-sensitive But Data-Loss sensitive have a consuming lag, then, it will pollute the Page cache as they are reading from the disk, hence, for other consumers which are latency-sensitive will be sad due to the pagecache miss

If there could be possible for the reading can happen in replicas for a eventually consistent (likely version based), thus, consumers marked as "read from replica" can be separated from others