[KAFKA-10683] Consumer.position() Ignores Transaction Marker with read_uncommitted

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.6.0
• Component/s: clients, core
• Assignee: Unassigned
• Reporter: Gary Russell
• Created: 04/Nov/20 19:59
• Updated: 13/Apr/21 08:54

Description

The workaround for https://issues.apache.org/jira/browse/KAFKA-6607# Says:

or use `consumer.position()` that takes the commit marker into account and would "step over it")

Note that this problem occurs with all consumers, not just Streams. We have implemented this solution in our project (as an option for those users concerned about the pseudo lag).

We have discovered that this technique will only work with

isolation.level=read_committed

Otherwise, the

position()

call does not include the marker "record".

https://github.com/spring-projects/spring-kafka/issues/1587#issuecomment-721899560

Issue Links

• is related to: KAFKA-6607 Kafka Streams lag not zero when input topic transactional