Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-10683

Consumer.position() Ignores Transaction Marker with read_uncommitted

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.6.0
    • Fix Version/s: None
    • Component/s: clients, core
    • Labels:
      None

      Description

      The workaround for https://issues.apache.org/jira/browse/KAFKA-6607# Says:

      or use `consumer.position()` that takes the commit marker into account and would "step over it")

      Note that this problem occurs with all consumers, not just Streams. We have implemented this solution in our project (as an option for those users concerned about the pseudo lag).

      We have discovered that this technique will only work with 

      isolation.level=read_committed

      Otherwise, the 

      position()

      call does not include the marker "record".

      https://github.com/spring-projects/spring-kafka/issues/1587#issuecomment-721899560

        Attachments

          Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-6607 Kafka Streams lag not zero when input topic transactional

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                grussell Gary Russell
              • Votes:
                3 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: