Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6190

GlobalKTable never finishes restoring when consuming transactional messages

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.11.0.1, 1.0.0
    • Fix Version/s: 0.11.0.2, 1.0.1, 1.1.0
    • Component/s: streams
    • Labels:
      None
    • Environment:
      Linux

      Description

      When creating a GlobalKTable from a topic that contains messages that were produced in a transaction the GlobalStreamThread never finishes restoring the table. This appears to be because the `GlobalStateManagerImpl#restoreState` method fails to take into account the transaction markers in it's calculation of it's offset when reading messages and so never reaches the high watermark for the topic it is restoring.

      To demonstrate the issue produce a few messages in a transaction to a topic, then attempt to restore a GlobalKTable from that topic, the store will never complete restoring.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                alexgood Alex Good
                Reporter:
                alexgood Alex Good
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: