Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6179

RecordQueue.clear() does not clear MinTimestampTracker's maintained list

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.2.1, 0.11.0.1, 1.0.0
    • Fix Version/s: 0.11.0.2, 1.0.1, 1.1.0
    • Component/s: streams
    • Labels:
      None

      Description

      When a stream task is being suspended, in RecordQueue.clear() we will clear the ArrayDeque fifoQueue, but we do not clear the MinTimestampTracker's maintained list. As a result if the task gets resumed we will live with an empty fifoQueue while a populated tracker. And hence we use reference equality to check if the smallest timestamp record can be popped, we would never be able to pop any more records and hence effectively leading to memory leak.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                guozhang Guozhang Wang
                Reporter:
                guozhang Guozhang Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: