Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-8347

Choose next record to process by timestamp

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.1.0
    • Fix Version/s: 2.3.0, 2.1.2, 2.2.2
    • Component/s: streams
    • Labels:
      None

      Description

      Currently PartitionGroup will determine the next record to process by choosing the partition with the lowest stream time. However if a partition contains out of order data its stream time may be significantly larger than the timestamp of the next record. The next record should instead be chosen as the record with the lowest timestamp across all partitions, regardless of which partition it comes from or what its partition time is.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ableegoldman Sophie Blee-Goldman
                Reporter:
                ableegoldman Sophie Blee-Goldman
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: