Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2590 KIP-28: Kafka Streams Checklist
  3. KAFKA-4114

Allow for different "auto.offset.reset" strategies for different input streams

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.10.2.0
    • Component/s: streams
    • Labels:
      None

      Description

      Today we only have one consumer config "offset.auto.reset" to control that behavior, which means all streams are read either from "earliest" or "latest".

      However, it would be useful to improve this settings to allow users have finer control over different input stream. For example, with two input streams, one of them always reading from offset 0 upon (re)-starting, and the other reading for log end offset.

      This JIRA requires to extend KStreamBuilder API for methods .stream(...) and .table(...) to add a new parameter that indicate the initial offset to be used.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                bbejeck Bill Bejeck
                Reporter:
                mjsax Matthias J. Sax
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: