Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2590 KIP-28: Kafka Streams Checklist
  3. KAFKA-4114

Allow for different "auto.offset.reset" strategies for different input streams

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.10.2.0
    • streams
    • None

    Description

      Today we only have one consumer config "offset.auto.reset" to control that behavior, which means all streams are read either from "earliest" or "latest".

      However, it would be useful to improve this settings to allow users have finer control over different input stream. For example, with two input streams, one of them always reading from offset 0 upon (re)-starting, and the other reading for log end offset.

      This JIRA requires to extend KStreamBuilder API for methods .stream(...) and .table(...) to add a new parameter that indicate the initial offset to be used.

      Attachments

        Issue Links

          Activity

            People

              bbejeck Bill Bejeck
              mjsax Matthias J. Sax
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: