Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6453

Document timestamp propagation semantics

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.6.0
    • streams

    Description

      Atm, Kafka Streams only has a defined "contract" about timestamp propagation at the Processor API level: all processor within a sub-topology, see the timestamp from the input topic record and this timestamp will be used for all result record when writing them to an topic, too.

      The DSL, inherits this "contract" atm.

      From a DSL point of view, it would be desirable to provide a different contract to the user. To allow this, we need to do the following:

       - extend Processor API to allow manipulation timestamps (ie, a Processor can set a new timestamp for downstream records)
       - define a DSL "contract" for timestamp propagation for each DSL operator
       - document the DSL "contract"
       - implement the DSL "contract" using the new/extended Processor API

      Changing the DSL contract etc was done via KIP-258. This ticket is about documenting the contract.

      Attachments

        Issue Links

          Activity

            People

              JimGalasyn James Galasyn
              mjsax Matthias J. Sax
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: