Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4619

Dissallow to output records with unknown keys in TransformValues

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.10.0.0, 0.10.0.1, 0.10.1.0, 0.10.1.1
    • 0.10.2.0
    • streams
    • None

    Description

      KStream#transformValues allows the user to return a new value in punctuate and it also allows the user to return any new key value pair using ProcesserContext#forward. For punctuate the key gets set to null under the hood and for forward the user can put any new key they want. However, Kafka Streams assumes that using transformValue does not change the key – thus, this assumption might not hold right now resulting potentially incorrectly partitioned data.

      Thus, it should not be possible to return any data in punctuate and forward and we should raise an exception.

      Attachments

        Issue Links

          Activity

            People

              mjsax Matthias J. Sax
              mjsax Matthias J. Sax
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: