Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4619

Dissallow to output records with unknown keys in TransformValues

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0.0, 0.10.0.1, 0.10.1.0, 0.10.1.1
    • Fix Version/s: 0.10.2.0
    • Component/s: streams
    • Labels:
      None

      Description

      KStream#transformValues allows the user to return a new value in punctuate and it also allows the user to return any new key value pair using ProcesserContext#forward. For punctuate the key gets set to null under the hood and for forward the user can put any new key they want. However, Kafka Streams assumes that using transformValue does not change the key – thus, this assumption might not hold right now resulting potentially incorrectly partitioned data.

      Thus, it should not be possible to return any data in punctuate and forward and we should raise an exception.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                mjsax Matthias J. Sax
                Reporter:
                mjsax Matthias J. Sax
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: