Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7483

Streams should allow headers to be passed to Serializer

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1.0
    • Component/s: streams
    • Labels:
      None

      Description

      We are storing schema metadata for record key and value in the header. Serializer, includes this metadata in the record header. While doing simple record transformation (x transformed to y) in streams, the same header that was passed from source, pushed to the sink topic. This leads to error while reading the sink topic.

      We should call the overloaded `serialize(topic, headers, object)` method in RecordCollectorImpl which in-turn adds the correct metadata in the record header.

      With this sink topic reader have the option to read all the values for a header key using `Headers#headers`  [or] only the overwritten value using `Headers#lastHeader`

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ckamal Kamal Chandraprakash
                Reporter:
                ckamal Kamal Chandraprakash
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: