Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7753

ValueTransformerWithKey should not require producing one value every message

    XMLWordPrintableJSON

Details

    • Wish
    • Status: Resolved
    • Minor
    • Resolution: Feedback Received
    • None
    • None
    • streams
    • None

    Description

      Hi, speaking about: https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/kstream/ValueTransformerWithKey.java
      I have a quite simple case - I want to implement a Transformer which I will use later in my DSL-api-defined topology. Those are my requirements:

      • no repartition topic should be created since I do not change the keys
      • I can't forward messages on every message transformed. I have my internal state store which I'm using to ensure max. 1 message per window is sent.

      Basic transformer gives me possibility to not send messages down the stream (null internal handler), but it forces repartitioning which I think is unnecessary in my case. WDYT?

      Attachments

        Activity

          People

            Unassigned Unassigned
            nijo Mateusz Owczarek
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: