Uploaded image for project: 'Apache Hop'
  1. Apache Hop
  2. HOP-3687

Allow reading of non-string messages with a Kafka Consumer

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • API, Beam, Transforms
    • None

    Description

      For both the regular Kafka Consumer and the Beam Kafka Consumer transforms it would be great to be able to read non-String messages, for example in Avro format.

      For the Beam Kafka Consumer I think it would be cool if you could specify the output format as "Avro Record" (in our example) or Serializable, Binary, with String as a default. 

      This would allow us to set Kafka consumer option value.deserializer to KafkaAvroDeserializer and get an actual Avro Record as a message.

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            mcasters Matt Casters
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: