Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7499

Extend ProductionExceptionHandler to cover serialization exceptions

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • streams

    Description

      In KIP-210, an exception handler for the write path was introduced. This exception handler covers exception that are raised in the producer callback.

      However, serialization happens before the data is handed to the producer with Kafka Streams itself and the producer uses `byte[]/byte[]` key-value-pair types.

      Thus, we might want to extend the ProductionExceptionHandler to cover serialization exception, too, to skip over corrupted output messages. An example could be a "String" message that contains invalid JSON and should be serialized as JSON.

      KIP-399 (not voted yet; feel free to pick it up): https://cwiki.apache.org/confluence/display/KAFKA/KIP-399%3A+Extend+ProductionExceptionHandler+to+cover+serialization+exceptions

      Attachments

        Issue Links

          Activity

            People

              raju1712 Bangarraju Vadapalli
              mjsax Matthias J. Sax
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated: