Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7499

Extend ProductionExceptionHandler to cover serialization exceptions

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: streams
    • Labels:

      Description

      In KIP-210, an exception handler for the write path was introduced. This exception handler covers exception that are raised in the producer callback.

      However, serialization happens before the data is handed to the producer with Kafka Streams itself and the producer uses `byte[]/byte[]` key-value-pair types.

      Thus, we might want to extend the ProductionExceptionHandler to cover serialization exception, too, to skip over corrupted output messages. An example could be a "String" message that contains invalid JSON and should be serialized as JSON.

      KIP-399 (not voted yet; feel free to pick it up): https://cwiki.apache.org/confluence/display/KAFKA/KIP-399%3A+Extend+ProductionExceptionHandler+to+cover+serialization+exceptions

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Chilio Alaa Zbair
                Reporter:
                mjsax Matthias J. Sax
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: