Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-13017

Excessive logging on sink task deserialization errors

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.0, 2.8.0, 3.0.0
    • Fix Version/s: 3.1.0
    • Component/s: KafkaConnect
    • Labels:
      None

      Description

      Even with errors.log.enable set to false, deserialization failures are still logged at ERROR level by the org.apache.kafka.connect.runtime.WorkerSinkTask namespace. This becomes problematic in pipelines with errors.tolerance set to all, and can generate excessive logging of stack traces when deserialization errors are encountered for most if not all of the records being consumed by a sink task.

      The logging added to the WorkerSinkTask class in KAFKA-9018 should be removed and, if necessary, any valuable information from it not already present in the log messages generated by Connect with errors.log.enable and errors.log.include.messages set to true should be added in that place instead.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ChrisEgerton Chris Egerton
                Reporter:
                ChrisEgerton Chris Egerton
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: