Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6812

Async ConsoleProducer exits with 0 status even after data loss

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 1.1.0
    • None
    • tools
    • None

    Description

      When ConsoleProducer is run without --sync flag and one of the batches times out, ErrorLoggingCallback logs the error:

       18/04/21 04:23:01 WARN clients.NetworkClient: [Producer clientId=console-producer] Connection to node 10 could not be established. Broker may not be available.
       18/04/21 04:23:02 ERROR internals.ErrorLoggingCallback: Error when sending message to topic my-topic with key: null, value: 8 bytes with error:
       org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for my-topic-0: 1530 ms has passed since batch creation plus linger time

      However, the tool exits with status code 0. 
      In my opinion the tool should indicate in the exit status that there was data lost. Maybe it's reasonable to exit after the first error.
       

      Attachments

        Activity

          People

            kamalkang Kamal Kang
            andrasbeni Andras Beni
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: