Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-3346

kafka channel tries to spin producer even when configured without any source

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Kafka Channel
    • Labels:
      None

      Description

      When we configure kafka channel without any source we expect that the channel will only start consumer and not the producer as there is no source and messages are not supposed to be produced to the topic. But kafka channel still spins the producer and tries to connect to kafka broker. If the producer configurations are not specified ( as it is not required) it fills the log with Warning messages about issue in producer connection depending upon what missing configuration is causing the connection failure.

      For ex:-
      16 Oct 2019 13:28:39,996 WARN [kafka-producer-network-thread | producer-6] (org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleDisconnection:725) - Bootstrap broker <broker>:9094 disconnected
      ..

      This causes performance issue.

      After providing the missing producer configuration, the warning goes away and everything works fine.

      It would be good, if producer is snot started if the kafka channel is configured without any source.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              bimalenduc Bimalendu Choudhary
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: