Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1919

Metadata request issued with no backoff in new producer if there are no topics

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 0.8.2.0
    • 0.8.2.1
    • None
    • None

    Description

      Original report:
      We have observed high cpu and high network traffic problem when
      1) cluster (0.8.1.1) has no topic
      2) KafkaProducer (0.8.2-beta) object is created without sending any traffic

      We have observed such problem twice. In both cases, problem went away
      immediately after one/any topic is created.

      Is this a known issue? Just want to check with the community first before I
      spend much time to reproduce it.

      I couldn't reproduce the issue with similar setup with unit test code in
      IDE. start two brokers with no topic locally on my laptop. create a
      KafkaProducer object without sending any msgs. but I only tested with
      0.8.2-beta for both broker and producer.

      Issue exists in 0.8.2 as well:
      I have re-run my unit test with 0.8.2.0. same tight-loop problem happened
      after a few mins.

      Attachments

        1. KAFKA-1919-v1.patch
          1.0 kB
          Jay Kreps

        Activity

          People

            jkreps Jay Kreps
            jkreps Jay Kreps
            Jay Kreps Jay Kreps
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: