Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1919

Metadata request issued with no backoff in new producer if there are no topics

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.8.2.0
    • Fix Version/s: 0.8.2.1
    • Component/s: None
    • Labels:
      None

      Description

      Original report:
      We have observed high cpu and high network traffic problem when
      1) cluster (0.8.1.1) has no topic
      2) KafkaProducer (0.8.2-beta) object is created without sending any traffic

      We have observed such problem twice. In both cases, problem went away
      immediately after one/any topic is created.

      Is this a known issue? Just want to check with the community first before I
      spend much time to reproduce it.

      I couldn't reproduce the issue with similar setup with unit test code in
      IDE. start two brokers with no topic locally on my laptop. create a
      KafkaProducer object without sending any msgs. but I only tested with
      0.8.2-beta for both broker and producer.

      Issue exists in 0.8.2 as well:
      I have re-run my unit test with 0.8.2.0. same tight-loop problem happened
      after a few mins.

        Attachments

        1. KAFKA-1919-v1.patch
          1.0 kB
          Jay Kreps

          Activity

            People

            • Assignee:
              jkreps Jay Kreps
              Reporter:
              jkreps Jay Kreps
              Reviewer:
              Jay Kreps
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: