Kafka
  1. Kafka
  2. KAFKA-684

ConsoleProducer does not have the queue-size option

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.8.0
    • Component/s: core
    • Labels:
      None

      Description

      When using the kafka ConsoleProducer (from script kafka-console-producer.sh), you cannot set the queue.size, which gets very annoying when you want to produce quickly a lot of messages. You definitely need to increase the queue.size (or decrease the send timeout).

      Here is a simple patch to add the option.

      1. KAFKA-684.patch
        2 kB
        Maxime Brugidou
      2. KAFKA-684-2.patch
        3 kB
        Maxime Brugidou
      3. KAFKA-684-3.patch
        5 kB
        Maxime Brugidou

        Activity

        Hide
        Jun Rao added a comment -

        Thanks for patch v3. +1. Committed to 0.8.

        Show
        Jun Rao added a comment - Thanks for patch v3. +1. Committed to 0.8.
        Hide
        Maxime Brugidou added a comment -

        While I'm at it, I added this small feature:

        Exit at end of input stream (so you can do echo "test" | ./kafka-console-producer.sh or ./kafka-console-producer.sh < test without stopping the producer manually

        Show
        Maxime Brugidou added a comment - While I'm at it, I added this small feature: Exit at end of input stream (so you can do echo "test" | ./kafka-console-producer.sh or ./kafka-console-producer.sh < test without stopping the producer manually
        Hide
        Maxime Brugidou added a comment -

        I added:

        queue.enqueueTimeout.ms
        producer.request.required.acks
        producer.request.timeout.ms

        Show
        Maxime Brugidou added a comment - I added: queue.enqueueTimeout.ms producer.request.required.acks producer.request.timeout.ms
        Hide
        Jun Rao added a comment -

        Thanks for the patch. It looks good. While you are here, could you also expose the following properties (from SyncProducerConfig) in ConsoleProducer?
        producer.request.timeout.ms
        producer.request.required.acks

        Show
        Jun Rao added a comment - Thanks for the patch. It looks good. While you are here, could you also expose the following properties (from SyncProducerConfig) in ConsoleProducer? producer.request.timeout.ms producer.request.required.acks

          People

          • Assignee:
            Maxime Brugidou
            Reporter:
            Maxime Brugidou
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development