Kafka
  1. Kafka
  2. KAFKA-1239 New producer checklist
  3. KAFKA-1236

Change producer performance tool to optionally use the new producer

    Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.10.0.0
    • Fix Version/s: 0.10.0.0
    • Component/s: producer
    • Labels:
      None

      Description

      The producer performance tool needs the ability to optionally use the new producer.

      1. KAFKA-1236.patch
        35 kB
        Jay Kreps
      2. KAFKA-1236-v1.patch
        35 kB
        Jay Kreps

        Activity

        Neha Narkhede created issue -
        Neha Narkhede made changes -
        Field Original Value New Value
        Assignee Jun Rao [ junrao ]
        Neha Narkhede made changes -
        Parent KAFKA-1239 [ 12693154 ]
        Issue Type Improvement [ 4 ] Sub-task [ 7 ]
        Neha Narkhede made changes -
        Summary Add ability to existing system tests to use the new producer client Change producer performance tool to optionally use the new producer
        Neha Narkhede made changes -
        Description We need to add the new producer to existing system tests. Until we release the new producer (0.9), the system tests will run the same tests twice - once on the 0.8.x producer and once on the 0.9 producer. The producer performance tool needs the ability to optionally use the new producer.
        Jay Kreps made changes -
        Assignee Jay Kreps [ jkreps ]
        Hide
        Jay Kreps added a comment -

        Attached is a patch that makes the performance test use either the old or new producer.

        This patch includes a few other things:
        1. Fix a bug in TestEndToEndLatency that lead to always giving an error about the wrong partitioner being used.
        2. Fix a bug in ConsumerPerformance.scala that lead to consuming the full topic. Plus some additional cleanup in ConsumerPerformance.
        3. Expose a few more options in the new ProducerPerformance.java

        Show
        Jay Kreps added a comment - Attached is a patch that makes the performance test use either the old or new producer. This patch includes a few other things: 1. Fix a bug in TestEndToEndLatency that lead to always giving an error about the wrong partitioner being used. 2. Fix a bug in ConsumerPerformance.scala that lead to consuming the full topic. Plus some additional cleanup in ConsumerPerformance. 3. Expose a few more options in the new ProducerPerformance.java
        Jay Kreps made changes -
        Attachment KAFKA-1236-v1.patch [ 12628065 ]
        Jay Kreps made changes -
        Attachment KAFKA-1236.patch [ 12628069 ]
        Hide
        Jay Kreps added a comment -

        Created reviewboard https://reviews.apache.org/r/17922/
        against branch trunk

        Show
        Jay Kreps added a comment - Created reviewboard https://reviews.apache.org/r/17922/ against branch trunk
        Jay Kreps made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s 0.9.0 [ 12323928 ]
        Resolution Fixed [ 1 ]
        Tony Stevenson made changes -
        Workflow no-reopen-closed, patch-avail [ 12839802 ] Apache Kafka Workflow [ 13052458 ]
        Tony Stevenson made changes -
        Workflow Apache Kafka Workflow [ 13052458 ] no-reopen-closed, patch-avail [ 13055186 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        9d 4h 38m 1 Jay Kreps 11/Feb/14 05:02

          People

          • Assignee:
            Jay Kreps
            Reporter:
            Neha Narkhede
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development