Kafka
  1. Kafka
  2. KAFKA-882

Enhance 0.7 ProducerPerformance to send sequential MessageID as in 0.8

    Details

    • Type: Task Task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.7
    • Component/s: None
    • Labels:

      Description

      Also update related files in the following in Kafka 0.8:
      1. system_test/migration_tool_testsuite/config
      2. system_test/migration_tool_testsuite/0.7/lib/kafka-perf-0.7.0.jar (after this JIRA is completed)
      3. system_test/migration_tool_testsuite/testcase_900x/testcase_900x_properties.json

        Issue Links

          Activity

          John Fung created issue -
          John Fung made changes -
          Field Original Value New Value
          Labels kafka
          John Fung made changes -
          Description Also update related files in the following :
          1. system_test/migration_tool_testsuite/config
          2. system_test/migration_tool_testsuite/0.7/lib/kafka-perf-0.7.0.jar (after this JIRA is completed)
          3. system_test/migration_tool_testsuite/testcase_900x/testcase_900x_properties.json
          Also update related files in the following in Kafka 0.8:
          1. system_test/migration_tool_testsuite/config
          2. system_test/migration_tool_testsuite/0.7/lib/kafka-perf-0.7.0.jar (after this JIRA is completed)
          3. system_test/migration_tool_testsuite/testcase_900x/testcase_900x_properties.json
          John Fung made changes -
          Link This issue blocks KAFKA-883 [ KAFKA-883 ]
          Gavin made changes -
          Link This issue blocks KAFKA-883 [ KAFKA-883 ]
          Gavin made changes -
          Link This issue is depended upon by KAFKA-883 [ KAFKA-883 ]
          John Fung made changes -
          Link This issue is duplicated by KAFKA-752 [ KAFKA-752 ]
          John Fung made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          John Fung made changes -
          Status In Progress [ 3 ] Open [ 1 ]
          Hide
          John Fung added a comment -

          uploaded kafka-882-v1.patch

          Show
          John Fung added a comment - uploaded kafka-882-v1.patch
          John Fung made changes -
          Attachment kafka-882-v1.patch [ 12590486 ]
          Hide
          John Fung added a comment -

          ProducerPerformance in 0.7 has quite a few nested if-else conditional logics in addition to while & for loops. In order to keep it simple, this patch contains the change to send sequential MessageID only when the following arguments are specified:

          --initial-message-id <n>
          --vary-message-size
          --async

          Otherwise, it will preserve the original 0.7 behavior.

          Show
          John Fung added a comment - ProducerPerformance in 0.7 has quite a few nested if-else conditional logics in addition to while & for loops. In order to keep it simple, this patch contains the change to send sequential MessageID only when the following arguments are specified: --initial-message-id <n> --vary-message-size --async Otherwise, it will preserve the original 0.7 behavior.
          John Fung made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Jun Rao added a comment -

          Thanks for the patch. Committed to 0.7 so that we can get the system tests in 0.8 working.

          Show
          Jun Rao added a comment - Thanks for the patch. Committed to 0.7 so that we can get the system tests in 0.8 working.
          Jun Rao made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.7 [ 12317243 ]
          Resolution Fixed [ 1 ]

            People

            • Assignee:
              John Fung
              Reporter:
              John Fung
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development