Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4213

Add system tests for replication throttling (KIP-73)

    Details

    • Type: Test
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.10.1.0
    • Component/s: None
    • Labels:
      None

      Description

      Add system tests for replication throttling. The two main things to test are:

      1. kafka-reassign-partitions: in this use case, a new broker is added to a cluster, and we are testing throttling of the partitions being replicated to this cluster. The '--throttle' option of the reassign partitions tool is what we want to test. we will invoke the tool with this option, and assert that the replication takes a minimum amount of time, based on the throttle and the amount of data being replicated.

      2. kafka-configs: in this use case, we lost a broker of an existing cluster for whatever reason, and want to re-replicate data to it from some point in time. We want this re-replicated data to be throttled. Again, we will check that the re-replication took at least a certain amount of time based on the value of the throttle and the amount of data being replicated.

        Attachments

          Activity

            People

            • Assignee:
              apurva Apurva Mehta
              Reporter:
              apurva Apurva Mehta
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: