Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4213

Add system tests for replication throttling (KIP-73)

    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.10.1.0
    • None
    • None

    Description

      Add system tests for replication throttling. The two main things to test are:

      1. kafka-reassign-partitions: in this use case, a new broker is added to a cluster, and we are testing throttling of the partitions being replicated to this cluster. The '--throttle' option of the reassign partitions tool is what we want to test. we will invoke the tool with this option, and assert that the replication takes a minimum amount of time, based on the throttle and the amount of data being replicated.

      2. kafka-configs: in this use case, we lost a broker of an existing cluster for whatever reason, and want to re-replicate data to it from some point in time. We want this re-replicated data to be throttled. Again, we will check that the re-replication took at least a certain amount of time based on the value of the throttle and the amount of data being replicated.

      Attachments

        Activity

          People

            apurva Apurva Mehta
            apurva Apurva Mehta
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: