Kafka
  1. Kafka
  2. KAFKA-868

System Test - add test case for rolling controlled shutdown

    Details

    1. kafka-868-v3.patch
      52 kB
      John Fung
    2. kafka-868-v2.patch
      52 kB
      John Fung
    3. kafka-868-v1.patch
      52 kB
      John Fung

      Issue Links

        Activity

        Hide
        John Fung added a comment -

        Adding a case (testcase_9061) to test rolling controlled shutdown as follow :
        1. Start Zookeeper
        2. Start Broker cluster (7 machines) with Replication factor 2, 5 topics, 2 partitions
        3. Settings in #2 can be configured at clean_shutdown_testsuite/testcase_9061/testcase_9061_properties.json
        4. For each iteration :
        5. Start ConsoleConsumer in the background
        6. Start ProducerPerformance in the background to keep sending messages to all topics
        7. For each broker :
        8. Call kafka.admin.ShutdownBroker
        9. Bounce the broker
        10. Call kafka-preferred-replica-election.sh
        11. Call kafka-list-topic.sh to find the number of under replicated partitions
        12. Validate data matched for this iteration
        13. Validate for "Failed to send" messages in producer
        14. Clean up producer & consumer logs

        Show
        John Fung added a comment - Adding a case (testcase_9061) to test rolling controlled shutdown as follow : 1. Start Zookeeper 2. Start Broker cluster (7 machines) with Replication factor 2, 5 topics, 2 partitions 3. Settings in #2 can be configured at clean_shutdown_testsuite/testcase_9061/testcase_9061_properties.json 4. For each iteration : 5. Start ConsoleConsumer in the background 6. Start ProducerPerformance in the background to keep sending messages to all topics 7. For each broker : 8. Call kafka.admin.ShutdownBroker 9. Bounce the broker 10. Call kafka-preferred-replica-election.sh 11. Call kafka-list-topic.sh to find the number of under replicated partitions 12. Validate data matched for this iteration 13. Validate for "Failed to send" messages in producer 14. Clean up producer & consumer logs
        Hide
        John Fung added a comment -

        Uploaded kafka-868-v1.patch

        Show
        John Fung added a comment - Uploaded kafka-868-v1.patch
        Hide
        John Fung added a comment -

        Uploaded kafka-868-v2.patch with the following change :

        At the end of each iteration, rename producer & consumer logs instead of deleting the files for future troubleshooting.

        Show
        John Fung added a comment - Uploaded kafka-868-v2.patch with the following change : At the end of each iteration, rename producer & consumer logs instead of deleting the files for future troubleshooting.
        Hide
        John Fung added a comment -

        Uploaded kafka-868-v3.patch after latest 0.8 branch rebase

        Show
        John Fung added a comment - Uploaded kafka-868-v3.patch after latest 0.8 branch rebase
        Hide
        Ewen Cheslack-Postava added a comment -

        This was for the old system tests and with the new system tests and KAFKA-2276/the initial patch for KIP-25 added replication tests that cover clean and hard bouncing brokers and therefore covers this scenario.

        Show
        Ewen Cheslack-Postava added a comment - This was for the old system tests and with the new system tests and KAFKA-2276 /the initial patch for KIP-25 added replication tests that cover clean and hard bouncing brokers and therefore covers this scenario.

          People

          • Assignee:
            Unassigned
            Reporter:
            John Fung
            Reviewer:
            Ewen Cheslack-Postava
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development