[KAFKA-440] Create a regression test framework for distributed environment testing

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Labels: replication-testing
• Assignee: John Fung
• Reporter: John Fung
• Created: 06/Aug/12 17:43
• Updated: 25/Aug/12 14:53
• Resolved: 22/Aug/12 17:17

Description

Initial requirements:

1. The whole test framework is preferably coded in Python (a common scripting language which has well supported features)

2. Test framework driver should be generic (distributed environment can be local host)

3. Test framework related configurations are defined in JSON format

4. Test environment, suite, case definitions may be defined in the following levels:
4-a entity_id is used as a key for looking up related config from different levels

4-b Cluster level defines: entity_id, hostname, kafka_home, java_home, ...

4-c Test suite / case level defines:
4-c-1 zookeeper: entity_id, clientPort, dataDir, log_filename, config_filename
4-c-2 broker: entity_id, port, log.file.size, log.dir, log_filename, config_filename
4-c-3 producer: entity_id, topic, threads, compression-codec, message-size, log_filename, config_filename

Issue Links

• is blocked by: KAFKA-203 Improve Kafka internal metrics