[KAFKA-1347] Create a system test for network partitions

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Assignee: Unassigned
• Reporter: Jay Kreps
• Created: 28/Mar/14 15:57
• Updated: 31/Aug/17 06:50
• Resolved: 31/Aug/17 06:50

Description

We got some free and rather public QA here:
http://aphyr.com/posts/293-call-me-maybe-kafka

We have since added a configuration to disable unclean leader election which allows you to prefer consistency over availability when all brokers fail.

This has some unit tests, but ultimately there is no reason to believe this works unless we have a fairly aggressive system test case for it.
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+System+Tests

It would be good to add support for network partitions. I don't think we actually need to try to use the jepsen stuff directly, we can just us the underlying tools it uses--iptables and tc. These are linux specific, but that is prolly okay. You can see these at work here:
https://github.com/aphyr/jepsen/blob/master/src/jepsen/control/net.clj

Having this would help provide better evidence that this works now, and would keep it working in the future.

Issue Links

• is duplicated by: KAFKA-5476 Implement a system test that creates network partitions