[SPARK-1022] Add unit tests for kafka streaming

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Saisai Shao
• Reporter: Patrick Wendell
• Created: 11/Jan/14 09:43
• Updated: 06/Aug/15 00:21
• Resolved: 06/Aug/14 06:43

Description

It would be nice if we could add unit tests to verify elements of kafka's stream. Right now we do integration tests only which makes it hard to upgrade versions of kafka. The place to start here would be to look at how kafka tests itself and see if the functionality can be exposed to third party users.

Issue Links

• relates to: SPARK-3615 Kafka test should not hard code Zookeeper port
• links to: [Github] Pull Request #557 (tdas)
• links to: [Github] Pull Request #1751 (jerryshao)
• links to: [Github] Pull Request #1797 (tdas)
• links to: [Github] Pull Request #1804 (srowen)