[FLUME-2936] KafkaSource tests arbitrarily fail

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.7.0
• Fix Version/s: 1.7.0
• Component/s: Test
• Assignee: Lior Zeno
• Reporter: Lior Zeno
• Created: 24/Jun/16 09:24
• Updated: 13/Aug/17 12:56
• Resolved: 09/Jul/16 22:12

Description

KafkaSource tests are flaky, and tend to fail. I investigated this issue and discovered the following issues:

• KafkaSource hangs in doStart at line 413:
  KafkaSourceEmbeddedKafka.java

   it = consumer.poll(1000).iterator();
  

I fixed that by simply changing HOST in KafkaSourceEmbeddedKafka to localhost.

• Out of memory exception. I fixed that by properly configuring MAVEN_OPTS, as stated in the documentation.

Issue Links

• duplicates: FLUME-2898 Kafka source test will freeze on JDK8
• is broken by: FLUME-2821 Flume-Kafka Source with new Consumer