[GEARPUMP-122] KafkaSource Stuck

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.8.1
• Component/s: kafka
• Assignee: Manu Zhang
• Reporter: Qi Shu
• Created: 11/May/16 10:03
• Updated: 02/Jun/16 01:47
• Resolved: 02/Jun/16 01:47

Description

Kafka's version is 2.10-0.8.2.0 and deployed on a cluster of 3 machines. Gearpump's version is 2.11-0.8.0 and deployed on local mode.
The app running on gearpump is a java example Kafka2Kafka.
The topic has millions of messages in It。
After app started for a while, there were no messages received from kafka, but kafka console can recevie messages from that topic.
And if I use the kafka source without offset checkpoint, then messages begin to flow.
"screenshot-1.png" means app started for 7 minutes and no messages received from kafka source.
"2.png" was a screen shot of JProfiler, I use JProfiler to watch the thread of Gearpump, and it seems the kafka source stucked when doing offset checkpoint.

Issue Links

• links to: GitHub Pull Request #25