[CRUNCH-621] Kafka no data to consume could get stuck

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.15.0
• Component/s: IO
• Assignee: Micah Whitacre
• Reporter: Micah Whitacre
• Created: 12/Sep/16 19:19
• Updated: 26/Feb/17 18:33
• Resolved: 20/Oct/16 02:35

Description

With the KafkaSource and specifically the KafkaRecordReader, if there is no data to consume from a partition because all data fell off Kafka then we can end up in a situation where the KafkaRecordReader will poll forever as it never gets data to reach its ending offset.