[FLINK-14107] Kinesis consumer record emitter deadlock under event time alignment

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.8.2, 1.9.0
• Fix Version/s: 1.8.3, 1.9.1, 1.10.0
• Component/s: Connectors / Kinesis
• Labels: pull-request-available
• Assignee: Thomas Weise
• Reporter: Thomas Weise
• Created: 17/Sep/19 16:59
• Updated: 19/Sep/19 17:36
• Resolved: 18/Sep/19 22:17

Description

When the emitter reaches the max timestamp for the current queue, it stops emitting and waits for the max timestamp to advance. Since it simultaneously selects the next queue as the new "minimum" queue, it may deadlock if the previous min queue represents the new global lower bound after the max timestamp advanced. This occurs very infrequently and we were finally able to reproduce.

Issue Links

• links to: GitHub Pull Request #9702
• links to: GitHub Pull Request #9708
• links to: GitHub Pull Request #9709