[KAFKA-5313] Improve exception handling on coordinator interactions

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.11.0.0
• Component/s: streams
• Assignee: Matthias J. Sax
• Reporter: Eno Thereska
• Created: 23/May/17 11:43
• Updated: 19/Feb/18 11:38
• Resolved: 25/Oct/17 23:13

Description

Exceptions during assignment of tasks are caught in ConsumerCoordinator.java and streams becomes aware of them during the StreamThread.onPartitionsAssigned() and StreamThread.onPartitionsRevoked() methods. Eventually these exceptions go through StreamThread.pollRequests() all the way up to StreamThread.runLoop() and will halt the stream thread that is processing these exceptions. Other stream threads may continue processing, however it is likely they will experience problems too soon after.

Exceptions here include LockExceptions that are thrown if tasks cannot use a particular directory due to previous tasks not releasing locks on them during reassignment.