[FLINK-12736] ResourceManager may release TM with allocated slots

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.7.2, 1.8.1, 1.9.0
• Fix Version/s: 1.7.3, 1.8.2, 1.9.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Andrey Zagrebin
• Reporter: Chesnay Schepler
• Created: 05/Jun/19 08:33
• Updated: 10/Jul/19 20:54
• Resolved: 10/Jul/19 20:53

Description

The ResourceManager looks out for TaskManagers that have not had any slots allocated on them for a while, as these could be released to safe resources. If such a TM is found the RM checks via an RPC call whether the TM still holds any partitions. If no partition is held then the TM is released.

However, in the RPC callback no check is made whether the TM is actually still idle. In the meantime a slot could've been allocated on the TM.

Issue Links

• is related to: FLINK-10941 Slots prematurely released which still contain unconsumed data
• links to: GitHub Pull Request #8988
• links to: GitHub Pull Request #9041
• links to: GitHub Pull Request #9042