[FLINK-20108] SingleThreadFetcherManager may add splits to a shutting down SplitFetcher

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.11.2
• Fix Version/s: 1.11.3
• Component/s: Connectors / Common
• Labels: auto-unassigned
• Assignee: Unassigned
• Reporter: Jiangjie Qin
• Created: 12/Nov/20 12:10
• Updated: 29/Apr/21 00:44
• Resolved: 29/Apr/21 00:44

Description

Currently the split fetchers are only removed from the SplitFetcherManager.fetchers when the thread exit. The may cause problem because when SplitFetcherManager.addSplits() is called, it may see a shutting down split fetcher and adds splits to it. These splits will then just be lost.

This issue is actually already fixed in FLINK-18128. The fix needs to cherry-picked to 1.11.3