[FLINK-18110] Bucket Listener in StreamingFileSink should notify for buckets detected to be inactive at recovery

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.11.0
• Fix Version/s: 1.11.0
• Component/s: Connectors / FileSystem, Connectors / Hive
• Labels: pull-request-available
• Assignee: Yun Gao
• Reporter: Yun Gao
• Created: 04/Jun/20 03:01
• Updated: 08/Jun/20 11:01
• Resolved: 08/Jun/20 02:21

Description

Current streaming file sink using bucket lifecycle listener to support the global commit of Hive sink, and the listener sends notification when buckets are created and get inactive. However, after failover, a bucket may be directly detected to be inactive and deserted directly, in this case the listener should also send the inactive notification.

Issue Links

• links to: GitHub Pull Request #12496