[FLINK-20492] The SourceOperatorStreamTask should implement cancelTask() and finishTask()

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.12.0, 1.11.3
• Fix Version/s: 1.11.3, 1.13.0, 1.12.1
• Component/s: Connectors / Common
• Labels: pull-request-available
• Assignee: Jiangjie Qin
• Reporter: Jiangjie Qin
• Created: 05/Dec/20 01:19
• Updated: 28/Dec/20 07:05
• Resolved: 10/Dec/20 00:49

Description

The SourceOperatorStreamTask does not implement cancelTask and finishTask at this point. This causes resource leak on job cancellation of finish.

Currently there are three cases that a Job may exit.

1. Canceled - cancelTask() method will be called to close the SourceOperator.
2. Stopped with a savepoint - finishTask() method will be called to close the SourceOperator.
3. Runs to the EndOfInput -  the SourceOperator is closed in StreamTask.afterInvoke().

 

Issue Links

• causes: FLINK-20781 UnalignedCheckpointITCase failure caused by NullPointerException
• links to: GitHub Pull Request #14314