[FLINK-30792] clean up not uploaded state changes after materialization complete

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.16.0
• Fix Version/s: 1.17.0, 1.16.2
• Component/s: Runtime / State Backends
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Feifan Wang
• Created: 26/Jan/23 02:07
• Updated: 17/Feb/23 02:23
• Resolved: 17/Feb/23 02:23

Description

We should clean up not uploaded state changes after materialization completed, otherwise it may cause FileNotFoundException.

Since state changes before completed materialization in FsStateChangelogWriter#notUploaded will not be used in any subsequent checkpoint, I suggest clean up it while handle materialization result. 

How do you think about this ? ym , roman 

Issue Links

• links to: GitHub Pull Request #21895