[FLINK-23429] State Processor API failed with FileNotFoundException when working with state files on Cloud Storage

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.14.0, 1.13.1, 1.12.4
• Fix Version/s: 1.14.0, 1.12.5, 1.13.2
• Component/s: API / State Processor
• Labels: pull-request-available
• Assignee: Jun Qin
• Reporter: Jun Qin
• Created: 19/Jul/21 15:04
• Updated: 23/Sep/21 18:08
• Resolved: 21/Jul/21 14:11

Description

For example,

Caused by: java.io.FileNotFoundException: /savepoints/savepoint-18cf55-d90c1b6b1d12/c965e4fd-9647-4f25-b4cd-5ce0485759fd (No such file or directory)
	at java.io.FileInputStream.open0(Native Method) ~[?:?]
	at java.io.FileInputStream.open(FileInputStream.java:219) ~[?:?]
	at java.io.FileInputStream.<init>(FileInputStream.java:157) ~[?:?]
	at org.apache.flink.core.fs.local.LocalDataInputStream.<init>(LocalDataInputStream.java:50) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
	at org.apache.flink.core.fs.local.LocalFileSystem.open(LocalFileSystem.java:134) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
	at org.apache.flink.core.fs.SafetyNetWrapperFileSystem.open(SafetyNetWrapperFileSystem.java:87) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
	at org.apache.flink.state.api.output.FileCopyFunction.writeRecord(FileCopyFunction.java:61) ~[?:?]
	at org.apache.flink.state.api.output.FileCopyFunction.writeRecord(FileCopyFunction.java:34) ~[?:?]
	at org.apache.flink.runtime.operators.DataSinkTask.invoke(DataSinkTask.java:235) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:755) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:570) ~[flink-dist_2.12-1.12.2.jar:1.12.2]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]

However, the actual files to be copied do exist in the source savepoint.

Issue Links

• links to: GitHub Pull Request #16542
• links to: GitHub Pull Request #16550