[FLINK-21341] Update state reader to return InputFormat

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Won't Do
• Affects Version/s: 1.13.0
• Component/s: API / State Processor
• Labels: auto-deprioritized-major auto-unassigned stale-assigned
• Assignee: Jun Qin
• Reporter: Seth Wiesman
• Created: 09/Feb/21 15:18
• Updated: 13/Dec/21 14:44
• Resolved: 13/Dec/21 14:44

Description

The state processor api on read currently takes an ExecutionEnvironment and returns a DataSet. As Flink now supports Bounded DataStream we want to support that as well but not have to maintain parallel apis. To that end we propose the following.

Introduce a new `load` method to Savepoint.

 

SavepointReader Savepoint#load(String path, StateBackend backend);

SavepointReader will contain the same read methods as ExistingSavepoint but they will instead return InputFormat<T, ?>. This way the input format can be used with either DataSet, DataStream, or Table API.

 

The reader methods in ExistingSavepoint should be deprecated.

 

Additionally, OperatorStateInputFormat and KeyedStateInputFormat should both now extend ResultTypeQueryable so users get efficient serializer for their reads.

 

Issue Links

• is related to: FLINK-24912 Migrate state processor API to DataStream API