[FLINK-13570] Pluggable Intermediate Result Storage

• Type: New Feature
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Table SQL / API
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Xuannan Su
• Created: 05/Aug/19 02:08
• Updated: 11/Dec/21 10:39

Description

As discussed in FLIP-48, the intermediate result storage is the backend storage where the content of the cached table stored.

FLIP-36 provides a default implementation of the intermediate result storage so that the user can use the cache out of the box.

For more advanced usage of the cache, users may want to plug in some external storages to store the intermediate result. This task is to provide the necessary interfaces for the pluggable intermediate result storage and implementation of using the filesystem as the intermediate result storage.

Issue Links

• mentioned in: Page Loading...

Sub-Tasks

• Introduce Configurable, TableCreationHook and TableCleanupHook Interfaces: Open
• Introduce IntermediateResultStorage Interface: Open
• Introduce IntermediateResultStorageDescriptor: Open
• Enable configuring IntermediateResultStorage with YAML: Open