[FLINK-19343] FLIP-36: Support Interactive Programming in Flink

• Type: New Feature
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Table SQL / API
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Xuannan Su
• Created: 22/Sep/20 09:24
• Updated: 18/Oct/24 19:38

Description

Please refer to the FLIP for any details: https://cwiki.apache.org/confluence/display/FLINK/FLIP-36%3A+Support+Interactive+Programming+in+Flink

Issue Links

• is duplicated by: FLINK-11199 Support interactive programming in Flink
• is related to: FLINK-22768 ShuffleMaster supports to promote partitions
• mentioned in: Page Loading...

Sub-Tasks

• Generate and put ClusterPartitionDescriptor of ClusterPartition in JobResult when job finishes: Open
• Generate InputGateDeploymentDescriptor from a JobVertex with ClusterPartitionDescriptor: Open
• Introduce CacheSource and CacheSink: Open
• StreamGraphGenerator handle CacheSource and CacheSink: Open
• StreamingJobGraphGenerator add the ClusterPartitionDescriptor of cached node to JobVertex: Open
• StreamingJobGraphGenerator set the caching node to BoundedBlockingType: Open
• Add cache() method to Table: Open
• BlinkPlanner translate and optimize CacheOperation: Open
• Add invalidateCache() method in CachedTable: Open
• Add close() method to TableEnvironment: Open
• Introduce CacheManager in CatalogManager to keep track of the ClusterPartitionDescriptor: Open