[FLINK-28415] FLIP-221: Support Partial and Full Caching in Lookup Table Source

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.16.0
• Fix Version/s: 1.16.0
• Component/s: Table SQL / API, Table SQL / Runtime
• Release Note: FLIP-221 provides a unified caching framework for lookup tables, including partial caching which loads entries into cache on a just-in-time basis, and full caching which loads all entries from the external system into the cache.
• Assignee: Qingsheng Ren
• Reporter: Qingsheng Ren
• Created: 06/Jul/22 06:28
• Updated: 12/Oct/22 04:26
• Resolved: 09/Aug/22 23:17

Description

Please see the FLIP for any details: https://cwiki.apache.org/confluence/display/FLINK/FLIP-221%3A+Abstraction+for+lookup+source+cache+and+metric

Issue Links

• contains: FLINK-25409 Add cache metric to LookupFunction

Sub-Tasks

• Add the new LookupFunction interface for lookup table source: Resolved
• Add interface and default implementation for cache in lookup table: Resolved
• Add runtime provider interface for partial caching lookup: Resolved
• Add runtime provider interface for full caching lookup: Resolved
• Support partial lookup caching in lookup join runners: Closed
• Support InputFormat as full caching provider in lookup table source: Resolved
• Migrate JDBC table connector to the new LookupFunction interface: Resolved
• Migrate HBase table connector to the new LookupFunction interface: Resolved
• Add documentation for lookup table caching feature: Open
• Update documentation of JDBC and HBase lookup table for new caching options: Resolved