[FLINK-16781] add built-in cache mechanism for LookupableTableSource in lookup join

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Component/s: Table SQL / API
• Labels: stale-major
• Assignee: Unassigned
• Reporter: Bowen Li
• Created: 25/Mar/20 17:53
• Updated: 29/Apr/21 16:34
• Resolved: 29/Apr/21 16:34

Description

Currently there's no built-in cache mechanism for LookupableTableSource. Developers have one of the following options:

1) build their own cache

2) use external cache services, like redis, memcached, etc, which Flink unfortunately doesn't have an out-of-box lookup function either

3) give up caching and bear with poor lookup performance

 

Flink should provide a generic caching layer for all the LookupableTableSource to take advantage of.

 

cc ykt836 jark lzljs3620320

Issue Links

• Is contained by: FLINK-16780 improve Flink lookup join