[FLINK-31397] Introduce write-once hash lookup store

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: table-store-0.4.0
• Component/s: Table Store
• Labels: pull-request-available
• Assignee: Jingsong Lee
• Reporter: Jingsong Lee
• Created: 10/Mar/23 09:44
• Updated: 14/Mar/23 03:17
• Resolved: 14/Mar/23 03:17

Description

Introduce interface for lookup changelog producer:

/**
 * A key-value store for lookup, key-value store should be single binary file written once and ready
 * to be used. This factory provide two interfaces:
 *
 * <ul>
 *   <li>Writer: written once to prepare binary file.
 *   <li>Reader: lookup value by key bytes.
 * </ul>
 */
public interface LookupStoreFactory {

    LookupStoreWriter createWriter(File file) throws IOException;

    LookupStoreReader createReader(File file) throws IOException;
}
 

We can convert remote columnar data to local lookup store, and ready to be used to lookup.

Issue Links

• links to: GitHub Pull Request #593