[FLINK-21782] Lookup Table based on rowkey ranges

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Connectors / HBase, Table SQL / Ecosystem
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Felipe Lolas
• Created: 14/Mar/21 17:45
• Updated: 05/Nov/21 10:39

Description

Hi,

Currently in a HBase table we model the data for a fast prefix filter scan, would be nice that we can use a lookup join as:

 

SELECT
   *
FROM
   tbl
LEFT JOIN
   hbaseTbl 
ON
  hbaseTbl.rowkey between tbl.field1 AND tbl.field2

In HBase we can traduce that as a RANGE SCAN operator with startRow = tbl.field1 and endRow = tbl.field2

Maybe too (same as Apache phoenix behaviour)

 

SELECT
 *
FROM
 tbl
LEFT JOIN
 hbaseTbl 
ON
 hbaseTbl.rowkey LIKE tbl.field1 || '%'

 

traduced as RANGE SCAN with startRow=tbl.field1 - 1 (replacing the last character with lexicographical order -1) and endRow=tbl.field1 or simply a RowPrefixFilter (does the same)

Issue Links

• duplicates: FLINK-21781 Lookup Table based on rowkey ranges