[PHOENIX-6501] Use batching when joining data table rows with uncovered global index rows

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 5.1.2
• Fix Version/s: 5.2.0, 4.16.2, 5.1.3
• Assignee: Kadir OZDEMIR
• Reporter: Kadir Ozdemir
• Created: 29/Jun/21 04:18
• Updated: 17/Mar/22 16:02
• Resolved: 15/Mar/22 23:02

Description

PHOENIX-6458 extends the existing uncovered local index support for global indexes. The current solution uses HBase get operations to join data table rows with uncovered index rows on the server side. Doing a separate RPC call for every data table row can be expensive. Instead, we can buffer lots of data row keys in memory,  use a skip scan filter and even multiple threads to issue a separate scan for each data table region in parallel. This will reduce the cost of join and also improve the performance.

Issue Links

• Blocked: PHOENIX-6458 Using global indexes for queries with uncovered columns
• Blocked: PHOENIX-6663 Use batching when joining data table rows with uncovered local index rows
• links to: GitHub Pull Request #1399