[HBASE-11046] New Scanner API

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Fix Version/s: 0.89-fb
• Component/s: Scanners
• Labels: features
• Assignee: Unassigned
• Reporter: @deprecated Yi Deng
• Created: 21/Apr/14 19:40
• Updated: 17/Jun/22 05:34
• Resolved: 06/Apr/15 19:52

Description

A new scanner API for reducing unnecessary RPC calls:
Motivation:

1. RPC is expensive to both client and server.
2. The most important function for scanning is getting data, but for each scanning process within a region, there are 3 times of RPC that doesn't transfer data: open, last next, and close, I want to remove them all (for most of the situation)

Solution:

1. a new scanner API (scanOpen) which has an option of transfer data along with the scannerID back in this call
2. a new scanner API (scanNext) which is similar to current next, but returns flags of whether more data is available and whether need to scan next region. If no data left, automatically close the scanner.
3. scanClose is still useful when you want to close the scanner before reach the end.

For most of the meta-scan, only one RPC will fetch all lines.