[HBASE-10421] Investigate scan performance in 0.96 and later

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 0.98.0
• Assignee: Unassigned
• Reporter: Lars Hofhansl
• Created: 26/Jan/14 17:37
• Updated: 17/Jun/22 05:02
• Resolved: 28/Jan/14 19:27

Description

Testing the "internal friction" of scanning in HBase (all data in the block cache, and all rows filtered at the server by a ValueFilter, so that one really measures the work HBase does internally), I found that 0.98 is almost 35% slower than 0.94.

Scanning 50m rows (one col each, 8 byte keys, 8 byte values) takes 13.2 in 0.94.17-SNAPSHOT and 18.5s in 0.98.

This probably came about with all the protobuf changes in 0.96.
It should be possible to bring back to par with 0.94.

Issue Links

• is related to: HBASE-4811 Support reverse Scan