[GORA-117] gora hbase does not have a mechanism to set the caching on a scanner, which makes for poor performance on map/reduce jobs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.2
• Fix Version/s: 0.4
• Component/s: gora-hbase
• Assignee: Michael Stack
• Reporter: Eric C. Newton
• Created: 10/Apr/12 21:36
• Updated: 03/Mar/22 14:27
• Resolved: 07/Jan/14 13:43

Description

goraci runs a map/reduce job over all the data that it generates. The hbase storage uses a scanner that doesn't cache rows, which means every fetch requires an RPC call. I experimented with

scan.setCaching(1000);

and goraci Verify ran about 30x faster.