[HBASE-1307] Threading writes and reads into HBase.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.90.0
• Component/s: regionserver
• Assignee: Unassigned
• Reporter: Erik Holstad
• Created: 03/Apr/09 17:27
• Updated: 11/Jun/22 19:49
• Resolved: 13/Nov/12 01:46

Description

I created this issue to be the overall issue for threading to increase read and write performance in HBase and to keep it as a discussion place about threading of these elements in general. Today we are doing batching of writes and from 0.20 you will be able to do that for reads too. The thing is that the batching procedure doesn't use the ability to run these different queries at the same time, but more like a series of queries. I think that after getting a good stable 0.20 system down we should try to add threading to increase throughput for both reading and writing. At the top level of these calls I don't think that is is goin gto be to hard to do this in parallel, where it gets a little bit more complicated is when you get down to running a get query on memcache and all the storefiles at the same time, but above that I don't see it being to hard. I do think that this should not be a part of 0.20 but rather an optimization in 0.21 or so.

Issue Links

• depends upon: HBASE-74 [performance] When a get or scan request spans multiple columns, execute the reads in parallel
• depends upon: HBASE-1306 [performance] Threading the update process when writing to HBase.