[HBASE-700] hbase.io.index.interval need be configuratable in column family

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.1.2
• Fix Version/s: 0.2.0
• Component/s: regionserver
• Assignee: Andrew Kyle Purtell
• Reporter: Luo Ning
• Created: 20/Jun/08 05:24
• Updated: 22/Aug/08 21:13
• Resolved: 17/Jul/08 07:05

Description

setting parameter hbase.io.index.interval to smaller can improve hbase reading performance significantly, esp. in large value size column families. however, small hbase.io.index.interval cause more memory usage, because all index will read into memory when loading a mapfile.

in my test env, i set hbase.io.index.interval to 1, after inserting about 3M samll size records to a table(about 1.5G in hadoop file), the regionserver throws OOME. then i found total size of map file index is 350M. however, i can't adjust hbase.io.index.interval to a larger one, like 32, because other big cell size tables need it be 1.

so, i think make hbase.io.index.interval a column family property should be very important for performance tuning.

Issue Links

• is part of: HBASE-62 [hbase] Allow user add arbitrary key/value pairs to table and column descriptors