[HBASE-12016] Reduce number of versions in Meta table. Make it configurable - ASF JIRA

XML

Word

Printable

JSON

Hadoop Flags:

Reviewed
Release Note:

Hide
Clients fetch META table descriptor using RPC. That gives an opportunity to change META table parameters on running cluster. Prior this change all clients used statically compiled META table descriptor and to apply new parameters new code need to be deployed.
META table versions can be configured by 'hbase.meta.versions' and now has 3 versions by default (was 10).
Block size for META table can be configured by 'hbase.meta.blocksize' (default 8k)

Show
Clients fetch META table descriptor using RPC. That gives an opportunity to change META table parameters on running cluster. Prior this change all clients used statically compiled META table descriptor and to apply new parameters new code need to be deployed. META table versions can be configured by 'hbase.meta.versions' and now has 3 versions by default (was 10). Block size for META table can be configured by 'hbase.meta.blocksize' (default 8k)

Currently meta keeps up to 10 versions of each KV.
For big metas it leads to substantial memory overhead and scan slowdowns.
(see https://issues.apache.org/jira/browse/HBASE-11165 )

Need to keep reasonable number of versions (suggested value is 3).

Number of versions configurable via parameter: hbase.meta.versions

incorporates

HBASE-12010 Use TableName.META_TABLE_NAME instead of indirectly from HTableDescriptor

relates to

HBASE-16832 Reduce the default number of versions in Meta table for branch-1

HBASE-12204 Backport HBASE-12016 'Reduce number of versions in Meta table. Make it configurable' to branch-1