Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12016

Reduce number of versions in Meta table. Make it configurable

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 2.0.0
    • 1.0.0
    • None
    • None
    • Reviewed
    • Hide
      Clients fetch META table descriptor using RPC. That gives an opportunity to change META table parameters on running cluster. Prior this change all clients used statically compiled META table descriptor and to apply new parameters new code need to be deployed.
      META table versions can be configured by 'hbase.meta.versions' and now has 3 versions by default (was 10).
      Block size for META table can be configured by 'hbase.meta.blocksize' (default 8k)
      Show
      Clients fetch META table descriptor using RPC. That gives an opportunity to change META table parameters on running cluster. Prior this change all clients used statically compiled META table descriptor and to apply new parameters new code need to be deployed. META table versions can be configured by 'hbase.meta.versions' and now has 3 versions by default (was 10). Block size for META table can be configured by 'hbase.meta.blocksize' (default 8k)

    Description

      Currently meta keeps up to 10 versions of each KV.
      For big metas it leads to substantial memory overhead and scan slowdowns.
      (see https://issues.apache.org/jira/browse/HBASE-11165 )

      Need to keep reasonable number of versions (suggested value is 3).

      Number of versions configurable via parameter: hbase.meta.versions

      Attachments

        1. HBASE-12016.patch
          52 kB
          Andrey Stepachev
        2. HBASE-12016.patch
          51 kB
          Andrey Stepachev
        3. HBASE-12016.patch
          51 kB
          Andrey Stepachev
        4. HBASE-12016.patch
          46 kB
          Andrey Stepachev
        5. HBASE-12016.patch
          46 kB
          Andrey Stepachev
        6. HBASE-12016.patch
          44 kB
          Andrey Stepachev
        7. HBASE-12016.patch
          45 kB
          Andrey Stepachev

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            octo47 Andrey Stepachev
            octo47 Andrey Stepachev
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment