HBase
  1. HBase
  2. HBASE-11735

Document Configurable Bucket Sizes in bucketCache

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.99.0, 0.98.4, 0.98.5
    • Fix Version/s: 0.99.0, 2.0.0, 0.98.6
    • Component/s: documentation
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    1. HBASE-11735.patch
      4 kB
      Misty Stanley-Jones
    2. HBASE-11735.patch
      4 kB
      Misty Stanley-Jones

      Issue Links

        Activity

        Hide
        Misty Stanley-Jones added a comment -

        Configurable sizes via hbase.bucketcache.bucket.sizes, should be a comma-separated list of block sizes, like 4096, 8192

        Should be in increasing order, HBASE-11550 will check for that.

        For only one size of bucket, use hbase.bucketcache.bucket.size instead.

        Goal is to optimize buckets based on data access patterns.

        Show
        Misty Stanley-Jones added a comment - Configurable sizes via hbase.bucketcache.bucket.sizes, should be a comma-separated list of block sizes, like 4096, 8192 Should be in increasing order, HBASE-11550 will check for that. For only one size of bucket, use hbase.bucketcache.bucket.size instead. Goal is to optimize buckets based on data access patterns.
        Hide
        Nick Dimiduk added a comment -

        Until 11550 is in, i think the string must be comma-delimited only; no spaces.

        Show
        Nick Dimiduk added a comment - Until 11550 is in, i think the string must be comma-delimited only; no spaces.
        Hide
        Nick Dimiduk added a comment -

        Converted to task as parent issue is already closed and shipped. Linked to parent instead.

        Show
        Nick Dimiduk added a comment - Converted to task as parent issue is already closed and shipped. Linked to parent instead.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12661612/HBASE-11735.patch
        against trunk revision .
        ATTACHMENT ID: 12661612

        +1 @author. The patch does not contain any @author tags.

        +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 lineLengths. The patch does not introduce lines longer than 100

        +1 site. The mvn site goal succeeds with this patch.

        -1 core tests. The patch failed these unit tests:

        -1 core zombie tests. There are 1 zombie test(s):

        Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12661612/HBASE-11735.patch against trunk revision . ATTACHMENT ID: 12661612 +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 lineLengths . The patch does not introduce lines longer than 100 +1 site . The mvn site goal succeeds with this patch. -1 core tests . The patch failed these unit tests: -1 core zombie tests . There are 1 zombie test(s): Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//console This message is automatically generated.
        Hide
        Misty Stanley-Jones added a comment -

        Had to rebase.

        Show
        Misty Stanley-Jones added a comment - Had to rebase.
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12661943/HBASE-11735.patch
        against trunk revision .
        ATTACHMENT ID: 12661943

        +1 @author. The patch does not contain any @author tags.

        +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 lineLengths. The patch does not introduce lines longer than 100

        +1 site. The mvn site goal succeeds with this patch.

        +1 core tests. The patch passed unit tests in .

        Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12661943/HBASE-11735.patch against trunk revision . ATTACHMENT ID: 12661943 +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 lineLengths . The patch does not introduce lines longer than 100 +1 site . The mvn site goal succeeds with this patch. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//console This message is automatically generated.
        Hide
        Misty Stanley-Jones added a comment -

        What do you think, stack?

        Show
        Misty Stanley-Jones added a comment - What do you think, stack ?
        Hide
        stack added a comment -

        I removed the bit about hbase.offheapcache.percentage. It is removed and even where it is present, it is a PITA. Nice job Misty Stanley-Jones Thanks.

        Show
        stack added a comment - I removed the bit about hbase.offheapcache.percentage. It is removed and even where it is present, it is a PITA. Nice job Misty Stanley-Jones Thanks.
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in HBase-TRUNK #5412 (See https://builds.apache.org/job/HBase-TRUNK/5412/)
        HBASE-11735 Document Configurable Bucket Sizes in bucketCache (Misty Stanley-Jones) (stack: rev 50f17935fdd14bfe869f1267de754a80bb6ad1ef)

        • src/main/docbkx/book.xml
        • hbase-common/src/main/resources/hbase-default.xml
        Show
        Hudson added a comment - SUCCESS: Integrated in HBase-TRUNK #5412 (See https://builds.apache.org/job/HBase-TRUNK/5412/ ) HBASE-11735 Document Configurable Bucket Sizes in bucketCache (Misty Stanley-Jones) (stack: rev 50f17935fdd14bfe869f1267de754a80bb6ad1ef) src/main/docbkx/book.xml hbase-common/src/main/resources/hbase-default.xml
        Hide
        Enis Soztutar added a comment -

        Closing this issue after 0.99.0 release.

        Show
        Enis Soztutar added a comment - Closing this issue after 0.99.0 release.
        Hide
        Biju Nair added a comment -

        I think the parameter hbase.bucketcache.sizes is used in the document patch instead of hbase.bucketcache.bucket.sizes to configure bucket sizes.

        Show
        Biju Nair added a comment - I think the parameter hbase.bucketcache.sizes is used in the document patch instead of hbase.bucketcache.bucket.sizes to configure bucket sizes.

          People

          • Assignee:
            Misty Stanley-Jones
            Reporter:
            Misty Stanley-Jones
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development