HBase
  1. HBase
  2. HBASE-11735

Document Configurable Bucket Sizes in bucketCache

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.99.0, 0.98.4, 0.98.5
    • Fix Version/s: 0.99.0, 2.0.0, 0.98.6
    • Component/s: documentation
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    1. HBASE-11735.patch
      4 kB
      Misty Stanley-Jones
    2. HBASE-11735.patch
      4 kB
      Misty Stanley-Jones

      Issue Links

        Activity

        Misty Stanley-Jones created issue -
        Misty Stanley-Jones made changes -
        Field Original Value New Value
        Fix Version/s 0.99.0 [ 12325675 ]
        Fix Version/s 0.98.4 [ 12326810 ]
        Hide
        Misty Stanley-Jones added a comment -

        Configurable sizes via hbase.bucketcache.bucket.sizes, should be a comma-separated list of block sizes, like 4096, 8192

        Should be in increasing order, HBASE-11550 will check for that.

        For only one size of bucket, use hbase.bucketcache.bucket.size instead.

        Goal is to optimize buckets based on data access patterns.

        Show
        Misty Stanley-Jones added a comment - Configurable sizes via hbase.bucketcache.bucket.sizes, should be a comma-separated list of block sizes, like 4096, 8192 Should be in increasing order, HBASE-11550 will check for that. For only one size of bucket, use hbase.bucketcache.bucket.size instead. Goal is to optimize buckets based on data access patterns.
        Hide
        Nick Dimiduk added a comment -

        Until 11550 is in, i think the string must be comma-delimited only; no spaces.

        Show
        Nick Dimiduk added a comment - Until 11550 is in, i think the string must be comma-delimited only; no spaces.
        Nick Dimiduk made changes -
        Affects Version/s 0.98.5 [ 12326953 ]
        Affects Version/s 0.98.4 [ 12326810 ]
        Affects Version/s 0.99.0 [ 12325675 ]
        Nick Dimiduk made changes -
        Fix Version/s 0.98.6 [ 12327376 ]
        Fix Version/s 0.98.4 [ 12326810 ]
        Nick Dimiduk made changes -
        Link This issue relates to HBASE-10641 [ HBASE-10641 ]
        Nick Dimiduk made changes -
        Parent HBASE-10641 [ 12698005 ]
        Issue Type Sub-task [ 7 ] Task [ 3 ]
        Hide
        Nick Dimiduk added a comment -

        Converted to task as parent issue is already closed and shipped. Linked to parent instead.

        Show
        Nick Dimiduk added a comment - Converted to task as parent issue is already closed and shipped. Linked to parent instead.
        Nick Dimiduk made changes -
        Link This issue relates to HBASE-11550 [ HBASE-11550 ]
        Misty Stanley-Jones made changes -
        Attachment HBASE-11735.patch [ 12661612 ]
        Misty Stanley-Jones made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12661612/HBASE-11735.patch
        against trunk revision .
        ATTACHMENT ID: 12661612

        +1 @author. The patch does not contain any @author tags.

        +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 lineLengths. The patch does not introduce lines longer than 100

        +1 site. The mvn site goal succeeds with this patch.

        -1 core tests. The patch failed these unit tests:

        -1 core zombie tests. There are 1 zombie test(s):

        Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12661612/HBASE-11735.patch against trunk revision . ATTACHMENT ID: 12661612 +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 lineLengths . The patch does not introduce lines longer than 100 +1 site . The mvn site goal succeeds with this patch. -1 core tests . The patch failed these unit tests: -1 core zombie tests . There are 1 zombie test(s): Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10425//console This message is automatically generated.
        Hide
        Misty Stanley-Jones added a comment -

        Had to rebase.

        Show
        Misty Stanley-Jones added a comment - Had to rebase.
        Misty Stanley-Jones made changes -
        Attachment HBASE-11735.patch [ 12661943 ]
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12661943/HBASE-11735.patch
        against trunk revision .
        ATTACHMENT ID: 12661943

        +1 @author. The patch does not contain any @author tags.

        +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 lineLengths. The patch does not introduce lines longer than 100

        +1 site. The mvn site goal succeeds with this patch.

        +1 core tests. The patch passed unit tests in .

        Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12661943/HBASE-11735.patch against trunk revision . ATTACHMENT ID: 12661943 +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 lineLengths . The patch does not introduce lines longer than 100 +1 site . The mvn site goal succeeds with this patch. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10447//console This message is automatically generated.
        Hide
        Misty Stanley-Jones added a comment -

        What do you think, stack?

        Show
        Misty Stanley-Jones added a comment - What do you think, stack ?
        Hide
        stack added a comment -

        I removed the bit about hbase.offheapcache.percentage. It is removed and even where it is present, it is a PITA. Nice job Misty Stanley-Jones Thanks.

        Show
        stack added a comment - I removed the bit about hbase.offheapcache.percentage. It is removed and even where it is present, it is a PITA. Nice job Misty Stanley-Jones Thanks.
        stack made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 2.0.0 [ 12327188 ]
        Resolution Fixed [ 1 ]
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in HBase-TRUNK #5412 (See https://builds.apache.org/job/HBase-TRUNK/5412/)
        HBASE-11735 Document Configurable Bucket Sizes in bucketCache (Misty Stanley-Jones) (stack: rev 50f17935fdd14bfe869f1267de754a80bb6ad1ef)

        • src/main/docbkx/book.xml
        • hbase-common/src/main/resources/hbase-default.xml
        Show
        Hudson added a comment - SUCCESS: Integrated in HBase-TRUNK #5412 (See https://builds.apache.org/job/HBase-TRUNK/5412/ ) HBASE-11735 Document Configurable Bucket Sizes in bucketCache (Misty Stanley-Jones) (stack: rev 50f17935fdd14bfe869f1267de754a80bb6ad1ef) src/main/docbkx/book.xml hbase-common/src/main/resources/hbase-default.xml
        Hide
        Enis Soztutar added a comment -

        Closing this issue after 0.99.0 release.

        Show
        Enis Soztutar added a comment - Closing this issue after 0.99.0 release.
        Enis Soztutar made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Hide
        Biju Nair added a comment -

        I think the parameter hbase.bucketcache.sizes is used in the document patch instead of hbase.bucketcache.bucket.sizes to configure bucket sizes.

        Show
        Biju Nair added a comment - I think the parameter hbase.bucketcache.sizes is used in the document patch instead of hbase.bucketcache.bucket.sizes to configure bucket sizes.
        Misty Stanley-Jones made changes -
        Link This issue is cloned by HBASE-13928 [ HBASE-13928 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        47m 52s 1 Misty Stanley-Jones 14/Aug/14 01:59
        Patch Available Patch Available Resolved Resolved
        5d 19h 47m 1 stack 19/Aug/14 21:47
        Resolved Resolved Closed Closed
        186d 1h 46m 1 Enis Soztutar 21/Feb/15 23:34

          People

          • Assignee:
            Misty Stanley-Jones
            Reporter:
            Misty Stanley-Jones
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development