Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-9341

Document hbase.hstore.compaction.kv.max

    Details

    • Hadoop Flags:
      Reviewed
    • Tags:
      compaction

      Description

      This setting is used within Compactor.java, apparently since 0.90 but has never been documented. It could be useful for people using very wide rows or those who want to fine tune their compactions.

        Activity

        Hide
        lars_francke Lars Francke added a comment -

        This issue was closed as part of a bulk closing operation on 2015-11-20. All issues that have been resolved and where all fixVersions have been released have been closed (following discussions on the mailing list).

        Show
        lars_francke Lars Francke added a comment - This issue was closed as part of a bulk closing operation on 2015-11-20. All issues that have been resolved and where all fixVersions have been released have been closed (following discussions on the mailing list).
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #700 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/700/)
        HBASE-9341 Document hbase.hstore.compaction.kv.max (stack: rev 1518400)

        • /hbase/trunk/hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java
        • /hbase/trunk/hbase-common/src/main/resources/hbase-default.xml
        • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFlusher.java
        • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #700 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/700/ ) HBASE-9341 Document hbase.hstore.compaction.kv.max (stack: rev 1518400) /hbase/trunk/hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java /hbase/trunk/hbase-common/src/main/resources/hbase-default.xml /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFlusher.java /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in HBase-TRUNK #4442 (See https://builds.apache.org/job/HBase-TRUNK/4442/)
        HBASE-9341 Document hbase.hstore.compaction.kv.max (stack: rev 1518400)

        • /hbase/trunk/hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java
        • /hbase/trunk/hbase-common/src/main/resources/hbase-default.xml
        • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFlusher.java
        • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in HBase-TRUNK #4442 (See https://builds.apache.org/job/HBase-TRUNK/4442/ ) HBASE-9341 Document hbase.hstore.compaction.kv.max (stack: rev 1518400) /hbase/trunk/hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java /hbase/trunk/hbase-common/src/main/resources/hbase-default.xml /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFlusher.java /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in hbase-0.95-on-hadoop2 #276 (See https://builds.apache.org/job/hbase-0.95-on-hadoop2/276/)
        HBASE-9341 Document hbase.hstore.compaction.kv.max (stack: rev 1518399)

        • /hbase/branches/0.95/hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java
        • /hbase/branches/0.95/hbase-common/src/main/resources/hbase-default.xml
        • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFlusher.java
        • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in hbase-0.95-on-hadoop2 #276 (See https://builds.apache.org/job/hbase-0.95-on-hadoop2/276/ ) HBASE-9341 Document hbase.hstore.compaction.kv.max (stack: rev 1518399) /hbase/branches/0.95/hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java /hbase/branches/0.95/hbase-common/src/main/resources/hbase-default.xml /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFlusher.java /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
        Hide
        jmspaggi Jean-Marc Spaggiari added a comment -

        I think we should also propose something like Document hbase.hstore.compaction.kv.maxsize taking bytes as a parameter for people who want to limit the compaction based on the memory and not on the number of KVs?

        Show
        jmspaggi Jean-Marc Spaggiari added a comment - I think we should also propose something like Document hbase.hstore.compaction.kv.maxsize taking bytes as a parameter for people who want to limit the compaction based on the memory and not on the number of KVs?
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in hbase-0.95 #501 (See https://builds.apache.org/job/hbase-0.95/501/)
        HBASE-9341 Document hbase.hstore.compaction.kv.max (stack: rev 1518399)

        • /hbase/branches/0.95/hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java
        • /hbase/branches/0.95/hbase-common/src/main/resources/hbase-default.xml
        • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFlusher.java
        • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in hbase-0.95 #501 (See https://builds.apache.org/job/hbase-0.95/501/ ) HBASE-9341 Document hbase.hstore.compaction.kv.max (stack: rev 1518399) /hbase/branches/0.95/hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java /hbase/branches/0.95/hbase-common/src/main/resources/hbase-default.xml /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFlusher.java /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
        Hide
        hadoopqa Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12600465/9341.txt
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

        +1 hadoop1.0. The patch compiles against the hadoop 1.0 profile.

        +1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 lineLengths. The patch does not introduce lines longer than 100

        +1 site. The mvn site goal succeeds with this patch.

        +1 core tests. The patch passed unit tests in .

        Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12600465/9341.txt against trunk revision . +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. +1 hadoop1.0 . The patch compiles against the hadoop 1.0 profile. +1 hadoop2.0 . The patch compiles against the hadoop 2.0 profile. +1 javadoc . The javadoc tool did not generate any warning messages. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 lineLengths . The patch does not introduce lines longer than 100 +1 site . The mvn site goal succeeds with this patch. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/6955//console This message is automatically generated.
        Hide
        stack stack added a comment -

        Thanks Nick. Committed to 0.95 and trunk.

        Show
        stack stack added a comment - Thanks Nick. Committed to 0.95 and trunk.
        Hide
        ndimiduk Nick Dimiduk added a comment -

        +1

        Show
        ndimiduk Nick Dimiduk added a comment - +1
        Hide
        stack stack added a comment -

        Add to hbase-default.xml so it'll show in documentation.

        Show
        stack stack added a comment - Add to hbase-default.xml so it'll show in documentation.

          People

          • Assignee:
            stack stack
            Reporter:
            cf357 Adrien Mogenet
          • Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development