Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4341

add types to capacity scheduler properties documentation

    Details

      Description

      MAPREDUCE-4311 is changing capacity/max capacity configuration to be floats. We should document that in the capacity scheduler properties docs (http://hadoop.apache.org/common/docs/r0.23.1/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Configuration).

      1. MR-4341.patch
        1 kB
        Karthik Kambatla

        Issue Links

          Activity

          Hide
          Karthik Kambatla (Inactive) added a comment -

          The documentation doesn't say the capacities are limited to integers either. Does this warrant a change to the documentation?

          Show
          Karthik Kambatla (Inactive) added a comment - The documentation doesn't say the capacities are limited to integers either. Does this warrant a change to the documentation?
          Hide
          Harsh J added a comment -

          I do think it is good if we can be explicit about the supported input format for the config params.

          Show
          Harsh J added a comment - I do think it is good if we can be explicit about the supported input format for the config params.
          Hide
          Karthik Kambatla (Inactive) added a comment -

          Adding a patch that mentions capacities can be floats. Didn't test as it is tiny change to documentation

          Show
          Karthik Kambatla (Inactive) added a comment - Adding a patch that mentions capacities can be floats. Didn't test as it is tiny change to documentation
          Hide
          Karthik Kambatla (Inactive) added a comment -

          No tests include as it is a tiny documentation change.

          Show
          Karthik Kambatla (Inactive) added a comment - No tests include as it is a tiny documentation change.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12532226/MR-4341.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2463//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2463//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12532226/MR-4341.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2463//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2463//console This message is automatically generated.
          Hide
          Thomas Graves added a comment -

          can you add it for max capacity also please.

          Show
          Thomas Graves added a comment - can you add it for max capacity also please.
          Hide
          Karthik Kambatla (Inactive) added a comment -

          Will add the documentation for max-capacity as well, and upload another patch shortly.

          Show
          Karthik Kambatla (Inactive) added a comment - Will add the documentation for max-capacity as well, and upload another patch shortly.
          Hide
          Karthik Kambatla (Inactive) added a comment -

          Modified documentation to mention both capacity and max-capacity are of type float.

          Didn't test.

          Show
          Karthik Kambatla (Inactive) added a comment - Modified documentation to mention both capacity and max-capacity are of type float. Didn't test.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12532428/MR-4341.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2469//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2469//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12532428/MR-4341.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2469//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2469//console This message is automatically generated.
          Hide
          Thomas Graves added a comment -

          +1. Thanks Karthik. I committed this to trunk, branch-2, and branch-0.23.

          Show
          Thomas Graves added a comment - +1. Thanks Karthik. I committed this to trunk, branch-2, and branch-0.23.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #2441 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2441/)
          MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762)

          Result = SUCCESS
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #2441 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2441/ ) MAPREDUCE-4341 . add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #2371 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2371/)
          MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762)

          Result = SUCCESS
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #2371 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2371/ ) MAPREDUCE-4341 . add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #2390 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2390/)
          MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762)

          Result = FAILURE
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #2390 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2390/ ) MAPREDUCE-4341 . add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762) Result = FAILURE tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #1082 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1082/)
          MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762)

          Result = FAILURE
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1082 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1082/ ) MAPREDUCE-4341 . add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762) Result = FAILURE tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Build #292 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/292/)
          merge -r 1351763:1351764 from branch-2. FIXES: MAPREDUCE-4341 (Revision 1351766)

          Result = SUCCESS
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351766
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #292 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/292/ ) merge -r 1351763:1351764 from branch-2. FIXES: MAPREDUCE-4341 (Revision 1351766) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351766 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #1115 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1115/)
          MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762)

          Result = FAILURE
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1115 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1115/ ) MAPREDUCE-4341 . add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762) Result = FAILURE tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm

            People

            • Assignee:
              Karthik Kambatla
              Reporter:
              Thomas Graves
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development