Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4341

add types to capacity scheduler properties documentation

    Details

      Description

      MAPREDUCE-4311 is changing capacity/max capacity configuration to be floats. We should document that in the capacity scheduler properties docs (http://hadoop.apache.org/common/docs/r0.23.1/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Configuration).

      1. MR-4341.patch
        1 kB
        Karthik Kambatla

        Issue Links

          Activity

          Thomas Graves created issue -
          Thomas Graves made changes -
          Field Original Value New Value
          Summary add types to capacity scheduler properties add types to capacity scheduler properties documentation
          Thomas Graves made changes -
          Link This issue depends on MAPREDUCE-4311 [ MAPREDUCE-4311 ]
          Karthik Kambatla (Inactive) made changes -
          Assignee Karthik Kambatla [ kkambatl ]
          Hide
          Karthik Kambatla (Inactive) added a comment -

          The documentation doesn't say the capacities are limited to integers either. Does this warrant a change to the documentation?

          Show
          Karthik Kambatla (Inactive) added a comment - The documentation doesn't say the capacities are limited to integers either. Does this warrant a change to the documentation?
          Hide
          Harsh J added a comment -

          I do think it is good if we can be explicit about the supported input format for the config params.

          Show
          Harsh J added a comment - I do think it is good if we can be explicit about the supported input format for the config params.
          Hide
          Karthik Kambatla (Inactive) added a comment -

          Adding a patch that mentions capacities can be floats. Didn't test as it is tiny change to documentation

          Show
          Karthik Kambatla (Inactive) added a comment - Adding a patch that mentions capacities can be floats. Didn't test as it is tiny change to documentation
          Karthik Kambatla (Inactive) made changes -
          Attachment MR-4341.patch [ 12532226 ]
          Hide
          Karthik Kambatla (Inactive) added a comment -

          No tests include as it is a tiny documentation change.

          Show
          Karthik Kambatla (Inactive) added a comment - No tests include as it is a tiny documentation change.
          Karthik Kambatla (Inactive) made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hadoop Flags Incompatible change [ 10342 ]
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12532226/MR-4341.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2463//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2463//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12532226/MR-4341.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2463//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2463//console This message is automatically generated.
          Hide
          Thomas Graves added a comment -

          can you add it for max capacity also please.

          Show
          Thomas Graves added a comment - can you add it for max capacity also please.
          Hide
          Karthik Kambatla (Inactive) added a comment -

          Will add the documentation for max-capacity as well, and upload another patch shortly.

          Show
          Karthik Kambatla (Inactive) added a comment - Will add the documentation for max-capacity as well, and upload another patch shortly.
          Karthik Kambatla (Inactive) made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Karthik Kambatla (Inactive) made changes -
          Attachment MR-4341.patch [ 12532226 ]
          Karthik Kambatla (Inactive) made changes -
          Attachment MR-4341.patch [ 12532428 ]
          Hide
          Karthik Kambatla (Inactive) added a comment -

          Modified documentation to mention both capacity and max-capacity are of type float.

          Didn't test.

          Show
          Karthik Kambatla (Inactive) added a comment - Modified documentation to mention both capacity and max-capacity are of type float. Didn't test.
          Karthik Kambatla (Inactive) made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.23.3 [ 12320060 ]
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12532428/MR-4341.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2469//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2469//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12532428/MR-4341.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2469//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2469//console This message is automatically generated.
          Hide
          Thomas Graves added a comment -

          +1. Thanks Karthik. I committed this to trunk, branch-2, and branch-0.23.

          Show
          Thomas Graves added a comment - +1. Thanks Karthik. I committed this to trunk, branch-2, and branch-0.23.
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Thomas Graves made changes -
          Hadoop Flags Incompatible change [ 10342 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #2441 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2441/)
          MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762)

          Result = SUCCESS
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #2441 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2441/ ) MAPREDUCE-4341 . add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #2371 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2371/)
          MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762)

          Result = SUCCESS
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #2371 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2371/ ) MAPREDUCE-4341 . add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #2390 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2390/)
          MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762)

          Result = FAILURE
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #2390 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2390/ ) MAPREDUCE-4341 . add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762) Result = FAILURE tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #1082 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1082/)
          MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762)

          Result = FAILURE
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1082 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1082/ ) MAPREDUCE-4341 . add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762) Result = FAILURE tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Build #292 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/292/)
          merge -r 1351763:1351764 from branch-2. FIXES: MAPREDUCE-4341 (Revision 1351766)

          Result = SUCCESS
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351766
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #292 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/292/ ) merge -r 1351763:1351764 from branch-2. FIXES: MAPREDUCE-4341 (Revision 1351766) Result = SUCCESS tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351766 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #1115 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1115/)
          MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762)

          Result = FAILURE
          tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1115 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1115/ ) MAPREDUCE-4341 . add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). (Revision 1351762) Result = FAILURE tgraves : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1351762 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/CapacityScheduler.apt.vm
          Arun C Murthy made changes -
          Fix Version/s 2.0.2-alpha [ 12322471 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Gavin made changes -
          Link This issue depends on MAPREDUCE-4311 [ MAPREDUCE-4311 ]
          Gavin made changes -
          Link This issue depends upon MAPREDUCE-4311 [ MAPREDUCE-4311 ]
          Gavin made changes -
          Assignee Karthik Kambatla [ kkambatl ] Karthik Kambatla [ kasha ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Patch Available Patch Available Open Open
          2d 20h 21m 1 Karthik Kambatla (Inactive) 18/Jun/12 16:21
          Open Open Patch Available Patch Available
          1d 6h 29m 2 Karthik Kambatla (Inactive) 18/Jun/12 18:20
          Patch Available Patch Available Resolved Resolved
          22h 59m 1 Thomas Graves 19/Jun/12 17:19
          Resolved Resolved Closed Closed
          114d 1h 29m 1 Arun C Murthy 11/Oct/12 18:48

            People

            • Assignee:
              Karthik Kambatla
              Reporter:
              Thomas Graves
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development