Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3947

yarn.app.mapreduce.am.resource.mb not documented

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.24.0, 0.23.3
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: None
    • Labels:

      Description

      This configuration is useful but doesn't appear to be documented anywhere.

        Activity

        Todd Lipcon created issue -
        Devaraj K made changes -
        Field Original Value New Value
        Attachment MAPREDUCE-3947.patch [ 12519980 ]
        Hide
        Devaraj K added a comment -

        I have added this property to mapred-default.xml file.

        Show
        Devaraj K added a comment - I have added this property to mapred-default.xml file.
        Devaraj K made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Labels newbie mrv2
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12519980/MAPREDUCE-3947.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2103//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2103//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12519980/MAPREDUCE-3947.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2103//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2103//console This message is automatically generated.
        Hide
        Devaraj K added a comment -

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        No tests needed for this since it is a documentation issue.

        Show
        Devaraj K added a comment - -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. No tests needed for this since it is a documentation issue.
        Hide
        Harsh J added a comment -

        I think the default AM memory is also under review. Do we really need 2 GB defaults for the AM?

        Perhaps you can mark this as dupe of MAPREDUCE-3812 and improve upon Vinod's patch on that, which sorta lowers configs (still a good place to add to xml)?

        Show
        Harsh J added a comment - I think the default AM memory is also under review. Do we really need 2 GB defaults for the AM? Perhaps you can mark this as dupe of MAPREDUCE-3812 and improve upon Vinod's patch on that, which sorta lowers configs (still a good place to add to xml)?
        Hide
        Robert Joseph Evans added a comment -

        Harsh, I agree that MAPREDUCE-3812 is a good place to add in the config, but it has been stalled for a while and it is not a big deal for MAPREDUCE-3812 to update the default.xml as well.

        I am +1 the change is simple enough and documents the config properly.

        Show
        Robert Joseph Evans added a comment - Harsh, I agree that MAPREDUCE-3812 is a good place to add in the config, but it has been stalled for a while and it is not a big deal for MAPREDUCE-3812 to update the default.xml as well. I am +1 the change is simple enough and documents the config properly.
        Hide
        Robert Joseph Evans added a comment -

        Thanks Devaraj, I put this into trunk, branch-2, and branch-0.23

        Show
        Robert Joseph Evans added a comment - Thanks Devaraj, I put this into trunk, branch-2, and branch-0.23
        Robert Joseph Evans made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Assignee Devaraj K [ devaraj.k ]
        Fix Version/s 0.23.3 [ 12320060 ]
        Fix Version/s 2.0.0 [ 12320354 ]
        Fix Version/s 3.0.0 [ 12320355 ]
        Resolution Fixed [ 1 ]
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #2185 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2185/)
        MAPREDUCE-3947. yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328111)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328111
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #2185 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2185/ ) MAPREDUCE-3947 . yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328111) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328111 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #2111 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2111/)
        MAPREDUCE-3947. yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328111)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328111
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #2111 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2111/ ) MAPREDUCE-3947 . yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328111) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328111 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #2128 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2128/)
        MAPREDUCE-3947. yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328111)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328111
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #2128 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2128/ ) MAPREDUCE-3947 . yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328111) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328111 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Hide
        Harsh J added a comment -

        Robert - Agreed. Thanks for pushing this in. I'll also work on MAPREDUCE-4026 shortly.

        Show
        Harsh J added a comment - Robert - Agreed. Thanks for pushing this in. I'll also work on MAPREDUCE-4026 shortly.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #233 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/233/)
        svn merge -c 1328111, FIXES: MAPREDUCE-3947. yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328113)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328113
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #233 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/233/ ) svn merge -c 1328111, FIXES: MAPREDUCE-3947 . yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328113) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328113 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #1020 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1020/)
        MAPREDUCE-3947. yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328111)

        Result = FAILURE
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328111
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1020 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1020/ ) MAPREDUCE-3947 . yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328111) Result = FAILURE bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328111 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #1055 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1055/)
        MAPREDUCE-3947. yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328111)

        Result = FAILURE
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328111
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1055 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1055/ ) MAPREDUCE-3947 . yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby) (Revision 1328111) Result = FAILURE bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1328111 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Arun C Murthy made changes -
        Fix Version/s 2.0.2-alpha [ 12322471 ]
        Fix Version/s 2.0.0-alpha [ 12320354 ]
        Fix Version/s 3.0.0 [ 12320355 ]

          People

          • Assignee:
            Devaraj K
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development