Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3918

proc_historyserver no longer in command line arguments for HistoryServer

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.1
    • Fix Version/s: 0.23.2
    • Component/s: mrv2
    • Labels:
      None

      Description

      This java arg is missing from the command line and needs to be replaced

      1. MAPREDUCE-3918.patch
        0.4 kB
        Jonathan Eagles
      2. MAPREDUCE-3918.patch
        0.5 kB
        Jonathan Eagles

        Activity

        Hide
        Robert Joseph Evans added a comment -

        Two things. mapred in the past did not echo its command before running, neither does hdfs, only yarn seems to. I would prefer to see this removed.

        Also I see that we tag all other commands with this -Dproc_ also. But I could not find any documentation on why, and no use of these values in the code. Is this for monitoring or something?

        Show
        Robert Joseph Evans added a comment - Two things. mapred in the past did not echo its command before running, neither does hdfs, only yarn seems to. I would prefer to see this removed. Also I see that we tag all other commands with this -Dproc_ also. But I could not find any documentation on why, and no use of these values in the code. Is this for monitoring or something?
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12515967/MAPREDUCE-3918.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1927//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1927//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12515967/MAPREDUCE-3918.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1927//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1927//console This message is automatically generated.
        Hide
        Jonathan Eagles added a comment -

        No tests required for this script change.

        In the past, the -Dproc_historyserver was the first argument on the
        command line for monitoring purposes. This allows quick and easy determination of what processes are running using ps on the command line.

        Show
        Jonathan Eagles added a comment - No tests required for this script change. In the past, the -Dproc_historyserver was the first argument on the command line for monitoring purposes. This allows quick and easy determination of what processes are running using ps on the command line.
        Hide
        Jonathan Eagles added a comment -

        Uploading patch reflecting the intent of MAPREDUCE-3866

        Show
        Jonathan Eagles added a comment - Uploading patch reflecting the intent of MAPREDUCE-3866
        Hide
        Jonathan Eagles added a comment -

        Patch also addresses Bobby's comment

        Show
        Jonathan Eagles added a comment - Patch also addresses Bobby's comment
        Hide
        Robert Joseph Evans added a comment -

        +1 I just commited this to trunk and branch-0.23

        Show
        Robert Joseph Evans added a comment - +1 I just commited this to trunk and branch-0.23
        Hide
        Jonathan Eagles added a comment -

        Thanks bobby.

        Show
        Jonathan Eagles added a comment - Thanks bobby.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #590 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/590/)
        svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #590 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/590/ ) svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1850 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1850/)
        MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1850 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1850/ ) MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1776 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1776/)
        MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1776 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1776/ ) MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #578 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/578/)
        svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #578 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/578/ ) svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1787 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1787/)
        MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469)

        Result = ABORTED
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1787 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1787/ ) MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469) Result = ABORTED bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #593 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/593/)
        svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470)

        Result = ABORTED
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #593 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/593/ ) svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470) Result = ABORTED bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #966 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/966/)
        MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469)

        Result = FAILURE
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #966 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/966/ ) MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469) Result = FAILURE bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #179 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/179/)
        svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #179 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/179/ ) svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #207 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/207/)
        svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470)

        Result = FAILURE
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #207 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/207/ ) svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470) Result = FAILURE bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #1001 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1001/)
        MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1001 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1001/ ) MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred

          People

          • Assignee:
            Jonathan Eagles
            Reporter:
            Jonathan Eagles
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development