Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3918

proc_historyserver no longer in command line arguments for HistoryServer

        Details

        • Type: Bug Bug
        • Status: Resolved
        • Priority: Major Major
        • Resolution: Fixed
        • Affects Version/s: 0.23.1
        • Fix Version/s: 0.23.2
        • Component/s: mrv2
        • Labels:
          None

          Description

          This java arg is missing from the command line and needs to be replaced

          1. Text File
            MAPREDUCE-3918.patch
            0.4 kB
            Jonathan Eagles
          2. Text File
            MAPREDUCE-3918.patch
            0.5 kB
            Jonathan Eagles

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            Robert Joseph Evans added a comment -

            Two things. mapred in the past did not echo its command before running, neither does hdfs, only yarn seems to. I would prefer to see this removed.

            Also I see that we tag all other commands with this -Dproc_ also. But I could not find any documentation on why, and no use of these values in the code. Is this for monitoring or something?

            Show
            Robert Joseph Evans added a comment - Two things. mapred in the past did not echo its command before running, neither does hdfs, only yarn seems to. I would prefer to see this removed. Also I see that we tag all other commands with this -Dproc_ also. But I could not find any documentation on why, and no use of these values in the code. Is this for monitoring or something?
            Hide
            Permalink
            Hadoop QA added a comment -

            -1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12515967/MAPREDUCE-3918.patch
            against trunk revision .

            +1 @author. The patch does not contain any @author tags.

            -1 tests included. The patch doesn't appear to include any new or modified tests.
            Please justify why no new tests are needed for this patch.
            Also please list what manual steps were performed to verify this patch.

            +1 javadoc. The javadoc tool did not generate any warning messages.

            +1 javac. The applied patch does not increase the total number of javac compiler warnings.

            +1 eclipse:eclipse. The patch built with eclipse:eclipse.

            +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

            +1 release audit. The applied patch does not increase the total number of release audit warnings.

            +1 core tests. The patch passed unit tests in .

            +1 contrib tests. The patch passed contrib unit tests.

            Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1927//testReport/
            Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1927//console

            This message is automatically generated.

            Show
            Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12515967/MAPREDUCE-3918.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1927//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1927//console This message is automatically generated.
            Hide
            Permalink
            Jonathan Eagles added a comment -

            No tests required for this script change.

            In the past, the -Dproc_historyserver was the first argument on the
            command line for monitoring purposes. This allows quick and easy determination of what processes are running using ps on the command line.

            Show
            Jonathan Eagles added a comment - No tests required for this script change. In the past, the -Dproc_historyserver was the first argument on the command line for monitoring purposes. This allows quick and easy determination of what processes are running using ps on the command line.
            Hide
            Permalink
            Jonathan Eagles added a comment -

            Uploading patch reflecting the intent of MAPREDUCE-3866

            Show
            Jonathan Eagles added a comment - Uploading patch reflecting the intent of MAPREDUCE-3866
            Hide
            Permalink
            Jonathan Eagles added a comment -

            Patch also addresses Bobby's comment

            Show
            Jonathan Eagles added a comment - Patch also addresses Bobby's comment
            Hide
            Permalink
            Robert Joseph Evans added a comment -

            +1 I just commited this to trunk and branch-0.23

            Show
            Robert Joseph Evans added a comment - +1 I just commited this to trunk and branch-0.23
            Hide
            Permalink
            Jonathan Eagles added a comment -

            Thanks bobby.

            Show
            Jonathan Eagles added a comment - Thanks bobby.
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Hadoop-Common-0.23-Commit #590 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/590/)
            svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470)

            Result = SUCCESS
            bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470
            Files :

            • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
            • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
            Show
            Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #590 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/590/ ) svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Hadoop-Hdfs-trunk-Commit #1850 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1850/)
            MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469)

            Result = SUCCESS
            bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469
            Files :

            • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
            • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
            Show
            Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1850 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1850/ ) MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Hadoop-Common-trunk-Commit #1776 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1776/)
            MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469)

            Result = SUCCESS
            bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469
            Files :

            • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
            • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
            Show
            Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1776 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1776/ ) MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Hadoop-Hdfs-0.23-Commit #578 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/578/)
            svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470)

            Result = SUCCESS
            bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470
            Files :

            • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
            • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
            Show
            Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #578 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/578/ ) svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Hadoop-Mapreduce-trunk-Commit #1787 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1787/)
            MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469)

            Result = ABORTED
            bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469
            Files :

            • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
            • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
            Show
            Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1787 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1787/ ) MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469) Result = ABORTED bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Hadoop-Mapreduce-0.23-Commit #593 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/593/)
            svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470)

            Result = ABORTED
            bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470
            Files :

            • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
            • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
            Show
            Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #593 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/593/ ) svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470) Result = ABORTED bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Hadoop-Hdfs-trunk #966 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/966/)
            MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469)

            Result = FAILURE
            bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469
            Files :

            • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
            • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
            Show
            Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #966 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/966/ ) MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469) Result = FAILURE bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Hadoop-Hdfs-0.23-Build #179 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/179/)
            svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470)

            Result = SUCCESS
            bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470
            Files :

            • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
            • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
            Show
            Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #179 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/179/ ) svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Hadoop-Mapreduce-0.23-Build #207 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/207/)
            svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470)

            Result = FAILURE
            bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470
            Files :

            • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
            • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
            Show
            Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #207 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/207/ ) svn merge -c 1293469 trunk ot branch-0.23 FIXES MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293470) Result = FAILURE bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293470 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/bin/mapred
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Hadoop-Mapreduce-trunk #1001 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1001/)
            MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469)

            Result = SUCCESS
            bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469
            Files :

            • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
            • /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred
            Show
            Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1001 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1001/ ) MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby) (Revision 1293469) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293469 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/bin/mapred

              People

              • Assignee:
                Jonathan Eagles
                Reporter:
                Jonathan Eagles
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Development