Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: contrib/streaming, mrv2
    • Labels:
      None

      Description

      The tracking URL for streaming jobs currently display "http://N/A"

      INFO streaming.StreamJob: To kill this job, run:
      INFO streaming.StreamJob: hadoop job -kill <jobID>
      INFO streaming.StreamJob: Tracking URL: http://N/A
      INFO mapreduce.Job: Running job: <jobID>
      INFO mapreduce.Job:  map 0% reduce 0%
      INFO mapred.ClientServiceDelegate: Tracking Url of JOB is <host:port>
      
      
      1. MAPREDUCE-3243.patch
        1 kB
        Jonathan Eagles

        Activity

        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #898 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/898/)
        MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201951
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #898 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/898/ ) MAPREDUCE-3243 . Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201951 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #94 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/94/)
        MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) - Merging r1201951 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201952
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #94 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/94/ ) MAPREDUCE-3243 . Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) - Merging r1201951 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201952 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #77 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/77/)
        MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) - Merging r1201951 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201952
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #77 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/77/ ) MAPREDUCE-3243 . Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) - Merging r1201951 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201952 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #864 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/864/)
        MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201951
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #864 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/864/ ) MAPREDUCE-3243 . Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201951 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Hide
        Jonathan Eagles added a comment -

        Thanks, Mahadev and Vinod for taking a look.

        Show
        Jonathan Eagles added a comment - Thanks, Mahadev and Vinod for taking a look.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1293 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1293/)
        MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201951
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1293 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1293/ ) MAPREDUCE-3243 . Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201951 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #181 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/181/)
        MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) - Merging r1201951 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201952
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #181 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/181/ ) MAPREDUCE-3243 . Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) - Merging r1201951 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201952 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1271 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1271/)
        MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201951
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1271 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1271/ ) MAPREDUCE-3243 . Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201951 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1345 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1345/)
        MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201951
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1345 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1345/ ) MAPREDUCE-3243 . Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201951 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #170 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/170/)
        MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) - Merging r1201951 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201952
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #170 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/170/ ) MAPREDUCE-3243 . Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) - Merging r1201951 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201952 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #169 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/169/)
        MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) - Merging r1201951 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201952
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #169 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/169/ ) MAPREDUCE-3243 . Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) - Merging r1201951 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201952 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamJob.java
        Hide
        Mahadev konar added a comment -

        Just committed this. Thanks Jonathan.

        Show
        Mahadev konar added a comment - Just committed this. Thanks Jonathan.
        Hide
        Jonathan Eagles added a comment -

        Vinod, I also thought that at first. This job, however, prints the tracking url to the console itself, which has been made redundant now that the client service delegate prints the tracking url as well. I have then made this bug to remove the tracking url printing in the job, leaving that responsibility to the client service delegate. While remove that print statement, I also removed the printing of how to kill this job since that is no longer correct.

        Show
        Jonathan Eagles added a comment - Vinod, I also thought that at first. This job, however, prints the tracking url to the console itself, which has been made redundant now that the client service delegate prints the tracking url as well. I have then made this bug to remove the tracking url printing in the job, leaving that responsibility to the client service delegate. While remove that print statement, I also removed the printing of how to kill this job since that is no longer correct.
        Hide
        Vinod Kumar Vavilapalli added a comment -

        Jonathan, will this be a dup if we go the route of MAPREDUCE-3387? Essentially, we will never return N/A and instead return the URL of the proxy for that application.

        Show
        Vinod Kumar Vavilapalli added a comment - Jonathan, will this be a dup if we go the route of MAPREDUCE-3387 ? Essentially, we will never return N/A and instead return the URL of the proxy for that application.
        Hide
        Jonathan Eagles added a comment -

        No tests are needed due to only changing logging to the console.

        Show
        Jonathan Eagles added a comment - No tests are needed due to only changing logging to the console.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12503301/MAPREDUCE-3243.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1292//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1292//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12503301/MAPREDUCE-3243.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1292//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1292//console This message is automatically generated.
        Hide
        Jonathan Eagles added a comment -

        Tracking URLs aren't available at the time of request since there is a delay between job submission and container assignment. Rather than poll for container assignment, handling numerous error conditions, I have opted to just remove this redundant information as well as the no long valid method killing the job.

        Show
        Jonathan Eagles added a comment - Tracking URLs aren't available at the time of request since there is a delay between job submission and container assignment. Rather than poll for container assignment, handling numerous error conditions, I have opted to just remove this redundant information as well as the no long valid method killing the job.

          People

          • Assignee:
            Jonathan Eagles
            Reporter:
            Ramya Sunil
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development