Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3346

Rumen LoggedTaskAttempt getHostName call returns hostname as null

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: tools/rumen
    • Labels:
      None

      Description

      After MAPREDUCE-3035 and MAPREDUCE-3317
      Now MRV2 job history contains hostName and rackName.
      when rumen trace builder is ran on jobhistory, its generated trace contains hostname in form of
      hostName : /raclname/hostname

      But getHostName for LoggedTaskAttempt returns hostname as null
      Seems that TraceBuilder is setting hostName properly but JobTraceReader is not able read it.

        Activity

        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Vinod Kumar Vavilapalli made changes -
        Fix Version/s 0.24.0 [ 12317654 ]
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #70 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/70/)
        MAPREDUCE-3346. [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199106
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #70 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/70/ ) MAPREDUCE-3346 . [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199106 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #84 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/84/)
        MAPREDUCE-3346. [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199106
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #84 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/84/ ) MAPREDUCE-3346 . [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199106 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #165 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/165/)
        MAPREDUCE-3346. [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199106
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #165 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/165/ ) MAPREDUCE-3346 . [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199106 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #154 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/154/)
        MAPREDUCE-3346. [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199106
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #154 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/154/ ) MAPREDUCE-3346 . [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199106 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #153 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/153/)
        MAPREDUCE-3346. [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199106
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #153 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/153/ ) MAPREDUCE-3346 . [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199106 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/LoggedTaskAttempt.java
        Amar Kamat made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Target Version/s 0.24.0, 0.23.1 [ 12317654, 12318883 ]
        Fix Version/s 0.24.0 [ 12317654 ]
        Fix Version/s 0.23.1 [ 12318883 ]
        Resolution Fixed [ 1 ]
        Tags rumen hostname
        Hide
        Amar Kamat added a comment -

        I just committed this to trunk and branch-0.23. Thanks Karam!

        Show
        Amar Kamat added a comment - I just committed this to trunk and branch-0.23. Thanks Karam!
        Amar Kamat made changes -
        Attachment MAPREDUCE-3346-v1.1.patch [ 12502881 ]
        Amar Kamat made changes -
        Attachment BZ-4980655-v1.1.patch [ 12502389 ]
        Hide
        Amar Kamat added a comment -

        The corner case should be fixed in MAPREDUCE-1976. I will commit this patch.

        Show
        Amar Kamat added a comment - The corner case should be fixed in MAPREDUCE-1976 . I will commit this patch.
        Hide
        Karam Singh added a comment -

        tested the Patch metioned by Amar
        Corner case of unsuccessful tasks still exists. But that is not blocker.

        Show
        Karam Singh added a comment - tested the Patch metioned by Amar Corner case of unsuccessful tasks still exists. But that is not blocker.
        Amar Kamat made changes -
        Attachment BZ-4980655-v1.1.patch [ 12502389 ]
        Hide
        Amar Kamat added a comment -

        Attaching a patch that fixes this issue. This patch restores the previously removed setHostName(String) API. This API is used by 1) setHostName(String, String) when rackname is missing and 2) Jackson

        Karam, can you test this patch and comment?

        Show
        Amar Kamat added a comment - Attaching a patch that fixes this issue. This patch restores the previously removed setHostName(String) API. This API is used by 1) setHostName(String, String) when rackname is missing and 2) Jackson Karam, can you test this patch and comment?
        Amar Kamat made changes -
        Field Original Value New Value
        Assignee Amar Kamat [ amar_kamat ]
        Karam Singh created issue -

          People

          • Assignee:
            Amar Kamat
            Reporter:
            Karam Singh
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development