Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3241

(Rumen)TraceBuilder throws IllegalArgumentException

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 0.23.0
    • Component/s: None
    • Labels:
      None
    • Release Note:
      Rumen is fixed to ignore the AMRestartedEvent.

      Description

      When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.

      2011-10-21 22:07:17,268 WARN  rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
      java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
              at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
              at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
              at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
              at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
              at java.lang.reflect.Method.invoke(Method.java:597)
              at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
      
      

        Activity

        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #884 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/884/)
        MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #884 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/884/ ) MAPREDUCE-3241 . [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #850 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/850/)
        MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #850 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/850/ ) MAPREDUCE-3241 . [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #58 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/58/)
        MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #58 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/58/ ) MAPREDUCE-3241 . [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #57 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/57/)
        MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #57 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/57/ ) MAPREDUCE-3241 . [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #122 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/122/)
        MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #122 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/122/ ) MAPREDUCE-3241 . [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Hide
        Amar Kamat added a comment -

        Need in branch-0.23 too?

        Already committed to branch 0.23.

        Show
        Amar Kamat added a comment - Need in branch-0.23 too? Already committed to branch 0.23.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1231 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1231/)
        MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1231 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1231/ ) MAPREDUCE-3241 . [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #113 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/113/)
        MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #113 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/113/ ) MAPREDUCE-3241 . [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #114 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/114/)
        MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #114 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/114/ ) MAPREDUCE-3241 . [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Hide
        Vinod Kumar Vavilapalli added a comment -

        I just committed the attached patch to trunk.

        Need in branch-0.23 too?

        Show
        Vinod Kumar Vavilapalli added a comment - I just committed the attached patch to trunk. Need in branch-0.23 too?
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1281 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1281/)
        MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1281 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1281/ ) MAPREDUCE-3241 . [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1205 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1205/)
        MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)

        amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1205 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1205/ ) MAPREDUCE-3241 . [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
        Hide
        Amar Kamat added a comment -

        I just committed the attached patch to trunk.

        Show
        Amar Kamat added a comment - I just committed the attached patch to trunk.
        Hide
        Siddharth Seth added a comment -

        Tried the patch - TraceBuilder works with it applied. Looks good, with a follow up jira to handle the AMStarted event.

        Show
        Siddharth Seth added a comment - Tried the patch - TraceBuilder works with it applied. Looks good, with a follow up jira to handle the AMStarted event.
        Hide
        Amar Kamat added a comment -

        Attaching a patch which ignores the AMStart event.

        Show
        Amar Kamat added a comment - Attaching a patch which ignores the AMStart event.
        Hide
        Amar Kamat added a comment -

        Thanks for the explanation Devaraj. I am not sure why AM related events should surface in a MapReduce job's history. Requesting Ravi to look into this.

        Show
        Amar Kamat added a comment - Thanks for the explanation Devaraj. I am not sure why AM related events should surface in a MapReduce job's history. Requesting Ravi to look into this.
        Hide
        Devaraj K added a comment -

        It is reproducible with the latest trunk code. You can run the below command using the latest job history file.

        ./yarn jar hadoop-mapreduce-tools-0.24.0-SNAPSHOT.jar org.apache.hadoop.tools.rumen.TraceBuilder 
                -recursive <jobtrace-output> <topology-output> <inputs>
        

        Recently AM_STARTED event record has added in the history file, but it is not handled in the rumen.

        JobBuilder.java
         public void process(HistoryEvent event) {
           .......
           .......
            } else if (event instanceof TaskUpdatedEvent) {
              processTaskUpdatedEvent((TaskUpdatedEvent) event);
            } else
              throw new IllegalArgumentException(
                  "JobBuilder.process(HistoryEvent): unknown event type");
          }
          

        Here for AM_STARTED record, AMStartedEvent is not able to parse and throwing the IllegalArgumentException.

        Show
        Devaraj K added a comment - It is reproducible with the latest trunk code. You can run the below command using the latest job history file. ./yarn jar hadoop-mapreduce-tools-0.24.0-SNAPSHOT.jar org.apache.hadoop.tools.rumen.TraceBuilder -recursive <jobtrace-output> <topology-output> <inputs> Recently AM_STARTED event record has added in the history file, but it is not handled in the rumen. JobBuilder.java public void process(HistoryEvent event) { ....... ....... } else if (event instanceof TaskUpdatedEvent) { processTaskUpdatedEvent((TaskUpdatedEvent) event); } else throw new IllegalArgumentException( "JobBuilder.process(HistoryEvent): unknown event type" ); } Here for AM_STARTED record, AMStartedEvent is not able to parse and throwing the IllegalArgumentException.
        Hide
        Amar Kamat added a comment -

        Devaraj,
        Can you tell us how to reproduce this issue? What is the version of the JobHistory files?

        Show
        Amar Kamat added a comment - Devaraj, Can you tell us how to reproduce this issue? What is the version of the JobHistory files?

          People

          • Assignee:
            Amar Kamat
            Reporter:
            Devaraj K
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development