Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2078

TraceBuilder unable to generate the traces while giving the job history path by globing.

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.22.0
    • Component/s: tools/rumen
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I was trying to generate the traces for MR job histories by using TraceBuilder. However, it's unable to generate the traces while giving the job history path by globing. It throws a file not found exception even though the job history path is exists.

      I have provide the job history path in the below way.

      hdfs://<<clustername>>/dir1/dir2/dir3///////

      Exception:

      java.io.FileNotFoundException: File does not exist:
      hdfs://<<clustername>>/dir1/dir2/dir3//////
      at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:525)
      at org.apache.hadoop.tools.rumen.TraceBuilder$MyOptions.<init>(TraceBuilder.java:88)
      at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:183)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
      at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:121)

      It's truncating the last slash in the path.

      1. mapreduce-2078-v1.5.patch
        5 kB
        Amar Kamat
      2. mapreduce-2078-v1.2.patch
        5 kB
        Amar Kamat

        Activity

        Konstantin Shvachko made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Amareshwari Sriramadasu made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.22.0 [ 12314184 ]
        Resolution Fixed [ 1 ]
        Amar Kamat made changes -
        Attachment mapreduce-2078-v1.5.patch [ 12455123 ]
        Amar Kamat made changes -
        Field Original Value New Value
        Attachment mapreduce-2078-v1.2.patch [ 12455020 ]
        Vinay Kumar Thota created issue -

          People

          • Assignee:
            Amar Kamat
            Reporter:
            Vinay Kumar Thota
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development