Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5392

"mapred job -history all" command throws IndexOutOfBoundsException

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0.5-alpha, 2.2.0, 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: mrv2
    • Labels:
    • Target Version/s:

      Description

      When I use an "all" option by "mapred job -history" comamnd, the following exceptions are displayed and do not work.

      Exception in thread "main" java.lang.StringIndexOutOfBoundsException: String index out of range: -3
              at java.lang.String.substring(String.java:1875)
              at org.apache.hadoop.mapreduce.util.HostUtil.convertTrackerNameToHostName(HostUtil.java:49)
              at org.apache.hadoop.mapreduce.jobhistory.HistoryViewer.getTaskLogsUrl(HistoryViewer.java:459)
              at org.apache.hadoop.mapreduce.jobhistory.HistoryViewer.printAllTaskAttempts(HistoryViewer.java:235)
              at org.apache.hadoop.mapreduce.jobhistory.HistoryViewer.print(HistoryViewer.java:117)
              at org.apache.hadoop.mapreduce.tools.CLI.viewHistory(CLI.java:472)
              at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:313)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
              at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1233)
      

      This is because a node name recorded in History file is not given "tracker_". Therefore it makes modifications to be able to read History file even if a node name is not given by "tracker_".
      In addition, it fixes the URL of displayed task log.

        Attachments

        1. MAPREDUCE-5392.patch
          3 kB
          Shinichi Yamashita
        2. MAPREDUCE-5392.patch
          4 kB
          Shinichi Yamashita
        3. MAPREDUCE-5392.patch
          5 kB
          Shinichi Yamashita
        4. MAPREDUCE-5392.patch
          5 kB
          Shinichi Yamashita
        5. MAPREDUCE-5392.patch
          7 kB
          Shinichi Yamashita
        6. MAPREDUCE-5392.patch
          7 kB
          Shinichi Yamashita
        7. MAPREDUCE-5392.patch
          23 kB
          Shinichi Yamashita
        8. MAPREDUCE-5392.patch
          23 kB
          Shinichi Yamashita
        9. MAPREDUCE-5392.patch
          23 kB
          Shinichi Yamashita
        10. MAPREDUCE-5392.2.patch
          24 kB
          Akira Ajisaka
        11. MAPREDUCE-5392.3.patch
          6 kB
          Akira Ajisaka
        12. MAPREDUCE-5392.4.patch
          24 kB
          Akira Ajisaka
        13. MAPREDUCE-5392.5.patch
          24 kB
          Akira Ajisaka

          Activity

            People

            • Assignee:
              sinchii Shinichi Yamashita
              Reporter:
              sinchii Shinichi Yamashita
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated: