Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5805

Unable to parse launch time from job history file

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.4.0
    • Component/s: jobhistoryserver
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      when job complete, there are WARN complains in the log:

      2014-03-19 13:31:10,036 WARN org.apache.hadoop.mapreduce.v2.jobhistory.FileNameIndexUtils: Unable to parse launch time from job history file job_1395204058904_0003-1395206473646-root-test_one_word-1395206966214-4-2-SUCCEEDED-root.test-queue-1395206480070.jhist : java.lang.NumberFormatException: For input string: "queue"
      

      because there is in the queue name 'test-queue', we split the job history file name by , and get the ninth item as job start time.
      FileNameIndexUtils.java

      private static final int JOB_START_TIME_INDEX = 9;
      

      but there is another potential issue:
      if I also include '-' in the job name(test_one_world in this case), there are all misunderstand.

        Issue Links

          Activity

          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Gera Shegalov made changes -
          Link This issue breaks MAPREDUCE-5813 [ MAPREDUCE-5813 ]
          Gera Shegalov made changes -
          Link This issue is related to MAPREDUCE-5815 [ MAPREDUCE-5815 ]
          Vinod Kumar Vavilapalli made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.4.0 [ 12326141 ]
          Resolution Fixed [ 1 ]
          Akira AJISAKA made changes -
          Priority Minor [ 4 ] Major [ 3 ]
          Akira AJISAKA made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Target Version/s 2.4.0 [ 12326141 ]
          Akira AJISAKA made changes -
          Attachment MAPREDUCE-5805.patch [ 12635609 ]
          Akira AJISAKA made changes -
          Project Hadoop YARN [ 12313722 ] Hadoop Map/Reduce [ 12310941 ]
          Key YARN-1851 MAPREDUCE-5805
          Affects Version/s 2.3.0 [ 12325257 ]
          Affects Version/s 2.4.0 [ 12326142 ]
          Fix Version/s 2.4.0 [ 12326142 ]
          Component/s jobhistoryserver [ 12315343 ]
          Component/s resourcemanager [ 12319322 ]
          Akira AJISAKA made changes -
          Assignee Akira AJISAKA [ ajisakaa ]
          Fengdong Yu made changes -
          Description when job complete, there are WARN complains in the log:
          {code}
          2014-03-19 13:31:10,036 WARN org.apache.hadoop.mapreduce.v2.jobhistory.FileNameIndexUtils: Unable to parse launch time from job history file job_1395204058904_0003-1395206473646-root-test_one_word-1395206966214-4-2-SUCCEEDED-root.test-queue-1395206480070.jhist : java.lang.NumberFormatException: For input string: "queue"
          {code}

          because there is "-" in the queue name 'test-queue', we split the job history file name by "-", and get the ninth item as job start time.
          FileNameIndexUtils.java
          {code}
          private static final int JOB_START_TIME_INDEX = 9;
          {code}

          but there is another potential issue:
          if I also include '-' in the job name(test_one_world in this case), there are all misunderstand.
          when job complete, there are WARN complains in the log:
          {code}
          2014-03-19 13:31:10,036 WARN org.apache.hadoop.mapreduce.v2.jobhistory.FileNameIndexUtils: Unable to parse launch time from job history file job_1395204058904_0003-1395206473646-root-test_one_word-1395206966214-4-2-SUCCEEDED-root.test-queue-1395206480070.jhist : java.lang.NumberFormatException: For input string: "queue"
          {code}

          because there is (-) in the queue name 'test-queue', we split the job history file name by (-), and get the ninth item as job start time.
          FileNameIndexUtils.java
          {code}
          private static final int JOB_START_TIME_INDEX = 9;
          {code}

          but there is another potential issue:
          if I also include '-' in the job name(test_one_world in this case), there are all misunderstand.
          Fengdong Yu made changes -
          Field Original Value New Value
          Description when job complete, there are WARN complains in the log:
          {code}
          2014-03-19 13:31:10,036 WARN org.apache.hadoop.mapreduce.v2.jobhistory.FileNameIndexUtils: Unable to parse launch time from job history file job_1395204058904_0003-1395206473646-root-test_one_word-1395206966214-4-2-SUCCEEDED-root.test-queue-1395206480070.jhist : java.lang.NumberFormatException: For input string: "queue"
          {code}

          because there is '-' in the queue name 'test-queue', we split the job history file name by '-', and get the ninth item as job start time.
          FileNameIndexUtils.java
          {code}
          private static final int JOB_START_TIME_INDEX = 9;
          {code}

          but there is another potential issue:
          if I also include '-' in the job name(test_one_world in this case), there are all misunderstand.
          when job complete, there are WARN complains in the log:
          {code}
          2014-03-19 13:31:10,036 WARN org.apache.hadoop.mapreduce.v2.jobhistory.FileNameIndexUtils: Unable to parse launch time from job history file job_1395204058904_0003-1395206473646-root-test_one_word-1395206966214-4-2-SUCCEEDED-root.test-queue-1395206480070.jhist : java.lang.NumberFormatException: For input string: "queue"
          {code}

          because there is "-" in the queue name 'test-queue', we split the job history file name by "-", and get the ninth item as job start time.
          FileNameIndexUtils.java
          {code}
          private static final int JOB_START_TIME_INDEX = 9;
          {code}

          but there is another potential issue:
          if I also include '-' in the job name(test_one_world in this case), there are all misunderstand.
          Fengdong Yu created issue -

            People

            • Assignee:
              Akira AJISAKA
              Reporter:
              Fengdong Yu
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development