Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2978

JobHistory log format for COUNTER is ambigurous

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.16.0
    • 0.16.2
    • None
    • None

    Description

      For the lines like:

      Job JOBID="job_200803072233_0001" FINISH_TIME="1204929332820" JOB_STATUS="SUCCESS" FINISHED_MAPS="24" FINISHED_REDUCES="15" FAILED_MAPS="0" FAILED_REDUCES="0" COUNTERS="Job Counters .Launched map tasks=24,Job Counters .Launched reduce tasks=15Map-Reduce Framework.Map input records=2894276,Map-Reduce Framework.Map output records=2894276,Map-Reduce Framework.Map input bytes=3227015845,Map-Reduce Framework.Map output bytes=3232268034,Map-Reduce Framework.Combine input records=0,Map-Reduce Framework.Combine output records=0,Map-Reduce Framework.Reduce input groups=2526981,Map-Reduce Framework.Reduce input records=2894276,Map-Reduce Framework.Reduce output records=2894276"

      The extracted value for COUNTERS is

      Job Counters .Launched map tasks

      which is clearly wrong.

      Attachments

        1. patch.2978.txt
          0.5 kB
          Runping Qi

        Activity

          People

            runping Runping Qi
            runping Runping Qi
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: