Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4017

Add jobname to jobsummary log

    XMLWordPrintableJSON

Details

    • The Job Summary log may contain commas in values that are escaped by a '\' character. This was true before, but is more likely to be exposed now.

    Description

      We occasionally use jobsummary from the JobTracker to collect users' slot usage on our clusters. It would be useful if the jobname was part of this jobsummary so that I don't need to join with other logs.

      Same jobsummary.
      2012-03-15 16:05:55,919 INFO mapred.JobInProgress$JobSummary: jobId=job_201202160624_1089972,submitTime=1331827523632,launchTime=1331827528197,firstMapTaskLaunchTime=1331827536917,firstReduceTaskLaunchTime=1331827541251,firstJobSetupTaskLaunchTime=1331827528200,firstJobCleanupTaskLaunchTime=1331827551655,finishTime=1331827555919,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=tortuga,queue=queue1,status=SUCCEEDED,mapSlotSeconds=13,reduceSlotsSeconds=10,clusterMapCapacity=___,clusterReduceCapacity=___

      I'd like to see "jobName" added to the end.

      Attachments

        1. MAPREDUCE-4017-v0.20-1.patch
          0.7 kB
          Koji Noguchi
        2. MAPREDUCE-4017.patch
          3 kB
          Thomas Graves

        Activity

          People

            tgraves Thomas Graves
            knoguchi Koji Noguchi
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: