Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1160

Two log statements at INFO level fill up jobtracker logs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20.1, 0.20.2, 0.20.3
    • 0.21.0
    • jobtracker
    • None
    • Reviewed
    • Changed some log statements that were filling up jobtracker logs to debug level.

    Description

      There are two log statements being logged at an INFO level that are unnecessarily filling up JT logs. This is making it difficult to debug issues on large cluster systems.

      The two statements identified are the following:

      INFO org.apache.hadoop.mapred.JobInProgress: No reduces to schedule for <jobid>
      and
      INFO org.apache.hadoop.mapred.ResourceEstimator: completedMapsUpdates:22 completedMapsInputSize:656 completedMapsOutputSize:6299

      Attachments

        1. MAPREDUCE-1160-20.patch
          2 kB
          Hemanth Yamijala
        2. MR-1160.patch
          2 kB
          Ravi Gummadi
        3. MR-1160-2.patch
          2 kB
          Hong Tang

        Activity

          People

            ravidotg Ravi Gummadi
            yhemanth Hemanth Yamijala
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: