Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1160

Two log statements at INFO level fill up jobtracker logs

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.1, 0.20.2, 0.20.3
    • Fix Version/s: 0.21.0
    • Component/s: jobtracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Changed some log statements that were filling up jobtracker logs to debug level.

      Description

      There are two log statements being logged at an INFO level that are unnecessarily filling up JT logs. This is making it difficult to debug issues on large cluster systems.

      The two statements identified are the following:

      INFO org.apache.hadoop.mapred.JobInProgress: No reduces to schedule for <jobid>
      and
      INFO org.apache.hadoop.mapred.ResourceEstimator: completedMapsUpdates:22 completedMapsInputSize:656 completedMapsOutputSize:6299

      1. MAPREDUCE-1160-20.patch
        2 kB
        Hemanth Yamijala
      2. MR-1160-2.patch
        2 kB
        Hong Tang
      3. MR-1160.patch
        2 kB
        Ravi Gummadi

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Ravi Gummadi
            Reporter:
            Hemanth Yamijala
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development