Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1160

Two log statements at INFO level fill up jobtracker logs

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.1, 0.20.2, 0.20.3
    • Fix Version/s: 0.21.0
    • Component/s: jobtracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Changed some log statements that were filling up jobtracker logs to debug level.

      Description

      There are two log statements being logged at an INFO level that are unnecessarily filling up JT logs. This is making it difficult to debug issues on large cluster systems.

      The two statements identified are the following:

      INFO org.apache.hadoop.mapred.JobInProgress: No reduces to schedule for <jobid>
      and
      INFO org.apache.hadoop.mapred.ResourceEstimator: completedMapsUpdates:22 completedMapsInputSize:656 completedMapsOutputSize:6299

      1. MAPREDUCE-1160-20.patch
        2 kB
        Hemanth Yamijala
      2. MR-1160-2.patch
        2 kB
        Hong Tang
      3. MR-1160.patch
        2 kB
        Ravi Gummadi

        Activity

        Hemanth Yamijala created issue -
        Ravi Gummadi made changes -
        Field Original Value New Value
        Attachment MR-1160.patch [ 12423427 ]
        Ravi Gummadi made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Release Note Changed some log statements that were filling up jobtracker logs to debug level.
        Hong Tang made changes -
        Attachment MR-1160-2.patch [ 12423467 ]
        Hemanth Yamijala made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Hemanth Yamijala made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hemanth Yamijala made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.22.0 [ 12314184 ]
        Resolution Fixed [ 1 ]
        Hemanth Yamijala made changes -
        Attachment MAPREDUCE-1160-20.patch [ 12423534 ]
        Allen Wittenauer made changes -
        Affects Version/s 0.20.2 [ 12314205 ]
        Affects Version/s 0.20.1 [ 12314047 ]
        Affects Version/s 0.20.3 [ 12314813 ]
        Tom White made changes -
        Fix Version/s 0.21.0 [ 12314045 ]
        Fix Version/s 0.22.0 [ 12314184 ]
        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Ravi Gummadi
            Reporter:
            Hemanth Yamijala
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development