[MAPREDUCE-1160] Two log statements at INFO level fill up jobtracker logs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.1, 0.20.2, 0.20.3
• Fix Version/s: 0.21.0
• Component/s: jobtracker
• Hadoop Flags: Reviewed
• Release Note: Changed some log statements that were filling up jobtracker logs to debug level.
• Assignee: Ravi Gummadi
• Reporter: Hemanth Yamijala
• Created: 28/Oct/09 08:51
• Updated: 24/Aug/10 21:19
• Resolved: 29/Oct/09 03:52

Description

There are two log statements being logged at an INFO level that are unnecessarily filling up JT logs. This is making it difficult to debug issues on large cluster systems.

The two statements identified are the following:

INFO org.apache.hadoop.mapred.JobInProgress: No reduces to schedule for <jobid>
and
INFO org.apache.hadoop.mapred.ResourceEstimator: completedMapsUpdates:22 completedMapsInputSize:656 completedMapsOutputSize:6299