[MAPREDUCE-4308] Remove excessive split log messages

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.0.3
• Component/s: jobtracker
• Labels: BB2015-05-TBR
• Assignee: Unassigned
• Reporter: Kihwal Lee
• Created: 04/Jun/12 16:48
• Updated: 06/May/15 03:31

Description

Job tracker currently prints out information on every split.

2012-05-20 00:06:01,985 INFO org.apache.hadoop.mapred.JobInProgress: 
tip:task_201205100740_1745_m_000000 has split on node:/192.168.0.1
/my.totally.madeup.host.com

I looked at one cluster and these messages were taking up more than 30% of the JT log. If jobs have large number of maps, it can be worse. I think it is reasonable to lower the log level of the statement from INFO to DEBUG.