[HBASE-11994] PutCombiner floods the M/R log with repeated log messages.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.98.6
• Fix Version/s: 0.98.7, 0.99.1
• Component/s: mapreduce
• Hadoop Flags: Reviewed
• Assignee: Aditya Kishore
• Reporter: Aditya Kishore
• Created: 16/Sep/14 19:03
• Updated: 06/Apr/18 17:55
• Resolved: 16/Sep/14 20:57

Description

o.a.h.h.mapreduce.PutCombiner logs an info message for each row that it receives in its reduce() function, flooding the M/R tasks log.

...............
2014-09-12 12:38:02,907 INFO [MapRSpillThread] org.apache.hadoop.hbase.mapreduce.PutCombiner: Combined 1 Put(s) into 1.
2014-09-12 12:38:02,908 INFO [MapRSpillThread] org.apache.hadoop.hbase.mapreduce.PutCombiner: Combined 1 Put(s) into 1.
...............{repeated 100s of thousand times.}

Issue Links

• is related to: HBASE-8874 PutCombiner is skipping KeyValues while combining puts of same row during bulkload