[HIVE-11841] KeyValuesInputMerger creates huge logs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.0, 1.0.0, 1.0.1, 1.2.1, 1.3.0, 2.0.0
• Fix Version/s: 1.1.2, 1.2.2, 1.3.0, 2.0.0
• Component/s: Logging
• Assignee: Rajesh Balamohan
• Reporter: Rajesh Balamohan
• Created: 16/Sep/15 14:13
• Updated: 16/Feb/16 23:53
• Resolved: 18/Sep/15 18:27

Description

https://github.com/apache/hive/blob/ac755ebe26361a4647d53db2a28500f71697b276/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/tools/KeyValuesInputMerger.java#L107

When running tpc-ds q75 at relatively large scale, it ends up generating huge logs due to this.

Log Type: syslog_attempt_1439860407967_1249_1_30_000000_0
Log Upload Time: Wed Sep 16 12:49:09 +0000 2015
Log Length: 3992760053
Showing 4096 bytes of 3992760053 total. Click here for the full log.