[HIVE-7924] auto_sortmerge_join_8 sometimes fails with OOM

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Tests
• Assignee: Szehon Ho
• Reporter: Szehon Ho
• Created: 30/Aug/14 19:35
• Updated: 12/Feb/15 23:40
• Resolved: 25/Nov/14 01:59

Description

Saw in some runs of this test, the following in the log:

(MapredLocalTask.java:executeInProcess(321)) - Hive Runtime Error: Map local work exhausted memory
org.apache.hadoop.hive.ql.exec.mapjoin.MapJoinMemoryExhaustionException: 2014-08-29 08:31:56	Processing rows:	4	Hashtable size:	3	Memory usage:	1531884480	percentage:	0.802
	at org.apache.hadoop.hive.ql.exec.mapjoin.MapJoinMemoryExhaustionHandler.checkMemoryStatus(MapJoinMemoryExhaustionHandler.java:91)
	at org.apache.hadoop.hive.ql.exec.HashTableSinkOperator.processOp(HashTableSinkOperator.java:251)
	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)

Issue Links

• relates to: HIVE-7271 Speed up unit tests