[SAMZA-544] TestSamzaContainerPerformance throws OOM occasionally

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.0
• Component/s: test
• Assignee: Chris Riccomini
• Reporter: Yan Fang
• Created: 30/Jan/15 19:29
• Updated: 26/Feb/15 21:51
• Resolved: 26/Feb/15 00:41

Description

Occasionally, can see the OOM error from TestSamzaContainerPerformance. Doubt it is because we decreased the memory in SAMZA-426. Log is following.

11:22:14.338 [DEBUG] [TestEventLogger]     2152 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Starting consumer multiplexer.
11:23:57.797 [ERROR] [system.err] 
11:23:57.798 [ERROR] [system.err] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "MockSystemConsumer-7"
11:24:47.237 [DEBUG] [TestEventLogger]     155714 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Shutting down.
11:24:47.237 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-6" java.lang.OutOfMemoryError: Java heap space
11:24:47.238 [DEBUG] [TestEventLogger]     	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:335)
11:24:47.238 [DEBUG] [TestEventLogger]     	at org.apache.samza.util.BlockingEnvelopeMap.put(BlockingEnvelopeMap.java:168)
11:24:47.238 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer.access$200(MockSystemConsumer.java:43)
11:24:47.238 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
11:24:47.238 [DEBUG] [TestEventLogger]     	at java.lang.Thread.run(Thread.java:745)
11:24:47.239 [DEBUG] [TestEventLogger]     155714 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Shutting down consumer multiplexer.
11:24:47.239 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-2" java.lang.OutOfMemoryError: Java heap space
11:24:47.239 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
11:24:47.239 [DEBUG] [TestEventLogger]     	at java.lang.Thread.run(Thread.java:745)
11:24:47.240 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-3" java.lang.OutOfMemoryError: Java heap space
11:24:47.240 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-9" java.lang.OutOfMemoryError: Java heap space
11:24:47.240 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
11:24:47.240 [DEBUG] [TestEventLogger]     	at java.lang.Thread.run(Thread.java:745)
11:24:47.240 [DEBUG] [TestEventLogger] 
11:24:47.240 [DEBUG] [TestEventLogger] org.apache.samza.test.performance.TestSamzaContainerPerformance > testContainerPerformance STANDARD_OUT
11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
11:24:47.242 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
11:24:47.242 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
11:24:47.242 [DEBUG] [TestEventLogger] 
11:24:47.242 [DEBUG] [TestEventLogger] org.apache.samza.test.performance.TestSamzaContainerPerformance > testContainerPerformance STANDARD_ERROR

Issue Links

• relates to: SAMZA-578 Validate SamzaContainer performance