Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-544

TestSamzaContainerPerformance throws OOM occasionally

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.9.0
    • Component/s: test
    • Labels:
      None

      Description

      Occasionally, can see the OOM error from TestSamzaContainerPerformance. Doubt it is because we decreased the memory in SAMZA-426. Log is following.

      11:22:14.338 [DEBUG] [TestEventLogger]     2152 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Starting consumer multiplexer.
      11:23:57.797 [ERROR] [system.err] 
      11:23:57.798 [ERROR] [system.err] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "MockSystemConsumer-7"
      11:24:47.237 [DEBUG] [TestEventLogger]     155714 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Shutting down.
      11:24:47.237 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-6" java.lang.OutOfMemoryError: Java heap space
      11:24:47.238 [DEBUG] [TestEventLogger]     	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:335)
      11:24:47.238 [DEBUG] [TestEventLogger]     	at org.apache.samza.util.BlockingEnvelopeMap.put(BlockingEnvelopeMap.java:168)
      11:24:47.238 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer.access$200(MockSystemConsumer.java:43)
      11:24:47.238 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
      11:24:47.238 [DEBUG] [TestEventLogger]     	at java.lang.Thread.run(Thread.java:745)
      11:24:47.239 [DEBUG] [TestEventLogger]     155714 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Shutting down consumer multiplexer.
      11:24:47.239 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-2" java.lang.OutOfMemoryError: Java heap space
      11:24:47.239 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
      11:24:47.239 [DEBUG] [TestEventLogger]     	at java.lang.Thread.run(Thread.java:745)
      11:24:47.240 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-3" java.lang.OutOfMemoryError: Java heap space
      11:24:47.240 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-9" java.lang.OutOfMemoryError: Java heap space
      11:24:47.240 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
      11:24:47.240 [DEBUG] [TestEventLogger]     	at java.lang.Thread.run(Thread.java:745)
      11:24:47.240 [DEBUG] [TestEventLogger] 
      11:24:47.240 [DEBUG] [TestEventLogger] org.apache.samza.test.performance.TestSamzaContainerPerformance > testContainerPerformance STANDARD_OUT
      11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.242 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.242 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.242 [DEBUG] [TestEventLogger] 
      11:24:47.242 [DEBUG] [TestEventLogger] org.apache.samza.test.performance.TestSamzaContainerPerformance > testContainerPerformance STANDARD_ERROR
      

        Attachments

        1. SAMZA-544-0.patch
          40 kB
          Chris Riccomini
        2. SAMZA-544-1.patch
          9 kB
          Chris Riccomini
        3. Screen Shot 2015-02-04 at 1.50.54 PM.png
          112 kB
          Yan Fang

          Issue Links

            Activity

              People

              • Assignee:
                criccomini Chris Riccomini
                Reporter:
                closeuris Yan Fang
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: