Uploaded image for project: 'Bookkeeper'
  1. Bookkeeper
  2. BOOKKEEPER-923

OutOfMemoryError during build on Jenkins

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Cannot Reproduce
    • 4.4.0
    • None
    • build
    • None
    • ASF Jenkins platform

    Description

      I'm seeing this java.lang.OutOfMemoryError error on Jenkins
      > https://builds.apache.org/job/bookkeeper-master/1349/

      I'm afraid that new version uses more memory than previous one,
      is there some commit which changed memory consumption ?

      -------------------------------------------------------
       T E S T S
      -------------------------------------------------------
      Running org.apache.bookkeeper.metastore.TestMetaStore
      Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.386 sec
      Running org.apache.bookkeeper.proto.TestDeathwatcher
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.38 sec
      Running org.apache.bookkeeper.proto.TestBackwardCompatCMS42
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.631 sec
      Running org.apache.bookkeeper.proto.TestPerChannelBookieClient
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.231 sec
      Running org.apache.bookkeeper.proto.TestBKStats
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.17 sec
      Running org.apache.bookkeeper.client.RoundRobinDistributionScheduleTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.235 sec
      Running org.apache.bookkeeper.client.TestWatchEnsembleChange
      Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.548 sec
      Running org.apache.bookkeeper.client.TestAddEntryQuorumTimeout
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.19 sec
      Running org.apache.bookkeeper.client.TestRackawareEnsemblePlacementPolicy
      Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.259 sec
      Running org.apache.bookkeeper.client.BookKeeperTest
      Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.856 sec
      Running org.apache.bookkeeper.client.TestReadTimeout
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.936 sec
      Running org.apache.bookkeeper.client.SlowBookieTest
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.236 sec
      Running org.apache.bookkeeper.client.TestTryReadLastConfirmed
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.28 sec
      Running org.apache.bookkeeper.client.LocalBookKeeperTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.26 sec
      Running org.apache.bookkeeper.client.UpdateLedgerCmdTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.712 sec
      Running org.apache.bookkeeper.client.TestFencing
      Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.622 sec
      Running org.apache.bookkeeper.client.BookieWriteLedgerTest
      Tests run: 54, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.367 sec
      Running org.apache.bookkeeper.client.ListLedgersTest
      Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.221 sec
      Running org.apache.bookkeeper.client.BookKeeperCloseTest
      Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.428 sec
      Running org.apache.bookkeeper.client.BookieRecoveryTest
      Tests run: 72, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.937 sec
      Running org.apache.bookkeeper.client.TestBookieHealthCheck
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.448 sec
      Running org.apache.bookkeeper.client.UpdateLedgerOpTest
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.666 sec
      Running org.apache.bookkeeper.client.TestLedgerFragmentReplication
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.914 sec
      Running org.apache.bookkeeper.client.TestBookieWatcher
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.92 sec
      Running org.apache.bookkeeper.client.TestSpeculativeRead
      Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.023 sec
      Running org.apache.bookkeeper.client.TestLedgerChecker
      Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.094 sec
      Running org.apache.bookkeeper.client.LedgerRecoveryTest
      Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.331 sec
      Running org.apache.bookkeeper.client.LedgerCloseTest
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.559 sec
      Running org.apache.bookkeeper.meta.GcLedgersTest
      Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.112 sec
      Running org.apache.bookkeeper.meta.TestZkLedgerIdGenerator
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.392 sec
      Running org.apache.bookkeeper.meta.TestZkVersion
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.083 sec
      Running org.apache.bookkeeper.meta.LedgerManagerIteratorTest
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.682 sec
      Running org.apache.bookkeeper.meta.TestLedgerManager
      Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.419 sec
      Running org.apache.bookkeeper.meta.LedgerLayoutTest
      Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.698 sec
      Running org.apache.bookkeeper.zookeeper.TestZooKeeperClient
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.605 sec
      Running org.apache.bookkeeper.bookie.EntryLogTest
      Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.491 sec
      Running org.apache.bookkeeper.bookie.BookieShutdownTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.233 sec
      Running org.apache.bookkeeper.bookie.BookieJournalTest
      Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.002 sec
      Running org.apache.bookkeeper.bookie.CompactionTest
      Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 95.109 sec
      Running org.apache.bookkeeper.bookie.LedgerCacheTest
      Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.38 sec
      Running org.apache.bookkeeper.bookie.BookieThreadTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.17 sec
      Running org.apache.bookkeeper.bookie.IndexPersistenceMgrTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.319 sec
      Running org.apache.bookkeeper.bookie.TestSyncThread
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.978 sec
      Running org.apache.bookkeeper.bookie.TestLedgerDirsManager
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.519 sec
      Running org.apache.bookkeeper.bookie.CookieTest
      Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.29 sec
      Running org.apache.bookkeeper.bookie.IndexCorruptionTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.422 sec
      Running org.apache.bookkeeper.bookie.BookieInitializationTest
      Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.506 sec
      Running org.apache.bookkeeper.bookie.CreateNewLogTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.373 sec
      Running org.apache.bookkeeper.bookie.UpdateCookieCmdTest
      Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.115 sec
      Running org.apache.bookkeeper.bookie.UpgradeTest
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.512 sec
      Running org.apache.bookkeeper.util.TestDiskChecker
      Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.221 sec
      Running org.apache.bookkeeper.auth.TestAuth
      Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.72 sec
      Running org.apache.bookkeeper.test.ConditionalSetTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.17 sec
      Running org.apache.bookkeeper.test.ForceReadOnlyBookieTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.728 sec
      Running org.apache.bookkeeper.test.CloseTest
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.307 sec
      Running org.apache.bookkeeper.test.BookieFailureTest
      Tests run: 48, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.583 sec
      Running org.apache.bookkeeper.test.LedgerCreateDeleteTest
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.116 sec
      Running org.apache.bookkeeper.test.BookieJournalRollingTest
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.132 sec
      Running org.apache.bookkeeper.test.MultipleThreadReadTest
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.659 sec
      Running org.apache.bookkeeper.test.BookieReadWriteTest
      Tests run: 78, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.704 sec
      Running org.apache.bookkeeper.test.ReadOnlyBookieTest
      Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.005 sec
      Running org.apache.bookkeeper.test.ConcurrentLedgerTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.507 sec
      Running org.apache.bookkeeper.test.BookieZKExpireTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.952 sec
      Running org.apache.bookkeeper.test.LedgerDeleteTest
      Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.218 sec
      Running org.apache.bookkeeper.test.AsyncLedgerOpsTest
      Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.248 sec
      Running org.apache.bookkeeper.test.BookieClientTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.888 sec
      Running org.apache.bookkeeper.test.TestBackwardCompat
      Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.133 sec
      Running org.apache.bookkeeper.test.ConfigurationTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.247 sec
      Running org.apache.bookkeeper.replication.BookieLedgerIndexTest
      Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.315 sec
      Running org.apache.bookkeeper.replication.TestAutoRecoveryAlongWithBookieServers
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.972 sec
      Running org.apache.bookkeeper.replication.AuditorBookieTest
      Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.363 sec
      Running org.apache.bookkeeper.replication.BookieAutoRecoveryTest
      Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.638 sec
      Running org.apache.bookkeeper.replication.TestLedgerUnderreplicationManager
      Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.162 sec
      Running org.apache.bookkeeper.replication.AutoRecoveryMainTest
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.693 sec
      Running org.apache.bookkeeper.replication.AuditorPeriodicBookieCheckTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.397 sec
      Running org.apache.bookkeeper.replication.AuditorLedgerCheckerTest
      Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.238 sec
      Running org.apache.bookkeeper.replication.AuditorRollingRestartTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 95.811 sec
      Running org.apache.bookkeeper.replication.TestReplicationWorker
      Tests run: 27, Failures: 3, Errors: 3, Skipped: 0, Time elapsed: 135.658 sec <<< FAILURE!
      Running org.apache.bookkeeper.replication.AuditorPeriodicCheckTest
      Exception in thread "ThreadedStreamConsumer" java.lang.OutOfMemoryError: Java heap space
      	at java.util.Arrays.copyOf(Arrays.java:2367)
      	at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)
      	at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:114)
      	at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:415)
      	at java.lang.StringBuffer.append(StringBuffer.java:237)
      	at org.apache.maven.surefire.report.ConsoleOutputFileReporter.writeMessage(ConsoleOutputFileReporter.java:115)
      	at org.apache.maven.surefire.report.MulticastingReporter.writeMessage(MulticastingReporter.java:101)
      	at org.apache.maven.surefire.report.TestSetRunListener.writeTestOutput(TestSetRunListener.java:99)
      	at org.apache.maven.plugin.surefire.booterclient.output.ForkClient.consumeLine(ForkClient.java:132)
      	at org.apache.maven.plugin.surefire.booterclient.output.ThreadedStreamConsumer$Pumper.run(ThreadedStreamConsumer.java:67)
      	at java.lang.Thread.run(Thread.java:745)
      Exception in thread "Thread-215" java.lang.OutOfMemoryError: Java heap space
      	at java.util.Arrays.copyOf(Arrays.java:2367)
      	at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)
      	at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:114)
      	at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:535)
      	at java.lang.StringBuffer.append(StringBuffer.java:322)
      	at java.io.BufferedReader.readLine(BufferedReader.java:351)
      	at java.io.BufferedReader.readLine(BufferedReader.java:382)
      	at org.codehaus.plexus.util.cli.StreamPumper.run(StreamPumper.java:129)
      
      Results :
      
      Failed tests:   testRWZKSessionLost[0](org.apache.bookkeeper.replication.TestReplicationWorker): Replication worker should have shut down
        testRWZKSessionLost[1](org.apache.bookkeeper.replication.TestReplicationWorker): Replication worker should have shut down
        testRWZKSessionLost[2](org.apache.bookkeeper.replication.TestReplicationWorker): Replication worker should have shut down
      
      Tests in error: 
        testRWShutdownOnLocalBookieReadonlyTransition[0](org.apache.bookkeeper.replication.TestReplicationWorker): test timed out after 20000 milliseconds
        testRWShutdownOnLocalBookieReadonlyTransition[1](org.apache.bookkeeper.replication.TestReplicationWorker): test timed out after 20000 milliseconds
        testRWShutdownOnLocalBookieReadonlyTransition[2](org.apache.bookkeeper.replication.TestReplicationWorker): test timed out after 20000 milliseconds
      
      Tests run: 666, Failures: 3, Errors: 3, Skipped: 0
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              eolivelli Enrico Olivelli
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Slack

                  Issue deployment