[BOOKKEEPER-923] OutOfMemoryError during build on Jenkins - ASF JIRA

Details

Type: Bug
Status: Resolved
Priority: Critical
Resolution: Cannot Reproduce
Affects Version/s: 4.4.0
Fix Version/s: None
Component/s: build
Labels:
None
Environment:

ASF Jenkins platform

Description

I'm seeing this java.lang.OutOfMemoryError error on Jenkins
> https://builds.apache.org/job/bookkeeper-master/1349/

I'm afraid that new version uses more memory than previous one,
is there some commit which changed memory consumption ?

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.apache.bookkeeper.metastore.TestMetaStore
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.386 sec
Running org.apache.bookkeeper.proto.TestDeathwatcher
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.38 sec
Running org.apache.bookkeeper.proto.TestBackwardCompatCMS42
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.631 sec
Running org.apache.bookkeeper.proto.TestPerChannelBookieClient
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.231 sec
Running org.apache.bookkeeper.proto.TestBKStats
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.17 sec
Running org.apache.bookkeeper.client.RoundRobinDistributionScheduleTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.235 sec
Running org.apache.bookkeeper.client.TestWatchEnsembleChange
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.548 sec
Running org.apache.bookkeeper.client.TestAddEntryQuorumTimeout
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.19 sec
Running org.apache.bookkeeper.client.TestRackawareEnsemblePlacementPolicy
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.259 sec
Running org.apache.bookkeeper.client.BookKeeperTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.856 sec
Running org.apache.bookkeeper.client.TestReadTimeout
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.936 sec
Running org.apache.bookkeeper.client.SlowBookieTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.236 sec
Running org.apache.bookkeeper.client.TestTryReadLastConfirmed
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.28 sec
Running org.apache.bookkeeper.client.LocalBookKeeperTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.26 sec
Running org.apache.bookkeeper.client.UpdateLedgerCmdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.712 sec
Running org.apache.bookkeeper.client.TestFencing
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.622 sec
Running org.apache.bookkeeper.client.BookieWriteLedgerTest
Tests run: 54, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.367 sec
Running org.apache.bookkeeper.client.ListLedgersTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.221 sec
Running org.apache.bookkeeper.client.BookKeeperCloseTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.428 sec
Running org.apache.bookkeeper.client.BookieRecoveryTest
Tests run: 72, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.937 sec
Running org.apache.bookkeeper.client.TestBookieHealthCheck
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.448 sec
Running org.apache.bookkeeper.client.UpdateLedgerOpTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.666 sec
Running org.apache.bookkeeper.client.TestLedgerFragmentReplication
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.914 sec
Running org.apache.bookkeeper.client.TestBookieWatcher
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.92 sec
Running org.apache.bookkeeper.client.TestSpeculativeRead
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.023 sec
Running org.apache.bookkeeper.client.TestLedgerChecker
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.094 sec
Running org.apache.bookkeeper.client.LedgerRecoveryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.331 sec
Running org.apache.bookkeeper.client.LedgerCloseTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.559 sec
Running org.apache.bookkeeper.meta.GcLedgersTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.112 sec
Running org.apache.bookkeeper.meta.TestZkLedgerIdGenerator
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.392 sec
Running org.apache.bookkeeper.meta.TestZkVersion
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.083 sec
Running org.apache.bookkeeper.meta.LedgerManagerIteratorTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.682 sec
Running org.apache.bookkeeper.meta.TestLedgerManager
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.419 sec
Running org.apache.bookkeeper.meta.LedgerLayoutTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.698 sec
Running org.apache.bookkeeper.zookeeper.TestZooKeeperClient
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.605 sec
Running org.apache.bookkeeper.bookie.EntryLogTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.491 sec
Running org.apache.bookkeeper.bookie.BookieShutdownTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.233 sec
Running org.apache.bookkeeper.bookie.BookieJournalTest
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.002 sec
Running org.apache.bookkeeper.bookie.CompactionTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 95.109 sec
Running org.apache.bookkeeper.bookie.LedgerCacheTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.38 sec
Running org.apache.bookkeeper.bookie.BookieThreadTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.17 sec
Running org.apache.bookkeeper.bookie.IndexPersistenceMgrTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.319 sec
Running org.apache.bookkeeper.bookie.TestSyncThread
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.978 sec
Running org.apache.bookkeeper.bookie.TestLedgerDirsManager
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.519 sec
Running org.apache.bookkeeper.bookie.CookieTest
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.29 sec
Running org.apache.bookkeeper.bookie.IndexCorruptionTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.422 sec
Running org.apache.bookkeeper.bookie.BookieInitializationTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.506 sec
Running org.apache.bookkeeper.bookie.CreateNewLogTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.373 sec
Running org.apache.bookkeeper.bookie.UpdateCookieCmdTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.115 sec
Running org.apache.bookkeeper.bookie.UpgradeTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.512 sec
Running org.apache.bookkeeper.util.TestDiskChecker
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.221 sec
Running org.apache.bookkeeper.auth.TestAuth
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.72 sec
Running org.apache.bookkeeper.test.ConditionalSetTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.17 sec
Running org.apache.bookkeeper.test.ForceReadOnlyBookieTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.728 sec
Running org.apache.bookkeeper.test.CloseTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.307 sec
Running org.apache.bookkeeper.test.BookieFailureTest
Tests run: 48, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.583 sec
Running org.apache.bookkeeper.test.LedgerCreateDeleteTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.116 sec
Running org.apache.bookkeeper.test.BookieJournalRollingTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.132 sec
Running org.apache.bookkeeper.test.MultipleThreadReadTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.659 sec
Running org.apache.bookkeeper.test.BookieReadWriteTest
Tests run: 78, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.704 sec
Running org.apache.bookkeeper.test.ReadOnlyBookieTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.005 sec
Running org.apache.bookkeeper.test.ConcurrentLedgerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.507 sec
Running org.apache.bookkeeper.test.BookieZKExpireTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.952 sec
Running org.apache.bookkeeper.test.LedgerDeleteTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.218 sec
Running org.apache.bookkeeper.test.AsyncLedgerOpsTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.248 sec
Running org.apache.bookkeeper.test.BookieClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.888 sec
Running org.apache.bookkeeper.test.TestBackwardCompat
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.133 sec
Running org.apache.bookkeeper.test.ConfigurationTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.247 sec
Running org.apache.bookkeeper.replication.BookieLedgerIndexTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.315 sec
Running org.apache.bookkeeper.replication.TestAutoRecoveryAlongWithBookieServers
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.972 sec
Running org.apache.bookkeeper.replication.AuditorBookieTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.363 sec
Running org.apache.bookkeeper.replication.BookieAutoRecoveryTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.638 sec
Running org.apache.bookkeeper.replication.TestLedgerUnderreplicationManager
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.162 sec
Running org.apache.bookkeeper.replication.AutoRecoveryMainTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.693 sec
Running org.apache.bookkeeper.replication.AuditorPeriodicBookieCheckTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.397 sec
Running org.apache.bookkeeper.replication.AuditorLedgerCheckerTest
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.238 sec
Running org.apache.bookkeeper.replication.AuditorRollingRestartTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 95.811 sec
Running org.apache.bookkeeper.replication.TestReplicationWorker
Tests run: 27, Failures: 3, Errors: 3, Skipped: 0, Time elapsed: 135.658 sec <<< FAILURE!
Running org.apache.bookkeeper.replication.AuditorPeriodicCheckTest
Exception in thread "ThreadedStreamConsumer" java.lang.OutOfMemoryError: Java heap space
	at java.util.Arrays.copyOf(Arrays.java:2367)
	at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)
	at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:114)
	at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:415)
	at java.lang.StringBuffer.append(StringBuffer.java:237)
	at org.apache.maven.surefire.report.ConsoleOutputFileReporter.writeMessage(ConsoleOutputFileReporter.java:115)
	at org.apache.maven.surefire.report.MulticastingReporter.writeMessage(MulticastingReporter.java:101)
	at org.apache.maven.surefire.report.TestSetRunListener.writeTestOutput(TestSetRunListener.java:99)
	at org.apache.maven.plugin.surefire.booterclient.output.ForkClient.consumeLine(ForkClient.java:132)
	at org.apache.maven.plugin.surefire.booterclient.output.ThreadedStreamConsumer$Pumper.run(ThreadedStreamConsumer.java:67)
	at java.lang.Thread.run(Thread.java:745)
Exception in thread "Thread-215" java.lang.OutOfMemoryError: Java heap space
	at java.util.Arrays.copyOf(Arrays.java:2367)
	at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)
	at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:114)
	at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:535)
	at java.lang.StringBuffer.append(StringBuffer.java:322)
	at java.io.BufferedReader.readLine(BufferedReader.java:351)
	at java.io.BufferedReader.readLine(BufferedReader.java:382)
	at org.codehaus.plexus.util.cli.StreamPumper.run(StreamPumper.java:129)

Results :

Failed tests:   testRWZKSessionLost[0](org.apache.bookkeeper.replication.TestReplicationWorker): Replication worker should have shut down
  testRWZKSessionLost[1](org.apache.bookkeeper.replication.TestReplicationWorker): Replication worker should have shut down
  testRWZKSessionLost[2](org.apache.bookkeeper.replication.TestReplicationWorker): Replication worker should have shut down

Tests in error: 
  testRWShutdownOnLocalBookieReadonlyTransition[0](org.apache.bookkeeper.replication.TestReplicationWorker): test timed out after 20000 milliseconds
  testRWShutdownOnLocalBookieReadonlyTransition[1](org.apache.bookkeeper.replication.TestReplicationWorker): test timed out after 20000 milliseconds
  testRWShutdownOnLocalBookieReadonlyTransition[2](org.apache.bookkeeper.replication.TestReplicationWorker): test timed out after 20000 milliseconds

Tests run: 666, Failures: 3, Errors: 3, Skipped: 0

Attachments

Issue Links

is related to

BOOKKEEPER-881 upgrade surefire plugin to 2.19

Resolved

OutOfMemoryError during build on Jenkins

Details

Description

Attachments

Issue Links

Activity

People

Dates