19:16:46.349 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit1464237481650679262\junit6367947572978060294, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:16:46.349 INFO [main] FileStore.java:240 TarMK opened: target\junit1464237481650679262\junit6367947572978060294 (mmap=false) 19:16:46.349 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit1464237481650679262\junit592060939646826002, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:16:46.349 INFO [main] FileStore.java:240 TarMK opened: target\junit1464237481650679262\junit592060939646826002 (mmap=false) 19:16:46.349 INFO [main] DataStoreTestBase.java:127 Test begin: testResilientSync 19:16:46.349 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 19:16:46.349 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 19:16:46.569 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x44540a59]' 19:16:46.572 DEBUG [main] StandbyServer.java:249 Binding was successful 19:16:46.577 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 732afa89-4eb8-4567-ad9a-9344d3ae5da9 for current head 19:16:46.577 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:64337 is allowed 19:16:46.577 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:16:46.577 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 732afa89-4eb8-4567-ad9a-9344d3ae5da9 19:16:46.578 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 732afa89-4eb8-4567-ad9a-9344d3ae5da9 19:16:50.577 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 732afa89-4eb8-4567-ad9a-9344d3ae5da9 io.netty.handler.timeout.ReadTimeoutException: null 19:16:50.578 ERROR [standby-run-44] StandbyClientSyncExecution.java:67 Unable to fetch remote head 19:16:50.579 DEBUG [standby-run-44] StandbyClient.java:157 Channel closed 19:16:51.597 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head b1d729ba-f5df-4353-afdd-3e068bad3133.0000000c to client 732afa89-4eb8-4567-ad9a-9344d3ae5da9 19:16:51.597 WARN [primary-1] ExceptionHandler.java:31 Exception caught on the server java.io.IOException: Eine bestehende Verbindung wurde softwaregesteuert durch den Hostcomputer abgebrochen at sun.nio.ch.SocketDispatcher.read0(Native Method) ~[na:1.8.0_151] at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43) ~[na:1.8.0_151] at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) ~[na:1.8.0_151] at sun.nio.ch.IOUtil.read(IOUtil.java:192) ~[na:1.8.0_151] at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) ~[na:1.8.0_151] at io.netty.buffer.PooledUnsafeDirectByteBuf.setBytes(PooledUnsafeDirectByteBuf.java:288) ~[netty-buffer-4.1.14.Final.jar:4.1.14.Final] at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1106) ~[netty-buffer-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:372) ~[netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:123) ~[netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 19:16:52.811 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:16:52.811 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:16:52.811 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:16:52.811 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:16:52.811 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:16:52.897 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x56c82b3f]' 19:16:52.897 DEBUG [main] StandbyServer.java:249 Binding was successful 19:16:52.912 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 3714c111-3184-40f3-aa3a-7ab9349a8215 for current head 19:16:52.912 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:64378 is allowed 19:16:52.912 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:16:52.912 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head b1d729ba-f5df-4353-afdd-3e068bad3133.0000000c to client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:16:52.912 DEBUG [standby-run-45] StandbyClientSyncExecution.java:103 Found missing segment b1d729ba-f5df-4353-afdd-3e068bad3133 19:16:52.912 DEBUG [standby-run-45] StandbyClientSyncExecution.java:124 Inspecting segment b1d729ba-f5df-4353-afdd-3e068bad3133 19:16:52.912 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 3714c111-3184-40f3-aa3a-7ab9349a8215 for references of segment b1d729ba-f5df-4353-afdd-3e068bad3133 19:16:52.912 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:16:52.912 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment b1d729ba-f5df-4353-afdd-3e068bad3133 for client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment b1d729ba-f5df-4353-afdd-3e068bad3133 to client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:16:52.912 DEBUG [standby-run-45] StandbyClientSyncExecution.java:184 Found reference from b1d729ba-f5df-4353-afdd-3e068bad3133 to 606d35b8-63f0-4197-a2da-1bd3050c2c48 19:16:52.912 DEBUG [standby-run-45] StandbyClientSyncExecution.java:124 Inspecting segment 606d35b8-63f0-4197-a2da-1bd3050c2c48 19:16:52.912 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 3714c111-3184-40f3-aa3a-7ab9349a8215 for references of segment 606d35b8-63f0-4197-a2da-1bd3050c2c48 19:16:52.912 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:16:52.912 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 606d35b8-63f0-4197-a2da-1bd3050c2c48 for client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 606d35b8-63f0-4197-a2da-1bd3050c2c48 to client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:16:52.912 INFO [standby-run-45] StandbyClientSyncExecution.java:196 Copying data segment 606d35b8-63f0-4197-a2da-1bd3050c2c48 from primary 19:16:52.912 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 3714c111-3184-40f3-aa3a-7ab9349a8215 for segment 606d35b8-63f0-4197-a2da-1bd3050c2c48 19:16:52.912 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 19:16:52.912 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 606d35b8-63f0-4197-a2da-1bd3050c2c48 for client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 606d35b8-63f0-4197-a2da-1bd3050c2c48 to client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:16:52.912 INFO [standby-run-45] StandbyClientSyncExecution.java:196 Copying data segment b1d729ba-f5df-4353-afdd-3e068bad3133 from primary 19:16:52.912 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 3714c111-3184-40f3-aa3a-7ab9349a8215 for segment b1d729ba-f5df-4353-afdd-3e068bad3133 19:16:52.912 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 19:16:52.912 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment b1d729ba-f5df-4353-afdd-3e068bad3133 for client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment b1d729ba-f5df-4353-afdd-3e068bad3133 to client 3714c111-3184-40f3-aa3a-7ab9349a8215 19:16:52.912 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:16:53.043 INFO [standby-run-45] StandbyClientSyncExecution.java:82 updated head state successfully: true in 131ms. 19:16:53.043 DEBUG [standby-run-45] StandbyClient.java:157 Channel closed 19:16:55.311 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:16:55.311 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:16:55.311 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:16:55.311 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:16:55.311 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:16:55.326 INFO [main] DataStoreTestBase.java:132 Test end: testResilientSync 19:16:55.411 INFO [main] FileStore.java:466 TarMK closed: target\junit1464237481650679262\junit592060939646826002 19:16:55.427 INFO [main] FileStore.java:466 TarMK closed: target\junit1464237481650679262\junit6367947572978060294 19:16:55.458 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit4590536288777293610\junit8846003926463285178, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:16:55.458 INFO [main] FileStore.java:240 TarMK opened: target\junit4590536288777293610\junit8846003926463285178 (mmap=false) 19:16:55.458 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit4590536288777293610\junit5463534256395575200, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:16:55.458 INFO [main] FileStore.java:240 TarMK opened: target\junit4590536288777293610\junit5463534256395575200 (mmap=false) 19:16:55.458 INFO [main] DataStoreTestBase.java:127 Test begin: testProxySkippedBytes 19:16:55.458 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 19:16:55.458 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 19:16:55.696 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x274e3752]' 19:16:55.712 DEBUG [main] StandbyServer.java:249 Binding was successful 19:16:55.812 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client b0dc43c4-d788-4ea2-a6b3-10b1b7b5fc22 for current head 19:16:55.843 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:64467 is allowed 19:16:55.843 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:16:55.843 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client b0dc43c4-d788-4ea2-a6b3-10b1b7b5fc22 19:16:55.843 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client b0dc43c4-d788-4ea2-a6b3-10b1b7b5fc22 19:16:55.843 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head ac4867ae-1756-465d-a18d-cf66786ab57e.0000000c to client b0dc43c4-d788-4ea2-a6b3-10b1b7b5fc22 19:16:55.843 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:16:55.843 DEBUG [standby-run-46] StandbyClientSyncExecution.java:103 Found missing segment ac4867ae-1756-465d-a18d-cf66786ab57e 19:16:55.843 DEBUG [standby-run-46] StandbyClientSyncExecution.java:124 Inspecting segment ac4867ae-1756-465d-a18d-cf66786ab57e 19:16:55.843 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client b0dc43c4-d788-4ea2-a6b3-10b1b7b5fc22 for references of segment ac4867ae-1756-465d-a18d-cf66786ab57e 19:16:55.843 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:16:55.843 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment ac4867ae-1756-465d-a18d-cf66786ab57e for client b0dc43c4-d788-4ea2-a6b3-10b1b7b5fc22 19:16:55.843 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment ac4867ae-1756-465d-a18d-cf66786ab57e to client b0dc43c4-d788-4ea2-a6b3-10b1b7b5fc22 19:17:00.861 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client b0dc43c4-d788-4ea2-a6b3-10b1b7b5fc22 io.netty.handler.timeout.ReadTimeoutException: null 19:17:00.861 DEBUG [standby-run-46] StandbyClient.java:157 Channel closed 19:17:00.861 ERROR [standby-run-46] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment ac4867ae-1756-465d-a18d-cf66786ab57e from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxySkippedBytes(DataStoreTestBase.java:296) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 19:17:03.169 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:03.223 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 for current head 19:17:03.223 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:64491 is allowed 19:17:03.223 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 19:17:03.223 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head ac4867ae-1756-465d-a18d-cf66786ab57e.0000000c to client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:03.223 DEBUG [standby-run-47] StandbyClientSyncExecution.java:103 Found missing segment ac4867ae-1756-465d-a18d-cf66786ab57e 19:17:03.223 DEBUG [standby-run-47] StandbyClientSyncExecution.java:124 Inspecting segment ac4867ae-1756-465d-a18d-cf66786ab57e 19:17:03.223 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 for references of segment ac4867ae-1756-465d-a18d-cf66786ab57e 19:17:03.223 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:03.223 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment ac4867ae-1756-465d-a18d-cf66786ab57e for client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment ac4867ae-1756-465d-a18d-cf66786ab57e to client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:03.223 DEBUG [standby-run-47] StandbyClientSyncExecution.java:184 Found reference from ac4867ae-1756-465d-a18d-cf66786ab57e to 57fdaf33-0f64-4dbe-a654-fe1c31a0a73e 19:17:03.223 DEBUG [standby-run-47] StandbyClientSyncExecution.java:124 Inspecting segment 57fdaf33-0f64-4dbe-a654-fe1c31a0a73e 19:17:03.223 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 for references of segment 57fdaf33-0f64-4dbe-a654-fe1c31a0a73e 19:17:03.223 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:03.223 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 57fdaf33-0f64-4dbe-a654-fe1c31a0a73e for client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 57fdaf33-0f64-4dbe-a654-fe1c31a0a73e to client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:03.223 INFO [standby-run-47] StandbyClientSyncExecution.java:196 Copying data segment 57fdaf33-0f64-4dbe-a654-fe1c31a0a73e from primary 19:17:03.223 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 for segment 57fdaf33-0f64-4dbe-a654-fe1c31a0a73e 19:17:03.223 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:03.223 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 57fdaf33-0f64-4dbe-a654-fe1c31a0a73e for client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 57fdaf33-0f64-4dbe-a654-fe1c31a0a73e to client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:03.223 INFO [standby-run-47] StandbyClientSyncExecution.java:196 Copying data segment ac4867ae-1756-465d-a18d-cf66786ab57e from primary 19:17:03.223 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 for segment ac4867ae-1756-465d-a18d-cf66786ab57e 19:17:03.223 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:03.223 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment ac4867ae-1756-465d-a18d-cf66786ab57e for client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment ac4867ae-1756-465d-a18d-cf66786ab57e to client 6dd6f3e8-3862-45a9-bfe9-8067da6441c1 19:17:03.223 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:03.354 INFO [standby-run-47] StandbyClientSyncExecution.java:82 updated head state successfully: true in 131ms. 19:17:03.354 DEBUG [standby-run-47] StandbyClient.java:157 Channel closed 19:17:05.673 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:05.673 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:05.673 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:05.673 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:17:05.673 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:17:05.706 INFO [main] DataStoreTestBase.java:132 Test end: testProxySkippedBytes 19:17:05.758 INFO [main] FileStore.java:466 TarMK closed: target\junit4590536288777293610\junit5463534256395575200 19:17:05.789 INFO [main] FileStore.java:466 TarMK closed: target\junit4590536288777293610\junit8846003926463285178 19:17:05.811 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6401917888695597346\junit6309408499708332463, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:05.811 INFO [main] FileStore.java:240 TarMK opened: target\junit6401917888695597346\junit6309408499708332463 (mmap=false) 19:17:05.811 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6401917888695597346\junit8514021029816847567, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:05.827 INFO [main] FileStore.java:240 TarMK opened: target\junit6401917888695597346\junit8514021029816847567 (mmap=false) 19:17:05.827 INFO [main] DataStoreTestBase.java:127 Test begin: testSyncUpdatedBinaryProperty 19:17:05.827 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 19:17:05.827 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 19:17:05.906 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x88f85d77]' 19:17:05.909 DEBUG [main] StandbyServer.java:249 Binding was successful 19:17:06.107 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 for current head 19:17:06.107 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:64531 is allowed 19:17:06.107 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:17:06.107 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.108 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.108 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 4dd29e32-c915-4a31-a427-72af52f876bb.0000000c to client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.108 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:06.108 DEBUG [standby-run-48] StandbyClientSyncExecution.java:103 Found missing segment 4dd29e32-c915-4a31-a427-72af52f876bb 19:17:06.109 DEBUG [standby-run-48] StandbyClientSyncExecution.java:124 Inspecting segment 4dd29e32-c915-4a31-a427-72af52f876bb 19:17:06.109 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 for references of segment 4dd29e32-c915-4a31-a427-72af52f876bb 19:17:06.109 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:17:06.109 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 4dd29e32-c915-4a31-a427-72af52f876bb for client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.110 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 4dd29e32-c915-4a31-a427-72af52f876bb to client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.110 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:06.110 DEBUG [standby-run-48] StandbyClientSyncExecution.java:184 Found reference from 4dd29e32-c915-4a31-a427-72af52f876bb to add54d70-2bc5-4fe2-a11a-5c730187ea81 19:17:06.111 DEBUG [standby-run-48] StandbyClientSyncExecution.java:124 Inspecting segment add54d70-2bc5-4fe2-a11a-5c730187ea81 19:17:06.111 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 for references of segment add54d70-2bc5-4fe2-a11a-5c730187ea81 19:17:06.111 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:17:06.111 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment add54d70-2bc5-4fe2-a11a-5c730187ea81 for client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.111 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment add54d70-2bc5-4fe2-a11a-5c730187ea81 to client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.111 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:06.111 INFO [standby-run-48] StandbyClientSyncExecution.java:196 Copying data segment add54d70-2bc5-4fe2-a11a-5c730187ea81 from primary 19:17:06.111 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 for segment add54d70-2bc5-4fe2-a11a-5c730187ea81 19:17:06.111 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 19:17:06.111 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.111 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment add54d70-2bc5-4fe2-a11a-5c730187ea81 for client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.111 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.111 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment add54d70-2bc5-4fe2-a11a-5c730187ea81 to client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.111 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:06.111 INFO [standby-run-48] StandbyClientSyncExecution.java:196 Copying data segment 4dd29e32-c915-4a31-a427-72af52f876bb from primary 19:17:06.111 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 for segment 4dd29e32-c915-4a31-a427-72af52f876bb 19:17:06.111 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 19:17:06.111 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.111 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 4dd29e32-c915-4a31-a427-72af52f876bb for client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.111 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.111 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 4dd29e32-c915-4a31-a427-72af52f876bb to client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.111 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:06.211 INFO [standby-run-48] StandbyClientSyncExecution.java:82 updated head state successfully: true in 103ms. 19:17:06.211 DEBUG [standby-run-48] StandbyClient.java:157 Channel closed 19:17:06.489 DEBUG [standby-2] GetHeadRequestEncoder.java:33 Sending request from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 for current head 19:17:06.489 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:64533 is allowed 19:17:06.489 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 19:17:06.489 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.489 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.489 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 2ef7a1d7-afc1-4966-a38e-5ffb5e16573a.00000006 to client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.489 DEBUG [standby-2] ResponseDecoder.java:82 Decoding 'get head' response 19:17:06.506 DEBUG [standby-run-49] StandbyClientSyncExecution.java:103 Found missing segment 2ef7a1d7-afc1-4966-a38e-5ffb5e16573a 19:17:06.507 DEBUG [standby-run-49] StandbyClientSyncExecution.java:124 Inspecting segment 2ef7a1d7-afc1-4966-a38e-5ffb5e16573a 19:17:06.508 DEBUG [standby-2] GetReferencesRequestEncoder.java:33 Sending request from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 for references of segment 2ef7a1d7-afc1-4966-a38e-5ffb5e16573a 19:17:06.508 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:06.509 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 2ef7a1d7-afc1-4966-a38e-5ffb5e16573a for client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.509 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 2ef7a1d7-afc1-4966-a38e-5ffb5e16573a to client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.511 DEBUG [standby-2] ResponseDecoder.java:94 Decoding 'get references' response 19:17:06.511 INFO [standby-run-49] StandbyClientSyncExecution.java:196 Copying data segment 2ef7a1d7-afc1-4966-a38e-5ffb5e16573a from primary 19:17:06.512 DEBUG [standby-2] GetSegmentRequestEncoder.java:33 Sending request from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 for segment 2ef7a1d7-afc1-4966-a38e-5ffb5e16573a 19:17:06.512 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:06.512 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.512 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 2ef7a1d7-afc1-4966-a38e-5ffb5e16573a for client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.512 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.512 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 2ef7a1d7-afc1-4966-a38e-5ffb5e16573a to client 3ac71ff7-00b5-4d72-a0cc-20337a764190 19:17:06.512 DEBUG [standby-2] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:06.611 INFO [standby-run-49] StandbyClientSyncExecution.java:82 updated head state successfully: true in 105ms. 19:17:06.611 DEBUG [standby-run-49] StandbyClient.java:157 Channel closed 19:17:08.958 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:08.958 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:08.958 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:08.958 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:17:08.958 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:17:08.958 INFO [main] DataStoreTestBase.java:132 Test end: testSyncUpdatedBinaryProperty 19:17:09.010 INFO [main] FileStore.java:466 TarMK closed: target\junit6401917888695597346\junit8514021029816847567 19:17:09.028 INFO [main] FileStore.java:466 TarMK closed: target\junit6401917888695597346\junit6309408499708332463 19:17:09.059 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6986213828820737458\junit5871023299073381844, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:09.059 INFO [main] FileStore.java:240 TarMK opened: target\junit6986213828820737458\junit5871023299073381844 (mmap=false) 19:17:09.059 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6986213828820737458\junit1109115438970616105, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:09.059 INFO [main] FileStore.java:240 TarMK opened: target\junit6986213828820737458\junit1109115438970616105 (mmap=false) 19:17:09.059 INFO [main] DataStoreTestBase.java:127 Test begin: testSync 19:17:09.059 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 19:17:09.059 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 19:17:09.206 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x5952443f]' 19:17:09.209 DEBUG [main] StandbyServer.java:249 Binding was successful 19:17:09.344 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 73924484-dfbf-48aa-be10-0459b02713aa for current head 19:17:09.344 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:64572 is allowed 19:17:09.344 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:17:09.344 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.344 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.344 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 2fcb2704-dff0-4928-a2c9-039b92df069d.0000000c to client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.344 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:09.344 DEBUG [standby-run-50] StandbyClientSyncExecution.java:103 Found missing segment 2fcb2704-dff0-4928-a2c9-039b92df069d 19:17:09.344 DEBUG [standby-run-50] StandbyClientSyncExecution.java:124 Inspecting segment 2fcb2704-dff0-4928-a2c9-039b92df069d 19:17:09.359 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 73924484-dfbf-48aa-be10-0459b02713aa for references of segment 2fcb2704-dff0-4928-a2c9-039b92df069d 19:17:09.359 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:17:09.359 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 2fcb2704-dff0-4928-a2c9-039b92df069d for client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.359 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 2fcb2704-dff0-4928-a2c9-039b92df069d to client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.359 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:09.359 DEBUG [standby-run-50] StandbyClientSyncExecution.java:184 Found reference from 2fcb2704-dff0-4928-a2c9-039b92df069d to 919662d7-868b-45aa-afe0-54e72a0d10fa 19:17:09.359 DEBUG [standby-run-50] StandbyClientSyncExecution.java:124 Inspecting segment 919662d7-868b-45aa-afe0-54e72a0d10fa 19:17:09.359 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 73924484-dfbf-48aa-be10-0459b02713aa for references of segment 919662d7-868b-45aa-afe0-54e72a0d10fa 19:17:09.359 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:17:09.359 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 919662d7-868b-45aa-afe0-54e72a0d10fa for client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.359 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 919662d7-868b-45aa-afe0-54e72a0d10fa to client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.359 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:09.359 INFO [standby-run-50] StandbyClientSyncExecution.java:196 Copying data segment 919662d7-868b-45aa-afe0-54e72a0d10fa from primary 19:17:09.359 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 73924484-dfbf-48aa-be10-0459b02713aa for segment 919662d7-868b-45aa-afe0-54e72a0d10fa 19:17:09.359 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 19:17:09.359 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.359 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 919662d7-868b-45aa-afe0-54e72a0d10fa for client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.359 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.359 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 919662d7-868b-45aa-afe0-54e72a0d10fa to client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.359 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:09.359 INFO [standby-run-50] StandbyClientSyncExecution.java:196 Copying data segment 2fcb2704-dff0-4928-a2c9-039b92df069d from primary 19:17:09.359 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 73924484-dfbf-48aa-be10-0459b02713aa for segment 2fcb2704-dff0-4928-a2c9-039b92df069d 19:17:09.375 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 19:17:09.375 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.375 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 2fcb2704-dff0-4928-a2c9-039b92df069d for client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.375 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.375 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 2fcb2704-dff0-4928-a2c9-039b92df069d to client 73924484-dfbf-48aa-be10-0459b02713aa 19:17:09.375 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:09.490 INFO [standby-run-50] StandbyClientSyncExecution.java:82 updated head state successfully: true in 146ms. 19:17:09.490 DEBUG [standby-run-50] StandbyClient.java:157 Channel closed 19:17:11.729 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:11.729 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:11.729 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:11.729 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:17:11.729 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:17:11.760 INFO [main] DataStoreTestBase.java:132 Test end: testSync 19:17:11.791 INFO [main] FileStore.java:466 TarMK closed: target\junit6986213828820737458\junit1109115438970616105 19:17:11.829 INFO [main] FileStore.java:466 TarMK closed: target\junit6986213828820737458\junit5871023299073381844 19:17:11.845 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6449027387015509771\junit5853869049318715050, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:11.845 INFO [main] FileStore.java:240 TarMK opened: target\junit6449027387015509771\junit5853869049318715050 (mmap=false) 19:17:11.845 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6449027387015509771\junit5467510656490915650, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:11.845 INFO [main] FileStore.java:240 TarMK opened: target\junit6449027387015509771\junit5467510656490915650 (mmap=false) 19:17:11.845 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByteChange2 19:17:11.845 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 19:17:11.845 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 19:17:12.076 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x41e097de]' 19:17:12.091 DEBUG [main] StandbyServer.java:249 Binding was successful 19:17:12.192 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 9b5935e0-6394-4722-9269-28c09d415de4 for current head 19:17:12.244 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:64661 is allowed 19:17:12.244 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:17:12.244 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 360d2cec-d1f2-4ff7-ac69-372c2c45d952.0000000c to client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:12.244 DEBUG [standby-run-51] StandbyClientSyncExecution.java:103 Found missing segment 360d2cec-d1f2-4ff7-ac69-372c2c45d952 19:17:12.244 DEBUG [standby-run-51] StandbyClientSyncExecution.java:124 Inspecting segment 360d2cec-d1f2-4ff7-ac69-372c2c45d952 19:17:12.244 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 9b5935e0-6394-4722-9269-28c09d415de4 for references of segment 360d2cec-d1f2-4ff7-ac69-372c2c45d952 19:17:12.244 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:17:12.244 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 360d2cec-d1f2-4ff7-ac69-372c2c45d952 for client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 360d2cec-d1f2-4ff7-ac69-372c2c45d952 to client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:12.244 DEBUG [standby-run-51] StandbyClientSyncExecution.java:184 Found reference from 360d2cec-d1f2-4ff7-ac69-372c2c45d952 to 8b4315a6-c508-4899-a1e5-f703d772d14b 19:17:12.244 DEBUG [standby-run-51] StandbyClientSyncExecution.java:124 Inspecting segment 8b4315a6-c508-4899-a1e5-f703d772d14b 19:17:12.244 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 9b5935e0-6394-4722-9269-28c09d415de4 for references of segment 8b4315a6-c508-4899-a1e5-f703d772d14b 19:17:12.244 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:17:12.244 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 8b4315a6-c508-4899-a1e5-f703d772d14b for client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 8b4315a6-c508-4899-a1e5-f703d772d14b to client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:12.244 INFO [standby-run-51] StandbyClientSyncExecution.java:196 Copying data segment 8b4315a6-c508-4899-a1e5-f703d772d14b from primary 19:17:12.244 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 9b5935e0-6394-4722-9269-28c09d415de4 for segment 8b4315a6-c508-4899-a1e5-f703d772d14b 19:17:12.244 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 19:17:12.244 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 8b4315a6-c508-4899-a1e5-f703d772d14b for client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 8b4315a6-c508-4899-a1e5-f703d772d14b to client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:12.244 INFO [standby-run-51] StandbyClientSyncExecution.java:196 Copying data segment 360d2cec-d1f2-4ff7-ac69-372c2c45d952 from primary 19:17:12.244 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 9b5935e0-6394-4722-9269-28c09d415de4 for segment 360d2cec-d1f2-4ff7-ac69-372c2c45d952 19:17:12.244 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 19:17:12.244 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 360d2cec-d1f2-4ff7-ac69-372c2c45d952 for client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 360d2cec-d1f2-4ff7-ac69-372c2c45d952 to client 9b5935e0-6394-4722-9269-28c09d415de4 19:17:12.244 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:12.344 INFO [standby-run-51] StandbyClientSyncExecution.java:82 updated head state successfully: true in 100ms. 19:17:12.344 DEBUG [standby-run-51] StandbyClient.java:157 Channel closed 19:17:14.678 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:14.862 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client e316ec0a-988a-4449-9be4-5113f6e3baa8 for current head 19:17:14.862 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:64681 is allowed 19:17:14.862 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 19:17:14.862 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client e316ec0a-988a-4449-9be4-5113f6e3baa8 19:17:14.862 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client e316ec0a-988a-4449-9be4-5113f6e3baa8 19:17:14.862 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 06a8700c-8eef-4613-a307-7a47fb55fdcf.00000006 to client e316ec0a-988a-4449-9be4-5113f6e3baa8 19:17:14.862 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:14.862 DEBUG [standby-run-52] StandbyClientSyncExecution.java:103 Found missing segment 06a8700c-8eef-4613-a307-7a47fb55fdcf 19:17:14.862 DEBUG [standby-run-52] StandbyClientSyncExecution.java:124 Inspecting segment 06a8700c-8eef-4613-a307-7a47fb55fdcf 19:17:14.862 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client e316ec0a-988a-4449-9be4-5113f6e3baa8 for references of segment 06a8700c-8eef-4613-a307-7a47fb55fdcf 19:17:14.862 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:14.862 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 06a8700c-8eef-4613-a307-7a47fb55fdcf for client e316ec0a-988a-4449-9be4-5113f6e3baa8 19:17:14.862 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 06a8700c-8eef-4613-a307-7a47fb55fdcf to client e316ec0a-988a-4449-9be4-5113f6e3baa8 19:17:14.862 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:14.862 INFO [standby-run-52] StandbyClientSyncExecution.java:196 Copying data segment 06a8700c-8eef-4613-a307-7a47fb55fdcf from primary 19:17:14.862 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client e316ec0a-988a-4449-9be4-5113f6e3baa8 for segment 06a8700c-8eef-4613-a307-7a47fb55fdcf 19:17:14.862 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:14.862 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client e316ec0a-988a-4449-9be4-5113f6e3baa8 19:17:14.862 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 06a8700c-8eef-4613-a307-7a47fb55fdcf for client e316ec0a-988a-4449-9be4-5113f6e3baa8 19:17:14.862 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client e316ec0a-988a-4449-9be4-5113f6e3baa8 19:17:14.862 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 06a8700c-8eef-4613-a307-7a47fb55fdcf to client e316ec0a-988a-4449-9be4-5113f6e3baa8 19:17:14.862 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:14.978 INFO [standby-run-52] StandbyClientSyncExecution.java:82 updated head state successfully: true in 116ms. 19:17:14.978 DEBUG [standby-run-52] StandbyClient.java:157 Channel closed 19:17:17.211 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:17.212 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:17.212 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:17.213 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:17:17.216 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:17:17.216 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByteChange2 19:17:17.247 INFO [main] FileStore.java:466 TarMK closed: target\junit6449027387015509771\junit5467510656490915650 19:17:17.278 INFO [main] FileStore.java:466 TarMK closed: target\junit6449027387015509771\junit5853869049318715050 19:17:17.310 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit1719527000899241384\junit1730117199101981612, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:17.314 INFO [main] FileStore.java:240 TarMK opened: target\junit1719527000899241384\junit1730117199101981612 (mmap=false) 19:17:17.316 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit1719527000899241384\junit2447847316190692614, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:17.316 INFO [main] FileStore.java:240 TarMK opened: target\junit1719527000899241384\junit2447847316190692614 (mmap=false) 19:17:17.316 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByteChange 19:17:17.316 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 19:17:17.316 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 19:17:17.564 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xa1a604fb]' 19:17:17.564 DEBUG [main] StandbyServer.java:249 Binding was successful 19:17:17.680 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 441ac896-54cf-4f4a-8e5c-902d2d3ba328 for current head 19:17:17.718 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:64770 is allowed 19:17:17.718 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:17:17.718 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 441ac896-54cf-4f4a-8e5c-902d2d3ba328 19:17:17.718 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 441ac896-54cf-4f4a-8e5c-902d2d3ba328 19:17:17.718 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 034a8c23-9ac0-4bc9-a930-0d7e71708cd3.0000000c to client 441ac896-54cf-4f4a-8e5c-902d2d3ba328 19:17:17.718 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:17.718 DEBUG [standby-run-53] StandbyClientSyncExecution.java:103 Found missing segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 19:17:17.718 DEBUG [standby-run-53] StandbyClientSyncExecution.java:124 Inspecting segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 19:17:17.718 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 441ac896-54cf-4f4a-8e5c-902d2d3ba328 for references of segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 19:17:17.718 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:17:17.718 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 for client 441ac896-54cf-4f4a-8e5c-902d2d3ba328 19:17:17.733 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 to client 441ac896-54cf-4f4a-8e5c-902d2d3ba328 19:17:17.733 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 441ac896-54cf-4f4a-8e5c-902d2d3ba328 io.netty.handler.codec.compression.DecompressionException: mismatching checksum: a282bf09 (expected: ae43e652) at io.netty.handler.codec.compression.Snappy.validateChecksum(Snappy.java:640) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.compression.SnappyFrameDecoder.decode(SnappyFrameDecoder.java:181) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:489) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:428) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1342) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:934) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 19:17:22.732 DEBUG [standby-run-53] StandbyClient.java:157 Channel closed 19:17:22.732 ERROR [standby-run-53] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxyFlippedIntermediateByteChange(DataStoreTestBase.java:321) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 19:17:24.964 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:25.234 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client ea7fa277-9570-412a-bb12-f857c99aaa58 for current head 19:17:25.234 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:64794 is allowed 19:17:25.234 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 19:17:25.234 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head a0c014bf-1380-4918-ae01-94a495d8a233.00000006 to client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:25.234 DEBUG [standby-run-54] StandbyClientSyncExecution.java:103 Found missing segment a0c014bf-1380-4918-ae01-94a495d8a233 19:17:25.234 DEBUG [standby-run-54] StandbyClientSyncExecution.java:124 Inspecting segment a0c014bf-1380-4918-ae01-94a495d8a233 19:17:25.234 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client ea7fa277-9570-412a-bb12-f857c99aaa58 for references of segment a0c014bf-1380-4918-ae01-94a495d8a233 19:17:25.234 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:25.234 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment a0c014bf-1380-4918-ae01-94a495d8a233 for client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment a0c014bf-1380-4918-ae01-94a495d8a233 to client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:25.234 DEBUG [standby-run-54] StandbyClientSyncExecution.java:184 Found reference from a0c014bf-1380-4918-ae01-94a495d8a233 to 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 19:17:25.234 DEBUG [standby-run-54] StandbyClientSyncExecution.java:184 Found reference from a0c014bf-1380-4918-ae01-94a495d8a233 to 055039b4-3776-418b-ac27-d34e1aa5cc92 19:17:25.234 DEBUG [standby-run-54] StandbyClientSyncExecution.java:124 Inspecting segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 19:17:25.234 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client ea7fa277-9570-412a-bb12-f857c99aaa58 for references of segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 19:17:25.234 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:25.234 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 for client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 to client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:25.234 DEBUG [standby-run-54] StandbyClientSyncExecution.java:124 Inspecting segment 055039b4-3776-418b-ac27-d34e1aa5cc92 19:17:25.234 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client ea7fa277-9570-412a-bb12-f857c99aaa58 for references of segment 055039b4-3776-418b-ac27-d34e1aa5cc92 19:17:25.234 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:25.234 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 055039b4-3776-418b-ac27-d34e1aa5cc92 for client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 055039b4-3776-418b-ac27-d34e1aa5cc92 to client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:25.234 INFO [standby-run-54] StandbyClientSyncExecution.java:196 Copying data segment 055039b4-3776-418b-ac27-d34e1aa5cc92 from primary 19:17:25.234 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client ea7fa277-9570-412a-bb12-f857c99aaa58 for segment 055039b4-3776-418b-ac27-d34e1aa5cc92 19:17:25.234 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:25.234 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 055039b4-3776-418b-ac27-d34e1aa5cc92 for client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 055039b4-3776-418b-ac27-d34e1aa5cc92 to client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:25.234 INFO [standby-run-54] StandbyClientSyncExecution.java:196 Copying data segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 from primary 19:17:25.234 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client ea7fa277-9570-412a-bb12-f857c99aaa58 for segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 19:17:25.234 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:25.234 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 for client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.234 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 034a8c23-9ac0-4bc9-a930-0d7e71708cd3 to client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.249 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:25.249 INFO [standby-run-54] StandbyClientSyncExecution.java:196 Copying data segment a0c014bf-1380-4918-ae01-94a495d8a233 from primary 19:17:25.249 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client ea7fa277-9570-412a-bb12-f857c99aaa58 for segment a0c014bf-1380-4918-ae01-94a495d8a233 19:17:25.249 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:25.249 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.249 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment a0c014bf-1380-4918-ae01-94a495d8a233 for client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.249 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.249 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment a0c014bf-1380-4918-ae01-94a495d8a233 to client ea7fa277-9570-412a-bb12-f857c99aaa58 19:17:25.249 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:25.418 INFO [standby-run-54] StandbyClientSyncExecution.java:82 updated head state successfully: true in 184ms. 19:17:25.418 DEBUG [standby-run-54] StandbyClient.java:157 Channel closed 19:17:27.654 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:27.654 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:27.654 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:27.654 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:17:27.654 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:17:27.670 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByteChange 19:17:27.721 INFO [main] FileStore.java:466 TarMK closed: target\junit1719527000899241384\junit2447847316190692614 19:17:27.739 INFO [main] FileStore.java:466 TarMK closed: target\junit1719527000899241384\junit1730117199101981612 19:17:27.755 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit9178135048163210568\junit7215177196274206241, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:27.755 INFO [main] FileStore.java:240 TarMK opened: target\junit9178135048163210568\junit7215177196274206241 (mmap=false) 19:17:27.770 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit9178135048163210568\junit3311066232740111034, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:27.770 INFO [main] FileStore.java:240 TarMK opened: target\junit9178135048163210568\junit3311066232740111034 (mmap=false) 19:17:27.770 INFO [main] DataStoreTestBase.java:127 Test begin: testProxySkippedBytesIntermediateChange 19:17:27.770 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 19:17:27.770 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 19:17:28.023 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xaadfefd7]' 19:17:28.039 DEBUG [main] StandbyServer.java:249 Binding was successful 19:17:28.155 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 2176d42f-6a21-4676-9b64-1b3a8629a5eb for current head 19:17:28.202 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:64883 is allowed 19:17:28.202 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:17:28.202 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 2176d42f-6a21-4676-9b64-1b3a8629a5eb 19:17:28.202 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 2176d42f-6a21-4676-9b64-1b3a8629a5eb 19:17:28.202 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 7d2a0f62-09f2-4943-a664-de04dc8d0df2.0000000c to client 2176d42f-6a21-4676-9b64-1b3a8629a5eb 19:17:28.202 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:28.202 DEBUG [standby-run-55] StandbyClientSyncExecution.java:103 Found missing segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 19:17:28.202 DEBUG [standby-run-55] StandbyClientSyncExecution.java:124 Inspecting segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 19:17:28.202 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 2176d42f-6a21-4676-9b64-1b3a8629a5eb for references of segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 19:17:28.202 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:17:28.202 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 for client 2176d42f-6a21-4676-9b64-1b3a8629a5eb 19:17:28.202 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 to client 2176d42f-6a21-4676-9b64-1b3a8629a5eb 19:17:33.222 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 2176d42f-6a21-4676-9b64-1b3a8629a5eb io.netty.handler.timeout.ReadTimeoutException: null 19:17:33.224 DEBUG [standby-run-55] StandbyClient.java:157 Channel closed 19:17:33.227 ERROR [standby-run-55] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxySkippedBytesIntermediateChange(DataStoreTestBase.java:301) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 19:17:35.463 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:35.648 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 04423621-6557-406d-8e69-e497b6bd1bab for current head 19:17:35.648 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:64907 is allowed 19:17:35.648 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 19:17:35.648 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.648 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.648 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 8bf63198-2a64-48de-a96e-23297f0afb7a.00000006 to client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.648 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:35.648 DEBUG [standby-run-56] StandbyClientSyncExecution.java:103 Found missing segment 8bf63198-2a64-48de-a96e-23297f0afb7a 19:17:35.648 DEBUG [standby-run-56] StandbyClientSyncExecution.java:124 Inspecting segment 8bf63198-2a64-48de-a96e-23297f0afb7a 19:17:35.648 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 04423621-6557-406d-8e69-e497b6bd1bab for references of segment 8bf63198-2a64-48de-a96e-23297f0afb7a 19:17:35.648 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:35.648 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 8bf63198-2a64-48de-a96e-23297f0afb7a for client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.648 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 8bf63198-2a64-48de-a96e-23297f0afb7a to client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.648 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:35.648 DEBUG [standby-run-56] StandbyClientSyncExecution.java:184 Found reference from 8bf63198-2a64-48de-a96e-23297f0afb7a to 7d2a0f62-09f2-4943-a664-de04dc8d0df2 19:17:35.648 DEBUG [standby-run-56] StandbyClientSyncExecution.java:184 Found reference from 8bf63198-2a64-48de-a96e-23297f0afb7a to 38ad12e8-3eca-4e02-a06d-a23186cad770 19:17:35.648 DEBUG [standby-run-56] StandbyClientSyncExecution.java:124 Inspecting segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 19:17:35.648 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 04423621-6557-406d-8e69-e497b6bd1bab for references of segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 19:17:35.648 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:35.648 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 for client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.648 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 to client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.648 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:35.648 DEBUG [standby-run-56] StandbyClientSyncExecution.java:124 Inspecting segment 38ad12e8-3eca-4e02-a06d-a23186cad770 19:17:35.648 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 04423621-6557-406d-8e69-e497b6bd1bab for references of segment 38ad12e8-3eca-4e02-a06d-a23186cad770 19:17:35.664 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:35.664 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 38ad12e8-3eca-4e02-a06d-a23186cad770 for client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 38ad12e8-3eca-4e02-a06d-a23186cad770 to client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:35.664 INFO [standby-run-56] StandbyClientSyncExecution.java:196 Copying data segment 38ad12e8-3eca-4e02-a06d-a23186cad770 from primary 19:17:35.664 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 04423621-6557-406d-8e69-e497b6bd1bab for segment 38ad12e8-3eca-4e02-a06d-a23186cad770 19:17:35.664 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:35.664 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 38ad12e8-3eca-4e02-a06d-a23186cad770 for client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 38ad12e8-3eca-4e02-a06d-a23186cad770 to client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:35.664 INFO [standby-run-56] StandbyClientSyncExecution.java:196 Copying data segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 from primary 19:17:35.664 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 04423621-6557-406d-8e69-e497b6bd1bab for segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 19:17:35.664 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:35.664 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 for client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 7d2a0f62-09f2-4943-a664-de04dc8d0df2 to client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:35.664 INFO [standby-run-56] StandbyClientSyncExecution.java:196 Copying data segment 8bf63198-2a64-48de-a96e-23297f0afb7a from primary 19:17:35.664 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 04423621-6557-406d-8e69-e497b6bd1bab for segment 8bf63198-2a64-48de-a96e-23297f0afb7a 19:17:35.664 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:35.664 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 8bf63198-2a64-48de-a96e-23297f0afb7a for client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 8bf63198-2a64-48de-a96e-23297f0afb7a to client 04423621-6557-406d-8e69-e497b6bd1bab 19:17:35.664 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:35.763 INFO [standby-run-56] StandbyClientSyncExecution.java:82 updated head state successfully: true in 115ms. 19:17:35.763 DEBUG [standby-run-56] StandbyClient.java:157 Channel closed 19:17:37.980 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:37.980 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:37.980 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:37.980 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:17:37.980 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:17:37.996 INFO [main] DataStoreTestBase.java:132 Test end: testProxySkippedBytesIntermediateChange 19:17:38.033 INFO [main] FileStore.java:466 TarMK closed: target\junit9178135048163210568\junit3311066232740111034 19:17:38.065 INFO [main] FileStore.java:466 TarMK closed: target\junit9178135048163210568\junit7215177196274206241 19:17:38.080 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit2775008413444400687\junit6816603922370339421, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:38.080 INFO [main] FileStore.java:240 TarMK opened: target\junit2775008413444400687\junit6816603922370339421 (mmap=false) 19:17:38.149 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit2775008413444400687\junit3790155493268022671, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:38.149 INFO [main] FileStore.java:240 TarMK opened: target\junit2775008413444400687\junit3790155493268022671 (mmap=false) 19:17:38.181 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByte 19:17:38.181 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 19:17:38.181 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 19:17:38.434 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x5ab37c78]' 19:17:38.450 DEBUG [main] StandbyServer.java:249 Binding was successful 19:17:38.550 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 75855fc9-87f1-448d-a3e7-5f85852ef9d0 for current head 19:17:38.597 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:64996 is allowed 19:17:38.597 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:17:38.597 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 75855fc9-87f1-448d-a3e7-5f85852ef9d0 19:17:38.597 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 75855fc9-87f1-448d-a3e7-5f85852ef9d0 19:17:38.597 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head c05cae78-1e80-4485-aaca-851b6dd78d37.0000000c to client 75855fc9-87f1-448d-a3e7-5f85852ef9d0 19:17:38.597 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:38.597 DEBUG [standby-run-57] StandbyClientSyncExecution.java:103 Found missing segment c05cae78-1e80-4485-aaca-851b6dd78d37 19:17:38.597 DEBUG [standby-run-57] StandbyClientSyncExecution.java:124 Inspecting segment c05cae78-1e80-4485-aaca-851b6dd78d37 19:17:38.597 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 75855fc9-87f1-448d-a3e7-5f85852ef9d0 for references of segment c05cae78-1e80-4485-aaca-851b6dd78d37 19:17:38.597 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:17:38.597 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment c05cae78-1e80-4485-aaca-851b6dd78d37 for client 75855fc9-87f1-448d-a3e7-5f85852ef9d0 19:17:38.597 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment c05cae78-1e80-4485-aaca-851b6dd78d37 to client 75855fc9-87f1-448d-a3e7-5f85852ef9d0 19:17:38.597 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 75855fc9-87f1-448d-a3e7-5f85852ef9d0 io.netty.handler.codec.compression.DecompressionException: mismatching checksum: a282dd85 (expected: 2377c8be) at io.netty.handler.codec.compression.Snappy.validateChecksum(Snappy.java:640) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.compression.SnappyFrameDecoder.decode(SnappyFrameDecoder.java:181) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:489) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:428) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1342) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:934) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 19:17:43.613 DEBUG [standby-run-57] StandbyClient.java:157 Channel closed 19:17:43.613 ERROR [standby-run-57] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment c05cae78-1e80-4485-aaca-851b6dd78d37 from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxyFlippedIntermediateByte(DataStoreTestBase.java:311) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 19:17:45.831 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:45.882 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d for current head 19:17:45.882 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:65020 is allowed 19:17:45.882 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 19:17:45.882 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head c05cae78-1e80-4485-aaca-851b6dd78d37.0000000c to client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:45.882 DEBUG [standby-run-58] StandbyClientSyncExecution.java:103 Found missing segment c05cae78-1e80-4485-aaca-851b6dd78d37 19:17:45.882 DEBUG [standby-run-58] StandbyClientSyncExecution.java:124 Inspecting segment c05cae78-1e80-4485-aaca-851b6dd78d37 19:17:45.882 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d for references of segment c05cae78-1e80-4485-aaca-851b6dd78d37 19:17:45.882 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:45.882 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment c05cae78-1e80-4485-aaca-851b6dd78d37 for client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment c05cae78-1e80-4485-aaca-851b6dd78d37 to client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:45.882 DEBUG [standby-run-58] StandbyClientSyncExecution.java:184 Found reference from c05cae78-1e80-4485-aaca-851b6dd78d37 to c4eb74dc-448f-4da6-a648-a759b0d56650 19:17:45.882 DEBUG [standby-run-58] StandbyClientSyncExecution.java:124 Inspecting segment c4eb74dc-448f-4da6-a648-a759b0d56650 19:17:45.882 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d for references of segment c4eb74dc-448f-4da6-a648-a759b0d56650 19:17:45.882 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:17:45.882 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment c4eb74dc-448f-4da6-a648-a759b0d56650 for client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment c4eb74dc-448f-4da6-a648-a759b0d56650 to client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:45.882 INFO [standby-run-58] StandbyClientSyncExecution.java:196 Copying data segment c4eb74dc-448f-4da6-a648-a759b0d56650 from primary 19:17:45.882 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d for segment c4eb74dc-448f-4da6-a648-a759b0d56650 19:17:45.882 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:45.882 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment c4eb74dc-448f-4da6-a648-a759b0d56650 for client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment c4eb74dc-448f-4da6-a648-a759b0d56650 to client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:45.882 INFO [standby-run-58] StandbyClientSyncExecution.java:196 Copying data segment c05cae78-1e80-4485-aaca-851b6dd78d37 from primary 19:17:45.882 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d for segment c05cae78-1e80-4485-aaca-851b6dd78d37 19:17:45.882 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:17:45.882 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment c05cae78-1e80-4485-aaca-851b6dd78d37 for client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment c05cae78-1e80-4485-aaca-851b6dd78d37 to client d3ad2c7c-50f3-4332-85c3-f9d8ae62503d 19:17:45.882 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:46.013 INFO [standby-run-58] StandbyClientSyncExecution.java:82 updated head state successfully: true in 131ms. 19:17:46.013 DEBUG [standby-run-58] StandbyClient.java:157 Channel closed 19:17:48.266 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:48.266 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:48.266 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:48.266 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:17:48.281 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:17:48.281 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByte 19:17:48.313 INFO [main] FileStore.java:466 TarMK closed: target\junit2775008413444400687\junit3790155493268022671 19:17:48.351 INFO [main] FileStore.java:466 TarMK closed: target\junit2775008413444400687\junit6816603922370339421 19:17:48.367 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit7254137767275646298\junit1868896064309307449, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:48.367 INFO [main] FileStore.java:240 TarMK opened: target\junit7254137767275646298\junit1868896064309307449 (mmap=false) 19:17:48.367 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit7254137767275646298\junit9206488976699335269, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:48.367 INFO [main] FileStore.java:240 TarMK opened: target\junit7254137767275646298\junit9206488976699335269 (mmap=false) 19:17:48.382 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByte2 19:17:48.382 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 19:17:48.382 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 19:17:48.713 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xea7ca5a7]' 19:17:48.730 DEBUG [main] StandbyServer.java:249 Binding was successful 19:17:48.835 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 901ee02e-7456-4f9b-b3a9-366aafadbb81 for current head 19:17:48.867 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:65109 is allowed 19:17:48.867 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:17:48.867 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.867 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.867 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 1dd6e341-126b-48a3-acee-3c3cbac33e5e.0000000c to client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.867 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:48.867 DEBUG [standby-run-59] StandbyClientSyncExecution.java:103 Found missing segment 1dd6e341-126b-48a3-acee-3c3cbac33e5e 19:17:48.867 DEBUG [standby-run-59] StandbyClientSyncExecution.java:124 Inspecting segment 1dd6e341-126b-48a3-acee-3c3cbac33e5e 19:17:48.867 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 901ee02e-7456-4f9b-b3a9-366aafadbb81 for references of segment 1dd6e341-126b-48a3-acee-3c3cbac33e5e 19:17:48.867 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:17:48.867 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 1dd6e341-126b-48a3-acee-3c3cbac33e5e for client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.867 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 1dd6e341-126b-48a3-acee-3c3cbac33e5e to client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.867 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:48.867 DEBUG [standby-run-59] StandbyClientSyncExecution.java:184 Found reference from 1dd6e341-126b-48a3-acee-3c3cbac33e5e to 71acce9a-017f-43ad-a936-80b7b0beb5c1 19:17:48.867 DEBUG [standby-run-59] StandbyClientSyncExecution.java:124 Inspecting segment 71acce9a-017f-43ad-a936-80b7b0beb5c1 19:17:48.867 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 901ee02e-7456-4f9b-b3a9-366aafadbb81 for references of segment 71acce9a-017f-43ad-a936-80b7b0beb5c1 19:17:48.867 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:17:48.867 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 71acce9a-017f-43ad-a936-80b7b0beb5c1 for client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.867 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 71acce9a-017f-43ad-a936-80b7b0beb5c1 to client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.867 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:17:48.867 INFO [standby-run-59] StandbyClientSyncExecution.java:196 Copying data segment 71acce9a-017f-43ad-a936-80b7b0beb5c1 from primary 19:17:48.867 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 901ee02e-7456-4f9b-b3a9-366aafadbb81 for segment 71acce9a-017f-43ad-a936-80b7b0beb5c1 19:17:48.867 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 19:17:48.867 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.867 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 71acce9a-017f-43ad-a936-80b7b0beb5c1 for client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.867 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.867 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 71acce9a-017f-43ad-a936-80b7b0beb5c1 to client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.882 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:48.882 INFO [standby-run-59] StandbyClientSyncExecution.java:196 Copying data segment 1dd6e341-126b-48a3-acee-3c3cbac33e5e from primary 19:17:48.882 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 901ee02e-7456-4f9b-b3a9-366aafadbb81 for segment 1dd6e341-126b-48a3-acee-3c3cbac33e5e 19:17:48.882 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 19:17:48.882 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.882 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 1dd6e341-126b-48a3-acee-3c3cbac33e5e for client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.882 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.882 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 1dd6e341-126b-48a3-acee-3c3cbac33e5e to client 901ee02e-7456-4f9b-b3a9-366aafadbb81 19:17:48.882 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:17:49.051 INFO [standby-run-59] StandbyClientSyncExecution.java:82 updated head state successfully: true in 184ms. 19:17:49.051 DEBUG [standby-run-59] StandbyClient.java:157 Channel closed 19:17:51.282 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:51.313 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client ef1fab22-aed1-47c1-8b88-36e579dd04d6 for current head 19:17:51.313 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:65128 is allowed 19:17:51.313 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 19:17:51.313 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client ef1fab22-aed1-47c1-8b88-36e579dd04d6 19:17:51.329 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client ef1fab22-aed1-47c1-8b88-36e579dd04d6 19:17:51.330 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 1dd6e341-126b-48a3-acee-3c3cbac33e5e.0000000c to client ef1fab22-aed1-47c1-8b88-36e579dd04d6 19:17:51.330 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:17:51.331 DEBUG [standby-run-60] StandbyClient.java:157 Channel closed 19:17:53.566 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:17:53.566 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:53.566 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:17:53.566 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:17:53.566 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:17:53.598 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByte2 19:17:53.636 INFO [main] FileStore.java:466 TarMK closed: target\junit7254137767275646298\junit9206488976699335269 19:17:53.652 INFO [main] FileStore.java:466 TarMK closed: target\junit7254137767275646298\junit1868896064309307449 19:17:53.683 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit5299906676324041004\junit3066970118201851040, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:53.683 INFO [main] FileStore.java:240 TarMK opened: target\junit5299906676324041004\junit3066970118201851040 (mmap=false) 19:17:53.683 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit5299906676324041004\junit8111805920366510707, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:17:53.683 INFO [main] FileStore.java:240 TarMK opened: target\junit5299906676324041004\junit8111805920366510707 (mmap=false) 19:17:53.683 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedStartByte 19:17:53.683 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 19:17:53.683 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 19:17:53.983 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xb695f604]' 19:17:53.983 DEBUG [main] StandbyServer.java:249 Binding was successful 19:17:54.099 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 216183cb-6a7f-4f33-8f40-079b2e032a6d for current head 19:17:54.136 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:65217 is allowed 19:17:54.136 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:17:54.136 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 216183cb-6a7f-4f33-8f40-079b2e032a6d 19:17:54.136 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 216183cb-6a7f-4f33-8f40-079b2e032a6d 19:17:54.136 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head e4ce9c61-bc90-4992-a8ad-48cd870540f0.0000000c to client 216183cb-6a7f-4f33-8f40-079b2e032a6d 19:17:54.136 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 216183cb-6a7f-4f33-8f40-079b2e032a6d io.netty.handler.codec.compression.DecompressionException: Received COMPRESSED_DATA tag before STREAM_IDENTIFIER at io.netty.handler.codec.compression.SnappyFrameDecoder.decode(SnappyFrameDecoder.java:162) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:489) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:428) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1342) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:934) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 19:17:59.117 ERROR [standby-run-61] StandbyClientSyncExecution.java:67 Unable to fetch remote head 19:17:59.117 DEBUG [standby-run-61] StandbyClient.java:157 Channel closed 19:18:01.370 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:18:01.439 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client ab75b013-486a-4fad-9804-f177c6e5039b for current head 19:18:01.439 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:65241 is allowed 19:18:01.439 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 19:18:01.439 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.439 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.439 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head e4ce9c61-bc90-4992-a8ad-48cd870540f0.0000000c to client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.439 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:18:01.439 DEBUG [standby-run-62] StandbyClientSyncExecution.java:103 Found missing segment e4ce9c61-bc90-4992-a8ad-48cd870540f0 19:18:01.439 DEBUG [standby-run-62] StandbyClientSyncExecution.java:124 Inspecting segment e4ce9c61-bc90-4992-a8ad-48cd870540f0 19:18:01.439 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client ab75b013-486a-4fad-9804-f177c6e5039b for references of segment e4ce9c61-bc90-4992-a8ad-48cd870540f0 19:18:01.439 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:18:01.439 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment e4ce9c61-bc90-4992-a8ad-48cd870540f0 for client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.439 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment e4ce9c61-bc90-4992-a8ad-48cd870540f0 to client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.439 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:18:01.439 DEBUG [standby-run-62] StandbyClientSyncExecution.java:184 Found reference from e4ce9c61-bc90-4992-a8ad-48cd870540f0 to 36c29d78-a300-41bb-a474-73f460fc8228 19:18:01.439 DEBUG [standby-run-62] StandbyClientSyncExecution.java:124 Inspecting segment 36c29d78-a300-41bb-a474-73f460fc8228 19:18:01.439 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client ab75b013-486a-4fad-9804-f177c6e5039b for references of segment 36c29d78-a300-41bb-a474-73f460fc8228 19:18:01.439 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 19:18:01.439 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 36c29d78-a300-41bb-a474-73f460fc8228 for client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.439 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 36c29d78-a300-41bb-a474-73f460fc8228 to client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.439 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:18:01.439 INFO [standby-run-62] StandbyClientSyncExecution.java:196 Copying data segment 36c29d78-a300-41bb-a474-73f460fc8228 from primary 19:18:01.439 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client ab75b013-486a-4fad-9804-f177c6e5039b for segment 36c29d78-a300-41bb-a474-73f460fc8228 19:18:01.439 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:18:01.439 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.439 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 36c29d78-a300-41bb-a474-73f460fc8228 for client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.439 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.439 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 36c29d78-a300-41bb-a474-73f460fc8228 to client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.439 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:18:01.439 INFO [standby-run-62] StandbyClientSyncExecution.java:196 Copying data segment e4ce9c61-bc90-4992-a8ad-48cd870540f0 from primary 19:18:01.454 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client ab75b013-486a-4fad-9804-f177c6e5039b for segment e4ce9c61-bc90-4992-a8ad-48cd870540f0 19:18:01.454 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 19:18:01.454 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.454 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment e4ce9c61-bc90-4992-a8ad-48cd870540f0 for client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.454 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.454 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment e4ce9c61-bc90-4992-a8ad-48cd870540f0 to client ab75b013-486a-4fad-9804-f177c6e5039b 19:18:01.454 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:18:01.539 INFO [standby-run-62] StandbyClientSyncExecution.java:82 updated head state successfully: true in 100ms. 19:18:01.539 DEBUG [standby-run-62] StandbyClient.java:157 Channel closed 19:18:03.786 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:18:03.786 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:18:03.786 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:18:03.786 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:18:03.786 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:18:03.817 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedStartByte 19:18:03.855 INFO [main] FileStore.java:466 TarMK closed: target\junit5299906676324041004\junit8111805920366510707 19:18:03.871 INFO [main] FileStore.java:466 TarMK closed: target\junit5299906676324041004\junit3066970118201851040 19:18:03.902 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6369944932320784419\junit1620842939437791512, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:18:03.902 INFO [main] FileStore.java:240 TarMK opened: target\junit6369944932320784419\junit1620842939437791512 (mmap=false) 19:18:03.902 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6369944932320784419\junit4159681836836511519, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 19:18:03.918 INFO [main] FileStore.java:240 TarMK opened: target\junit6369944932320784419\junit4159681836836511519 (mmap=false) 19:18:03.918 INFO [main] DataStoreTestBase.java:127 Test begin: testSyncBigBlob 19:18:03.918 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 19:18:03.918 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 19:18:28.270 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xa79623b1]' 19:18:28.270 DEBUG [main] StandbyServer.java:249 Binding was successful 19:18:28.270 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 2561f179-97b6-4459-bd66-6fa8f3c0f672 for current head 19:18:28.270 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:65305 is allowed 19:18:28.270 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 19:18:28.270 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 2561f179-97b6-4459-bd66-6fa8f3c0f672 19:18:28.270 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 2561f179-97b6-4459-bd66-6fa8f3c0f672 19:18:28.404 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 392c90c7-82ef-4aee-aadc-c2eafe7f9be0.00000005 to client 2561f179-97b6-4459-bd66-6fa8f3c0f672 19:18:28.404 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 19:18:28.404 DEBUG [standby-run-63] StandbyClientSyncExecution.java:103 Found missing segment 392c90c7-82ef-4aee-aadc-c2eafe7f9be0 19:18:28.404 DEBUG [standby-run-63] StandbyClientSyncExecution.java:124 Inspecting segment 392c90c7-82ef-4aee-aadc-c2eafe7f9be0 19:18:28.404 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 2561f179-97b6-4459-bd66-6fa8f3c0f672 for references of segment 392c90c7-82ef-4aee-aadc-c2eafe7f9be0 19:18:28.404 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 19:18:28.404 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 392c90c7-82ef-4aee-aadc-c2eafe7f9be0 for client 2561f179-97b6-4459-bd66-6fa8f3c0f672 19:18:28.438 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 392c90c7-82ef-4aee-aadc-c2eafe7f9be0 to client 2561f179-97b6-4459-bd66-6fa8f3c0f672 19:18:28.438 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 19:18:28.438 INFO [standby-run-63] StandbyClientSyncExecution.java:196 Copying data segment 392c90c7-82ef-4aee-aadc-c2eafe7f9be0 from primary 19:18:28.438 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 2561f179-97b6-4459-bd66-6fa8f3c0f672 for segment 392c90c7-82ef-4aee-aadc-c2eafe7f9be0 19:18:28.438 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 19:18:28.438 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 2561f179-97b6-4459-bd66-6fa8f3c0f672 19:18:28.438 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 392c90c7-82ef-4aee-aadc-c2eafe7f9be0 for client 2561f179-97b6-4459-bd66-6fa8f3c0f672 19:18:28.438 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 2561f179-97b6-4459-bd66-6fa8f3c0f672 19:18:28.438 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 392c90c7-82ef-4aee-aadc-c2eafe7f9be0 to client 2561f179-97b6-4459-bd66-6fa8f3c0f672 19:18:28.454 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 19:18:29.018 INFO [standby-run-63] StandbyClientSyncExecution.java:82 updated head state successfully: true in 614ms. 19:18:29.018 DEBUG [standby-run-63] StandbyClient.java:157 Channel closed 19:18:31.256 DEBUG [main] StandbyClientSync.java:277 Group shut down 19:18:31.256 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:18:31.256 DEBUG [main] StandbyServer.java:220 Channel disconnected 19:18:31.256 DEBUG [main] StandbyServer.java:231 Boss group shut down 19:18:31.256 DEBUG [main] StandbyServer.java:237 Worker group shut down 19:18:31.256 INFO [main] DataStoreTestBase.java:132 Test end: testSyncBigBlob 19:18:31.319 INFO [main] FileStore.java:466 TarMK closed: target\junit6369944932320784419\junit4159681836836511519 19:18:31.356 INFO [main] FileStore.java:466 TarMK closed: target\junit6369944932320784419\junit1620842939437791512