14:24:43.052 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit4669236914621397056\junit5801250995232964476, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:24:43.068 INFO [main] FileStore.java:240 TarMK opened: target\junit4669236914621397056\junit5801250995232964476 (mmap=false) 14:24:43.068 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit4669236914621397056\junit5801250995232964476\data00000a.tar} 14:24:43.068 DEBUG [main] TarWriter.java:185 Writing segment c4defdeb-4f02-4055-a48c-6f9a70ffe3b9 to target\junit4669236914621397056\junit5801250995232964476\data00000a.tar 14:24:43.068 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit4669236914621397056\junit7877534638865831933, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:24:43.068 INFO [main] FileStore.java:240 TarMK opened: target\junit4669236914621397056\junit7877534638865831933 (mmap=false) 14:24:43.068 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit4669236914621397056\junit7877534638865831933\data00000a.tar} 14:24:43.068 DEBUG [main] TarWriter.java:185 Writing segment 97bdd21e-661f-4336-a1ea-1ca81d95f17a to target\junit4669236914621397056\junit7877534638865831933\data00000a.tar 14:24:43.068 INFO [main] DataStoreTestBase.java:127 Test begin: testSyncFailingDueToTooShortTimeout 14:24:43.068 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:24:43.068 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:24:43.221 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x5358ac95]' 14:24:43.221 DEBUG [main] StandbyServer.java:249 Binding was successful 14:24:43.221 DEBUG [main] TarWriter.java:185 Writing segment de8771e5-3344-411c-a0e0-955afae2e830 to target\junit4669236914621397056\junit5801250995232964476\data00000a.tar 14:24:43.290 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> de8771e5-3344-411c-a0e0-955afae2e830.0000000c 14:24:43.406 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c for current head 14:24:43.406 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:65281 is allowed 14:24:43.406 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:24:43.406 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.406 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.406 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head de8771e5-3344-411c-a0e0-955afae2e830.0000000c to client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.406 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:24:43.406 DEBUG [standby-run-23] StandbyClientSyncExecution.java:103 Found missing segment de8771e5-3344-411c-a0e0-955afae2e830 14:24:43.406 DEBUG [standby-run-23] StandbyClientSyncExecution.java:124 Inspecting segment de8771e5-3344-411c-a0e0-955afae2e830 14:24:43.406 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c for references of segment de8771e5-3344-411c-a0e0-955afae2e830 14:24:43.406 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:24:43.406 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment de8771e5-3344-411c-a0e0-955afae2e830 for client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment de8771e5-3344-411c-a0e0-955afae2e830 to client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:24:43.421 DEBUG [standby-run-23] StandbyClientSyncExecution.java:184 Found reference from de8771e5-3344-411c-a0e0-955afae2e830 to c4defdeb-4f02-4055-a48c-6f9a70ffe3b9 14:24:43.421 DEBUG [standby-run-23] StandbyClientSyncExecution.java:124 Inspecting segment c4defdeb-4f02-4055-a48c-6f9a70ffe3b9 14:24:43.421 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c for references of segment c4defdeb-4f02-4055-a48c-6f9a70ffe3b9 14:24:43.421 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:24:43.421 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment c4defdeb-4f02-4055-a48c-6f9a70ffe3b9 for client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment c4defdeb-4f02-4055-a48c-6f9a70ffe3b9 to client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:24:43.421 INFO [standby-run-23] StandbyClientSyncExecution.java:196 Copying data segment c4defdeb-4f02-4055-a48c-6f9a70ffe3b9 from primary 14:24:43.421 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c for segment c4defdeb-4f02-4055-a48c-6f9a70ffe3b9 14:24:43.421 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:24:43.421 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment c4defdeb-4f02-4055-a48c-6f9a70ffe3b9 for client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment c4defdeb-4f02-4055-a48c-6f9a70ffe3b9 to client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:24:43.421 DEBUG [standby-run-23] TarWriter.java:185 Writing segment c4defdeb-4f02-4055-a48c-6f9a70ffe3b9 to target\junit4669236914621397056\junit7877534638865831933\data00000a.tar 14:24:43.421 INFO [standby-run-23] StandbyClientSyncExecution.java:196 Copying data segment de8771e5-3344-411c-a0e0-955afae2e830 from primary 14:24:43.421 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c for segment de8771e5-3344-411c-a0e0-955afae2e830 14:24:43.421 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:24:43.421 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment de8771e5-3344-411c-a0e0-955afae2e830 for client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment de8771e5-3344-411c-a0e0-955afae2e830 to client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:24:43.421 DEBUG [standby-run-23] TarWriter.java:185 Writing segment de8771e5-3344-411c-a0e0-955afae2e830 to target\junit4669236914621397056\junit7877534638865831933\data00000a.tar 14:24:43.421 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c for blob 1253eeb576abc98e36b4928d422a0f96608faade32181d62d0a05dd0c95e255f#5242880 14:24:43.421 DEBUG [primary-1] RequestDecoder.java:39 Parsed 'get blob' request 14:24:43.421 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get blob id' received from client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [primary-1] GetBlobRequestHandler.java:41 Reading blob 1253eeb576abc98e36b4928d422a0f96608faade32181d62d0a05dd0c95e255f#5242880 for client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [primary-1] CommunicationObserver.java:130 Binary with size 5242880 sent to client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.421 DEBUG [primary-1] GetBlobResponseEncoder.java:41 Sending blob 1253eeb576abc98e36b4928d422a0f96608faade32181d62d0a05dd0c95e255f#5242880 to client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.453 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 1/5 of size 1048576 from blob 1253eeb576abc98e36b4928d422a0f96608faade32181d62d0a05dd0c95e255f#5242880 to client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.490 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:24:43.490 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 1/5 of size 1048576 from blob 1253eeb576abc98e36b4928d422a0f96608faade32181d62d0a05dd0c95e255f#5242880 14:24:43.506 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\1253eeb576abc98e36b4928d422a0f96608faade32181d62d0a05dd0c95e255f#5242880.tmp 14:24:43.506 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 2/5 of size 1048576 from blob 1253eeb576abc98e36b4928d422a0f96608faade32181d62d0a05dd0c95e255f#5242880 to client 249c0dc0-2dfe-43c3-89bf-00f3539aaa7c 14:24:43.506 DEBUG [standby-run-23] StandbyClient.java:157 Channel closed 14:24:43.506 ERROR [standby-run-23] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to load remote blob 1253eeb576abc98e36b4928d422a0f96608faade32181d62d0a05dd0c95e255f#5242880 at /root/server/#testBlob in 60ms. Please increase the timeout and try again. at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchAndStoreBlob(StandbyDiff.java:208) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchBinary(StandbyDiff.java:196) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchBinary(StandbyDiff.java:181) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchBinary(StandbyDiff.java:169) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.diff(StandbyDiff.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.process(StandbyDiff.java:121) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.childNodeAdded(StandbyDiff.java:94) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.CancelableDiff.childNodeAdded(CancelableDiff.java:76) ~[oak-segment-tar-1.8-SNAPSHOT.jar:na] at org.apache.jackrabbit.oak.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:562) ~[oak-segment-tar-1.8-SNAPSHOT.jar:na] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.diff(StandbyDiff.java:143) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.process(StandbyDiff.java:121) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.childNodeChanged(StandbyDiff.java:105) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:566) ~[oak-segment-tar-1.8-SNAPSHOT.jar:na] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:101) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.ExternalPrivateStoreIT.testSyncFailingDueToTooShortTimeout(ExternalPrivateStoreIT.java:86) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 14:24:45.752 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:24:45.752 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:24:45.752 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:24:45.752 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:24:45.752 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:24:45.752 INFO [main] DataStoreTestBase.java:132 Test end: testSyncFailingDueToTooShortTimeout 14:24:45.752 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:24:46.090 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 97bdd21e-661f-4336-a1ea-1ca81d95f17a.00000005 14:24:46.305 INFO [main] FileStore.java:467 TarMK closed: target\junit4669236914621397056\junit7877534638865831933 14:24:46.305 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:24:46.305 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:24:46.352 INFO [main] FileStore.java:467 TarMK closed: target\junit4669236914621397056\junit5801250995232964476 14:24:46.367 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6007879511514440861\junit1780837987861591080, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:24:46.385 INFO [main] FileStore.java:240 TarMK opened: target\junit6007879511514440861\junit1780837987861591080 (mmap=false) 14:24:46.385 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit6007879511514440861\junit1780837987861591080\data00000a.tar} 14:24:46.386 DEBUG [main] TarWriter.java:185 Writing segment 05cac76e-f82c-4140-aff6-84db052766d0 to target\junit6007879511514440861\junit1780837987861591080\data00000a.tar 14:24:46.520 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6007879511514440861\junit1381122769695936861, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:24:46.536 INFO [main] FileStore.java:240 TarMK opened: target\junit6007879511514440861\junit1381122769695936861 (mmap=false) 14:24:46.536 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit6007879511514440861\junit1381122769695936861\data00000a.tar} 14:24:46.536 DEBUG [main] TarWriter.java:185 Writing segment 940e2e29-e4ee-498a-a625-576c3928a90c to target\junit6007879511514440861\junit1381122769695936861\data00000a.tar 14:24:46.536 INFO [main] DataStoreTestBase.java:127 Test begin: testResilientSync 14:24:46.536 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:24:46.536 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:24:46.706 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xdd580806]' 14:24:46.706 DEBUG [main] StandbyServer.java:249 Binding was successful 14:24:46.706 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 9ae5299b-cd7d-4986-aa6b-5f6c6762a670 for current head 14:24:46.721 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:65321 is allowed 14:24:46.721 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:24:46.721 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 9ae5299b-cd7d-4986-aa6b-5f6c6762a670 14:24:46.721 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 9ae5299b-cd7d-4986-aa6b-5f6c6762a670 14:24:50.721 ERROR [standby-run-24] StandbyClientSyncExecution.java:67 Unable to fetch remote head 14:24:50.721 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 9ae5299b-cd7d-4986-aa6b-5f6c6762a670 io.netty.handler.timeout.ReadTimeoutException: null 14:24:50.723 DEBUG [standby-run-24] StandbyClient.java:157 Channel closed 14:24:51.386 DEBUG [TarMK flush [target\junit6007879511514440861\junit1780837987861591080]] TarWriter.java:185 Writing segment 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee to target\junit6007879511514440861\junit1780837987861591080\data00000a.tar 14:24:51.522 DEBUG [TarMK flush [target\junit6007879511514440861\junit1780837987861591080]] TarRevisions.java:220 TarMK journal update null -> 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee.0000000c 14:24:51.618 DEBUG [TarMK flush [target\junit6007879511514440861\junit1381122769695936861]] TarRevisions.java:220 TarMK journal update null -> 940e2e29-e4ee-498a-a625-576c3928a90c.00000005 14:24:51.745 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee.0000000c to client 9ae5299b-cd7d-4986-aa6b-5f6c6762a670 14:24:51.745 WARN [primary-1] ExceptionHandler.java:31 Exception caught on the server java.io.IOException: Eine bestehende Verbindung wurde softwaregesteuert durch den Hostcomputer abgebrochen at sun.nio.ch.SocketDispatcher.read0(Native Method) ~[na:1.8.0_151] at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43) ~[na:1.8.0_151] at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) ~[na:1.8.0_151] at sun.nio.ch.IOUtil.read(IOUtil.java:192) ~[na:1.8.0_151] at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) ~[na:1.8.0_151] at io.netty.buffer.PooledUnsafeDirectByteBuf.setBytes(PooledUnsafeDirectByteBuf.java:288) ~[netty-buffer-4.1.14.Final.jar:4.1.14.Final] at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1106) ~[netty-buffer-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:372) ~[netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:123) ~[netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 14:24:52.955 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:24:52.955 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:24:52.955 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:24:52.955 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:24:52.955 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:24:53.071 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x54eb9f09]' 14:24:53.071 DEBUG [main] StandbyServer.java:249 Binding was successful 14:24:53.087 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e for current head 14:24:53.087 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:65362 is allowed 14:24:53.087 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:24:53.087 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.087 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.087 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee.0000000c to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.087 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:24:53.087 DEBUG [standby-run-25] StandbyClientSyncExecution.java:103 Found missing segment 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee 14:24:53.087 DEBUG [standby-run-25] StandbyClientSyncExecution.java:124 Inspecting segment 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee 14:24:53.087 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e for references of segment 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee 14:24:53.087 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:24:53.087 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee for client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.087 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.087 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:24:53.087 DEBUG [standby-run-25] StandbyClientSyncExecution.java:184 Found reference from 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee to 05cac76e-f82c-4140-aff6-84db052766d0 14:24:53.087 DEBUG [standby-run-25] StandbyClientSyncExecution.java:124 Inspecting segment 05cac76e-f82c-4140-aff6-84db052766d0 14:24:53.087 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e for references of segment 05cac76e-f82c-4140-aff6-84db052766d0 14:24:53.087 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:24:53.087 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 05cac76e-f82c-4140-aff6-84db052766d0 for client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.087 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 05cac76e-f82c-4140-aff6-84db052766d0 to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.087 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:24:53.087 INFO [standby-run-25] StandbyClientSyncExecution.java:196 Copying data segment 05cac76e-f82c-4140-aff6-84db052766d0 from primary 14:24:53.103 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e for segment 05cac76e-f82c-4140-aff6-84db052766d0 14:24:53.103 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:24:53.103 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.103 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 05cac76e-f82c-4140-aff6-84db052766d0 for client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.104 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.104 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 05cac76e-f82c-4140-aff6-84db052766d0 to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.104 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:24:53.104 DEBUG [standby-run-25] TarWriter.java:185 Writing segment 05cac76e-f82c-4140-aff6-84db052766d0 to target\junit6007879511514440861\junit1381122769695936861\data00000a.tar 14:24:53.105 INFO [standby-run-25] StandbyClientSyncExecution.java:196 Copying data segment 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee from primary 14:24:53.105 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e for segment 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee 14:24:53.105 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:24:53.106 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.106 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee for client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.106 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.106 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.107 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:24:53.109 DEBUG [standby-run-25] TarWriter.java:185 Writing segment 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee to target\junit6007879511514440861\junit1381122769695936861\data00000a.tar 14:24:53.109 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e for blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 14:24:53.109 DEBUG [primary-1] RequestDecoder.java:39 Parsed 'get blob' request 14:24:53.109 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get blob id' received from client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.109 DEBUG [primary-1] GetBlobRequestHandler.java:41 Reading blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 for client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.109 DEBUG [primary-1] CommunicationObserver.java:130 Binary with size 5242880 sent to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.109 DEBUG [primary-1] GetBlobResponseEncoder.java:41 Sending blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.109 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 1/5 of size 1048576 from blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.172 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:24:53.172 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 1/5 of size 1048576 from blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 14:24:53.187 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 2/5 of size 1048576 from blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.187 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880.tmp 14:24:53.225 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:24:53.225 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 2/5 of size 1048576 from blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 14:24:53.241 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880.tmp 14:24:53.241 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 3/5 of size 1048576 from blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.288 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:24:53.288 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 3/5 of size 1048576 from blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 14:24:53.288 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880.tmp 14:24:53.288 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 4/5 of size 1048576 from blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.339 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:24:53.339 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 4/5 of size 1048576 from blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 14:24:53.343 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880.tmp 14:24:53.343 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 5/5 of size 1048576 from blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 to client 53a6e76f-65e8-4ef6-90f1-ae7242b25b8e 14:24:53.387 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:24:53.387 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 5/5 of size 1048576 from blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 14:24:53.390 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880.tmp 14:24:53.398 DEBUG [standby-1] ResponseDecoder.java:167 Received entire blob 1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880 14:24:53.477 DEBUG [standby-run-25] ResponseDecoder.java:66 Processing input stream finished! Deleting file C:\tmp\1d35168f03dabebe6ddc0bce02a8c7e463f4aa29e2a13889d72f91b1ad4536c9#5242880.tmp 14:24:53.524 DEBUG [standby-run-25] TarRevisions.java:220 TarMK journal update 940e2e29-e4ee-498a-a625-576c3928a90c.00000005 -> 0c94c5e0-b68d-4f19-a025-1d24b12ae6ee.0000000c 14:24:53.587 INFO [standby-run-25] StandbyClientSyncExecution.java:82 updated head state successfully: true in 500ms. 14:24:53.587 DEBUG [standby-run-25] StandbyClient.java:157 Channel closed 14:24:55.805 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:24:55.806 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:24:55.806 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:24:55.807 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:24:55.810 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:24:55.811 INFO [main] DataStoreTestBase.java:132 Test end: testResilientSync 14:24:55.811 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:24:55.811 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:24:55.858 INFO [main] FileStore.java:467 TarMK closed: target\junit6007879511514440861\junit1381122769695936861 14:24:55.858 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:24:55.858 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:24:55.911 INFO [main] FileStore.java:467 TarMK closed: target\junit6007879511514440861\junit1780837987861591080 14:24:55.942 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit3502336843077002896\junit6831714462259643530, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:24:55.942 INFO [main] FileStore.java:240 TarMK opened: target\junit3502336843077002896\junit6831714462259643530 (mmap=false) 14:24:55.942 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit3502336843077002896\junit6831714462259643530\data00000a.tar} 14:24:55.942 DEBUG [main] TarWriter.java:185 Writing segment 2243ef99-fc94-4d29-a9fd-47b6780c2426 to target\junit3502336843077002896\junit6831714462259643530\data00000a.tar 14:24:55.942 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit3502336843077002896\junit8180274434440055709, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:24:55.942 INFO [main] FileStore.java:240 TarMK opened: target\junit3502336843077002896\junit8180274434440055709 (mmap=false) 14:24:55.942 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit3502336843077002896\junit8180274434440055709\data00000a.tar} 14:24:55.942 DEBUG [main] TarWriter.java:185 Writing segment 81cbabad-9648-45aa-a9c8-46aec53c0792 to target\junit3502336843077002896\junit8180274434440055709\data00000a.tar 14:24:55.989 INFO [main] DataStoreTestBase.java:127 Test begin: testProxySkippedBytes 14:24:55.989 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:24:55.989 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:24:56.058 DEBUG [main] TarWriter.java:185 Writing segment 819206a9-378d-42cd-acf8-8604e1cb794d to target\junit3502336843077002896\junit6831714462259643530\data00000a.tar 14:24:56.411 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 819206a9-378d-42cd-acf8-8604e1cb794d.0000000c 14:24:56.644 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x09af981f]' 14:24:56.644 DEBUG [main] StandbyServer.java:249 Binding was successful 14:24:56.744 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 29e9d740-fb7e-45fb-885f-f806c9d026bc for current head 14:24:56.791 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:65452 is allowed 14:24:56.791 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:24:56.791 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 29e9d740-fb7e-45fb-885f-f806c9d026bc 14:24:56.791 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 29e9d740-fb7e-45fb-885f-f806c9d026bc 14:24:56.791 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 819206a9-378d-42cd-acf8-8604e1cb794d.0000000c to client 29e9d740-fb7e-45fb-885f-f806c9d026bc 14:24:56.791 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:24:56.791 DEBUG [standby-run-26] StandbyClientSyncExecution.java:103 Found missing segment 819206a9-378d-42cd-acf8-8604e1cb794d 14:24:56.791 DEBUG [standby-run-26] StandbyClientSyncExecution.java:124 Inspecting segment 819206a9-378d-42cd-acf8-8604e1cb794d 14:24:56.791 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 29e9d740-fb7e-45fb-885f-f806c9d026bc for references of segment 819206a9-378d-42cd-acf8-8604e1cb794d 14:24:56.791 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:24:56.791 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 819206a9-378d-42cd-acf8-8604e1cb794d for client 29e9d740-fb7e-45fb-885f-f806c9d026bc 14:24:56.807 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 819206a9-378d-42cd-acf8-8604e1cb794d to client 29e9d740-fb7e-45fb-885f-f806c9d026bc 14:25:00.951 DEBUG [TarMK flush [target\junit3502336843077002896\junit6831714462259643530]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:00.997 DEBUG [TarMK flush [target\junit3502336843077002896\junit8180274434440055709]] TarRevisions.java:220 TarMK journal update null -> 81cbabad-9648-45aa-a9c8-46aec53c0792.00000005 14:25:01.813 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 29e9d740-fb7e-45fb-885f-f806c9d026bc io.netty.handler.timeout.ReadTimeoutException: null 14:25:01.816 DEBUG [standby-run-26] StandbyClient.java:157 Channel closed 14:25:01.818 ERROR [standby-run-26] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment 819206a9-378d-42cd-acf8-8604e1cb794d from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxySkippedBytes(DataStoreTestBase.java:296) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 14:25:04.153 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:04.200 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef for current head 14:25:04.200 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:65476 is allowed 14:25:04.200 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:25:04.200 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.200 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.200 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 819206a9-378d-42cd-acf8-8604e1cb794d.0000000c to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.200 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:04.200 DEBUG [standby-run-27] StandbyClientSyncExecution.java:103 Found missing segment 819206a9-378d-42cd-acf8-8604e1cb794d 14:25:04.200 DEBUG [standby-run-27] StandbyClientSyncExecution.java:124 Inspecting segment 819206a9-378d-42cd-acf8-8604e1cb794d 14:25:04.200 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef for references of segment 819206a9-378d-42cd-acf8-8604e1cb794d 14:25:04.200 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:04.200 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 819206a9-378d-42cd-acf8-8604e1cb794d for client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.200 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 819206a9-378d-42cd-acf8-8604e1cb794d to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.200 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:04.200 DEBUG [standby-run-27] StandbyClientSyncExecution.java:184 Found reference from 819206a9-378d-42cd-acf8-8604e1cb794d to 2243ef99-fc94-4d29-a9fd-47b6780c2426 14:25:04.200 DEBUG [standby-run-27] StandbyClientSyncExecution.java:124 Inspecting segment 2243ef99-fc94-4d29-a9fd-47b6780c2426 14:25:04.215 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef for references of segment 2243ef99-fc94-4d29-a9fd-47b6780c2426 14:25:04.216 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:04.216 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 2243ef99-fc94-4d29-a9fd-47b6780c2426 for client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.216 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 2243ef99-fc94-4d29-a9fd-47b6780c2426 to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.217 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:04.217 INFO [standby-run-27] StandbyClientSyncExecution.java:196 Copying data segment 2243ef99-fc94-4d29-a9fd-47b6780c2426 from primary 14:25:04.217 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef for segment 2243ef99-fc94-4d29-a9fd-47b6780c2426 14:25:04.218 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:04.218 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.218 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 2243ef99-fc94-4d29-a9fd-47b6780c2426 for client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.218 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.218 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 2243ef99-fc94-4d29-a9fd-47b6780c2426 to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.219 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:04.219 DEBUG [standby-run-27] TarWriter.java:185 Writing segment 2243ef99-fc94-4d29-a9fd-47b6780c2426 to target\junit3502336843077002896\junit8180274434440055709\data00000a.tar 14:25:04.219 INFO [standby-run-27] StandbyClientSyncExecution.java:196 Copying data segment 819206a9-378d-42cd-acf8-8604e1cb794d from primary 14:25:04.220 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef for segment 819206a9-378d-42cd-acf8-8604e1cb794d 14:25:04.220 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:04.220 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.220 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 819206a9-378d-42cd-acf8-8604e1cb794d for client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.220 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.221 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 819206a9-378d-42cd-acf8-8604e1cb794d to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.221 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:04.221 DEBUG [standby-run-27] TarWriter.java:185 Writing segment 819206a9-378d-42cd-acf8-8604e1cb794d to target\junit3502336843077002896\junit8180274434440055709\data00000a.tar 14:25:04.221 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef for blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 14:25:04.221 DEBUG [primary-2] RequestDecoder.java:39 Parsed 'get blob' request 14:25:04.221 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get blob id' received from client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.221 DEBUG [primary-2] GetBlobRequestHandler.java:41 Reading blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 for client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.221 DEBUG [primary-2] CommunicationObserver.java:130 Binary with size 5242880 sent to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.221 DEBUG [primary-2] GetBlobResponseEncoder.java:41 Sending blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.221 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 1/5 of size 1048576 from blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.268 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:04.268 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 1/5 of size 1048576 from blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 14:25:04.268 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 2/5 of size 1048576 from blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.268 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880.tmp 14:25:04.300 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:04.300 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 2/5 of size 1048576 from blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 14:25:04.316 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880.tmp 14:25:04.317 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 3/5 of size 1048576 from blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.353 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:04.353 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 3/5 of size 1048576 from blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 14:25:04.353 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880.tmp 14:25:04.353 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 4/5 of size 1048576 from blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.400 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:04.400 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 4/5 of size 1048576 from blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 14:25:04.416 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880.tmp 14:25:04.416 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 5/5 of size 1048576 from blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 to client a647dfa8-3d80-4ae2-a965-5ffb349bf9ef 14:25:04.460 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:04.460 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 5/5 of size 1048576 from blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 14:25:04.463 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880.tmp 14:25:04.473 DEBUG [standby-1] ResponseDecoder.java:167 Received entire blob 2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880 14:25:04.556 DEBUG [standby-run-27] ResponseDecoder.java:66 Processing input stream finished! Deleting file C:\tmp\2950ee39bd0c637b10f6e79f5646abd714878d37c6f11101084fbef1c2cccd1f#5242880.tmp 14:25:04.668 DEBUG [standby-run-27] TarRevisions.java:220 TarMK journal update 81cbabad-9648-45aa-a9c8-46aec53c0792.00000005 -> 819206a9-378d-42cd-acf8-8604e1cb794d.0000000c 14:25:04.752 INFO [standby-run-27] StandbyClientSyncExecution.java:82 updated head state successfully: true in 552ms. 14:25:04.752 DEBUG [standby-run-27] StandbyClient.java:157 Channel closed 14:25:05.953 DEBUG [TarMK flush [target\junit3502336843077002896\junit6831714462259643530]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:05.969 DEBUG [TarMK flush [target\junit3502336843077002896\junit8180274434440055709]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:06.985 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:06.986 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:06.987 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:06.988 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:25:06.990 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:25:07.006 INFO [main] DataStoreTestBase.java:132 Test end: testProxySkippedBytes 14:25:07.006 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:07.006 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:07.037 INFO [main] FileStore.java:467 TarMK closed: target\junit3502336843077002896\junit8180274434440055709 14:25:07.037 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:07.037 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:07.106 INFO [main] FileStore.java:467 TarMK closed: target\junit3502336843077002896\junit6831714462259643530 14:25:07.122 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit1985247368444761193\junit4489441777165922243, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:07.122 INFO [main] FileStore.java:240 TarMK opened: target\junit1985247368444761193\junit4489441777165922243 (mmap=false) 14:25:07.122 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit1985247368444761193\junit4489441777165922243\data00000a.tar} 14:25:07.122 DEBUG [main] TarWriter.java:185 Writing segment 5f22fdd5-e604-4a2c-a352-a37a15b2de34 to target\junit1985247368444761193\junit4489441777165922243\data00000a.tar 14:25:07.421 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit1985247368444761193\junit4578865375769105512, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:07.421 INFO [main] FileStore.java:240 TarMK opened: target\junit1985247368444761193\junit4578865375769105512 (mmap=false) 14:25:07.421 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit1985247368444761193\junit4578865375769105512\data00000a.tar} 14:25:07.421 DEBUG [main] TarWriter.java:185 Writing segment 58436ed2-fd6a-4b2b-a5b1-b9c9e4b3182b to target\junit1985247368444761193\junit4578865375769105512\data00000a.tar 14:25:07.421 INFO [main] DataStoreTestBase.java:127 Test begin: testSyncUpdatedBinaryProperty 14:25:07.421 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:25:07.421 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:25:07.522 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x6c211b5f]' 14:25:07.522 DEBUG [main] StandbyServer.java:249 Binding was successful 14:25:07.590 DEBUG [main] TarWriter.java:185 Writing segment a6eccaf5-78dd-438c-a5de-9d2c24c2f664 to target\junit1985247368444761193\junit4489441777165922243\data00000a.tar 14:25:07.653 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> a6eccaf5-78dd-438c-a5de-9d2c24c2f664.0000000c 14:25:07.738 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client d99a0063-5933-4584-ab08-4ac89ba65879 for current head 14:25:07.738 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:65516 is allowed 14:25:07.738 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:25:07.738 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.738 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.738 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head a6eccaf5-78dd-438c-a5de-9d2c24c2f664.0000000c to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.738 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:07.738 DEBUG [standby-run-28] StandbyClientSyncExecution.java:103 Found missing segment a6eccaf5-78dd-438c-a5de-9d2c24c2f664 14:25:07.738 DEBUG [standby-run-28] StandbyClientSyncExecution.java:124 Inspecting segment a6eccaf5-78dd-438c-a5de-9d2c24c2f664 14:25:07.738 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client d99a0063-5933-4584-ab08-4ac89ba65879 for references of segment a6eccaf5-78dd-438c-a5de-9d2c24c2f664 14:25:07.738 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:25:07.738 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment a6eccaf5-78dd-438c-a5de-9d2c24c2f664 for client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.738 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment a6eccaf5-78dd-438c-a5de-9d2c24c2f664 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.738 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:07.738 DEBUG [standby-run-28] StandbyClientSyncExecution.java:184 Found reference from a6eccaf5-78dd-438c-a5de-9d2c24c2f664 to 5f22fdd5-e604-4a2c-a352-a37a15b2de34 14:25:07.738 DEBUG [standby-run-28] StandbyClientSyncExecution.java:124 Inspecting segment 5f22fdd5-e604-4a2c-a352-a37a15b2de34 14:25:07.738 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client d99a0063-5933-4584-ab08-4ac89ba65879 for references of segment 5f22fdd5-e604-4a2c-a352-a37a15b2de34 14:25:07.738 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:25:07.738 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 5f22fdd5-e604-4a2c-a352-a37a15b2de34 for client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.738 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 5f22fdd5-e604-4a2c-a352-a37a15b2de34 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.738 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:07.738 INFO [standby-run-28] StandbyClientSyncExecution.java:196 Copying data segment 5f22fdd5-e604-4a2c-a352-a37a15b2de34 from primary 14:25:07.738 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client d99a0063-5933-4584-ab08-4ac89ba65879 for segment 5f22fdd5-e604-4a2c-a352-a37a15b2de34 14:25:07.738 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:25:07.738 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.738 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 5f22fdd5-e604-4a2c-a352-a37a15b2de34 for client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.738 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.738 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 5f22fdd5-e604-4a2c-a352-a37a15b2de34 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.738 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:07.738 DEBUG [standby-run-28] TarWriter.java:185 Writing segment 5f22fdd5-e604-4a2c-a352-a37a15b2de34 to target\junit1985247368444761193\junit4578865375769105512\data00000a.tar 14:25:07.738 INFO [standby-run-28] StandbyClientSyncExecution.java:196 Copying data segment a6eccaf5-78dd-438c-a5de-9d2c24c2f664 from primary 14:25:07.753 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client d99a0063-5933-4584-ab08-4ac89ba65879 for segment a6eccaf5-78dd-438c-a5de-9d2c24c2f664 14:25:07.753 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:25:07.753 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.753 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment a6eccaf5-78dd-438c-a5de-9d2c24c2f664 for client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.753 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.753 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment a6eccaf5-78dd-438c-a5de-9d2c24c2f664 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.753 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:07.753 DEBUG [standby-run-28] TarWriter.java:185 Writing segment a6eccaf5-78dd-438c-a5de-9d2c24c2f664 to target\junit1985247368444761193\junit4578865375769105512\data00000a.tar 14:25:07.753 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client d99a0063-5933-4584-ab08-4ac89ba65879 for blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 14:25:07.753 DEBUG [primary-1] RequestDecoder.java:39 Parsed 'get blob' request 14:25:07.753 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get blob id' received from client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.753 DEBUG [primary-1] GetBlobRequestHandler.java:41 Reading blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 for client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.753 DEBUG [primary-1] CommunicationObserver.java:130 Binary with size 5242880 sent to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.753 DEBUG [primary-1] GetBlobResponseEncoder.java:41 Sending blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.753 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 1/5 of size 1048576 from blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.794 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:07.794 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 1/5 of size 1048576 from blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 14:25:07.794 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880.tmp 14:25:07.794 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 2/5 of size 1048576 from blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.841 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:07.841 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 2/5 of size 1048576 from blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 14:25:07.841 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 3/5 of size 1048576 from blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.841 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880.tmp 14:25:07.889 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:07.889 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 3/5 of size 1048576 from blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 14:25:07.892 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880.tmp 14:25:07.898 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 4/5 of size 1048576 from blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.937 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:07.937 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 4/5 of size 1048576 from blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 14:25:07.940 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880.tmp 14:25:07.942 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 5/5 of size 1048576 from blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:07.981 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:07.982 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 5/5 of size 1048576 from blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 14:25:07.985 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880.tmp 14:25:07.992 DEBUG [standby-1] ResponseDecoder.java:167 Received entire blob 3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880 14:25:08.036 DEBUG [standby-run-28] ResponseDecoder.java:66 Processing input stream finished! Deleting file C:\tmp\3ec87350e73db9fda533d704fa40174baa3743c598deff1c3c0fe86f800375a8#5242880.tmp 14:25:08.135 DEBUG [standby-run-28] TarRevisions.java:220 TarMK journal update null -> a6eccaf5-78dd-438c-a5de-9d2c24c2f664.0000000c 14:25:08.235 INFO [standby-run-28] StandbyClientSyncExecution.java:82 updated head state successfully: true in 497ms. 14:25:08.235 DEBUG [standby-run-28] StandbyClient.java:157 Channel closed 14:25:08.313 DEBUG [main] TarWriter.java:185 Writing segment 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d to target\junit1985247368444761193\junit4489441777165922243\data00000a.tar 14:25:08.435 DEBUG [main] TarRevisions.java:220 TarMK journal update a6eccaf5-78dd-438c-a5de-9d2c24c2f664.0000000c -> 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d.00000006 14:25:08.551 DEBUG [standby-2] GetHeadRequestEncoder.java:33 Sending request from client d99a0063-5933-4584-ab08-4ac89ba65879 for current head 14:25:08.551 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:65517 is allowed 14:25:08.551 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:25:08.551 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.551 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.551 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d.00000006 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.551 DEBUG [standby-2] ResponseDecoder.java:82 Decoding 'get head' response 14:25:08.551 DEBUG [standby-run-29] StandbyClientSyncExecution.java:103 Found missing segment 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d 14:25:08.551 DEBUG [standby-run-29] StandbyClientSyncExecution.java:124 Inspecting segment 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d 14:25:08.551 DEBUG [standby-2] GetReferencesRequestEncoder.java:33 Sending request from client d99a0063-5933-4584-ab08-4ac89ba65879 for references of segment 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d 14:25:08.551 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:08.551 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d for client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.551 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.551 DEBUG [standby-2] ResponseDecoder.java:94 Decoding 'get references' response 14:25:08.551 INFO [standby-run-29] StandbyClientSyncExecution.java:196 Copying data segment 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d from primary 14:25:08.551 DEBUG [standby-2] GetSegmentRequestEncoder.java:33 Sending request from client d99a0063-5933-4584-ab08-4ac89ba65879 for segment 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d 14:25:08.551 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:08.551 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.551 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d for client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.551 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.551 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.551 DEBUG [standby-2] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:08.551 DEBUG [standby-run-29] TarWriter.java:185 Writing segment 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d to target\junit1985247368444761193\junit4578865375769105512\data00000a.tar 14:25:08.566 DEBUG [standby-2] GetBlobRequestEncoder.java:33 Sending request from client d99a0063-5933-4584-ab08-4ac89ba65879 for blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 14:25:08.566 DEBUG [primary-2] RequestDecoder.java:39 Parsed 'get blob' request 14:25:08.566 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get blob id' received from client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.566 DEBUG [primary-2] GetBlobRequestHandler.java:41 Reading blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 for client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.566 DEBUG [primary-2] CommunicationObserver.java:130 Binary with size 5242880 sent to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.566 DEBUG [primary-2] GetBlobResponseEncoder.java:41 Sending blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.566 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 1/5 of size 1048576 from blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.629 DEBUG [standby-2] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:08.630 DEBUG [standby-2] ResponseDecoder.java:150 Received chunk 1/5 of size 1048576 from blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 14:25:08.632 DEBUG [standby-2] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880.tmp 14:25:08.634 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 2/5 of size 1048576 from blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.667 DEBUG [standby-2] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:08.667 DEBUG [standby-2] ResponseDecoder.java:150 Received chunk 2/5 of size 1048576 from blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 14:25:08.667 DEBUG [standby-2] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880.tmp 14:25:08.667 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 3/5 of size 1048576 from blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.713 DEBUG [standby-2] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:08.713 DEBUG [standby-2] ResponseDecoder.java:150 Received chunk 3/5 of size 1048576 from blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 14:25:08.713 DEBUG [standby-2] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880.tmp 14:25:08.713 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 4/5 of size 1048576 from blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.736 DEBUG [standby-2] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:08.736 DEBUG [standby-2] ResponseDecoder.java:150 Received chunk 4/5 of size 1048576 from blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 14:25:08.736 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 5/5 of size 1048576 from blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 to client d99a0063-5933-4584-ab08-4ac89ba65879 14:25:08.736 DEBUG [standby-2] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880.tmp 14:25:08.767 DEBUG [standby-2] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:08.767 DEBUG [standby-2] ResponseDecoder.java:150 Received chunk 5/5 of size 1048576 from blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 14:25:08.767 DEBUG [standby-2] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880.tmp 14:25:08.782 DEBUG [standby-2] ResponseDecoder.java:167 Received entire blob f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880 14:25:08.851 DEBUG [standby-run-29] ResponseDecoder.java:66 Processing input stream finished! Deleting file C:\tmp\f763a2e49a6af4c8dde5362c5c30b9b57175b4a21f4bfa71bac8893a5e8cb739#5242880.tmp 14:25:08.914 DEBUG [standby-run-29] TarRevisions.java:220 TarMK journal update a6eccaf5-78dd-438c-a5de-9d2c24c2f664.0000000c -> 9b021d16-3a4e-4e01-aaa9-cf63d8c3af8d.00000006 14:25:08.999 INFO [standby-run-29] StandbyClientSyncExecution.java:82 updated head state successfully: true in 448ms. 14:25:08.999 DEBUG [standby-run-29] StandbyClient.java:157 Channel closed 14:25:11.332 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:11.333 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:11.334 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:11.335 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:25:11.337 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:25:11.337 INFO [main] DataStoreTestBase.java:132 Test end: testSyncUpdatedBinaryProperty 14:25:11.337 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:11.337 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:11.384 INFO [main] FileStore.java:467 TarMK closed: target\junit1985247368444761193\junit4578865375769105512 14:25:11.384 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:11.384 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:11.415 INFO [main] FileStore.java:467 TarMK closed: target\junit1985247368444761193\junit4489441777165922243 14:25:11.437 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit8090589386129022165\junit6645500259742478326, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:11.437 INFO [main] FileStore.java:240 TarMK opened: target\junit8090589386129022165\junit6645500259742478326 (mmap=false) 14:25:11.437 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit8090589386129022165\junit6645500259742478326\data00000a.tar} 14:25:11.437 DEBUG [main] TarWriter.java:185 Writing segment f27401a4-f7cd-4919-a02d-ff9d2a9ea9e5 to target\junit8090589386129022165\junit6645500259742478326\data00000a.tar 14:25:11.453 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit8090589386129022165\junit4374262141499614396, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:11.453 INFO [main] FileStore.java:240 TarMK opened: target\junit8090589386129022165\junit4374262141499614396 (mmap=false) 14:25:11.453 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit8090589386129022165\junit4374262141499614396\data00000a.tar} 14:25:11.453 DEBUG [main] TarWriter.java:185 Writing segment 34552aa0-a919-49d2-ac06-daf03d6f14e3 to target\junit8090589386129022165\junit4374262141499614396\data00000a.tar 14:25:11.453 INFO [main] DataStoreTestBase.java:127 Test begin: testSync 14:25:11.453 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:25:11.453 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:25:11.600 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x256d017a]' 14:25:11.600 DEBUG [main] StandbyServer.java:249 Binding was successful 14:25:11.600 DEBUG [main] TarWriter.java:185 Writing segment 357ca445-d39d-47b2-a273-867abddd6ae8 to target\junit8090589386129022165\junit6645500259742478326\data00000a.tar 14:25:11.784 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 357ca445-d39d-47b2-a273-867abddd6ae8.0000000c 14:25:11.915 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 for current head 14:25:11.915 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:49175 is allowed 14:25:11.915 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:25:11.915 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.915 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.931 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 357ca445-d39d-47b2-a273-867abddd6ae8.0000000c to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.931 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:11.932 DEBUG [standby-run-30] StandbyClientSyncExecution.java:103 Found missing segment 357ca445-d39d-47b2-a273-867abddd6ae8 14:25:11.932 DEBUG [standby-run-30] StandbyClientSyncExecution.java:124 Inspecting segment 357ca445-d39d-47b2-a273-867abddd6ae8 14:25:11.933 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 for references of segment 357ca445-d39d-47b2-a273-867abddd6ae8 14:25:11.933 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:25:11.933 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 357ca445-d39d-47b2-a273-867abddd6ae8 for client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.935 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 357ca445-d39d-47b2-a273-867abddd6ae8 to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.935 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:11.936 DEBUG [standby-run-30] StandbyClientSyncExecution.java:184 Found reference from 357ca445-d39d-47b2-a273-867abddd6ae8 to f27401a4-f7cd-4919-a02d-ff9d2a9ea9e5 14:25:11.936 DEBUG [standby-run-30] StandbyClientSyncExecution.java:124 Inspecting segment f27401a4-f7cd-4919-a02d-ff9d2a9ea9e5 14:25:11.936 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 for references of segment f27401a4-f7cd-4919-a02d-ff9d2a9ea9e5 14:25:11.937 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:25:11.937 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment f27401a4-f7cd-4919-a02d-ff9d2a9ea9e5 for client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment f27401a4-f7cd-4919-a02d-ff9d2a9ea9e5 to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:11.937 INFO [standby-run-30] StandbyClientSyncExecution.java:196 Copying data segment f27401a4-f7cd-4919-a02d-ff9d2a9ea9e5 from primary 14:25:11.937 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 for segment f27401a4-f7cd-4919-a02d-ff9d2a9ea9e5 14:25:11.937 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:25:11.937 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment f27401a4-f7cd-4919-a02d-ff9d2a9ea9e5 for client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment f27401a4-f7cd-4919-a02d-ff9d2a9ea9e5 to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:11.937 DEBUG [standby-run-30] TarWriter.java:185 Writing segment f27401a4-f7cd-4919-a02d-ff9d2a9ea9e5 to target\junit8090589386129022165\junit4374262141499614396\data00000a.tar 14:25:11.937 INFO [standby-run-30] StandbyClientSyncExecution.java:196 Copying data segment 357ca445-d39d-47b2-a273-867abddd6ae8 from primary 14:25:11.937 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 for segment 357ca445-d39d-47b2-a273-867abddd6ae8 14:25:11.937 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:25:11.937 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 357ca445-d39d-47b2-a273-867abddd6ae8 for client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 357ca445-d39d-47b2-a273-867abddd6ae8 to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:11.937 DEBUG [standby-run-30] TarWriter.java:185 Writing segment 357ca445-d39d-47b2-a273-867abddd6ae8 to target\junit8090589386129022165\junit4374262141499614396\data00000a.tar 14:25:11.937 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 for blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 14:25:11.937 DEBUG [primary-1] RequestDecoder.java:39 Parsed 'get blob' request 14:25:11.937 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get blob id' received from client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [primary-1] GetBlobRequestHandler.java:41 Reading blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 for client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [primary-1] CommunicationObserver.java:130 Binary with size 5242880 sent to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.937 DEBUG [primary-1] GetBlobResponseEncoder.java:41 Sending blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.953 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 1/5 of size 1048576 from blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:11.984 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:11.984 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 1/5 of size 1048576 from blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 14:25:11.984 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880.tmp 14:25:12.000 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 2/5 of size 1048576 from blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:12.038 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:12.038 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 2/5 of size 1048576 from blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 14:25:12.038 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880.tmp 14:25:12.038 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 3/5 of size 1048576 from blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:12.084 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:12.084 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 3/5 of size 1048576 from blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 14:25:12.084 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880.tmp 14:25:12.084 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 4/5 of size 1048576 from blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:12.134 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:12.135 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 4/5 of size 1048576 from blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 14:25:12.138 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880.tmp 14:25:12.138 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 5/5 of size 1048576 from blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 to client 978646d0-44f3-4756-a4c0-73ecf6cb1bc4 14:25:12.169 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:12.185 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 5/5 of size 1048576 from blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 14:25:12.185 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880.tmp 14:25:12.200 DEBUG [standby-1] ResponseDecoder.java:167 Received entire blob 2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880 14:25:12.301 DEBUG [standby-run-30] ResponseDecoder.java:66 Processing input stream finished! Deleting file C:\tmp\2df27888a708cb3d4cea616458e4938c86fd66038b8e1fae19acdc671daba2e9#5242880.tmp 14:25:12.539 DEBUG [standby-run-30] TarRevisions.java:220 TarMK journal update null -> 357ca445-d39d-47b2-a273-867abddd6ae8.0000000c 14:25:12.601 INFO [standby-run-30] StandbyClientSyncExecution.java:82 updated head state successfully: true in 669ms. 14:25:12.601 DEBUG [standby-run-30] StandbyClient.java:157 Channel closed 14:25:14.819 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:14.819 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:14.819 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:14.819 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:25:14.819 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:25:14.857 INFO [main] DataStoreTestBase.java:132 Test end: testSync 14:25:14.857 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:14.857 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:14.872 INFO [main] FileStore.java:467 TarMK closed: target\junit8090589386129022165\junit4374262141499614396 14:25:14.872 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:14.872 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:14.903 INFO [main] FileStore.java:467 TarMK closed: target\junit8090589386129022165\junit6645500259742478326 14:25:14.941 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit8973344500841027367\junit4053337186445340863, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:14.941 INFO [main] FileStore.java:240 TarMK opened: target\junit8973344500841027367\junit4053337186445340863 (mmap=false) 14:25:14.941 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit8973344500841027367\junit4053337186445340863\data00000a.tar} 14:25:14.941 DEBUG [main] TarWriter.java:185 Writing segment d8182e5c-c31c-4cbd-a8e8-0d5d27c49467 to target\junit8973344500841027367\junit4053337186445340863\data00000a.tar 14:25:14.941 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit8973344500841027367\junit8268548351748424386, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:14.941 INFO [main] FileStore.java:240 TarMK opened: target\junit8973344500841027367\junit8268548351748424386 (mmap=false) 14:25:14.941 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit8973344500841027367\junit8268548351748424386\data00000a.tar} 14:25:14.941 DEBUG [main] TarWriter.java:185 Writing segment d401deab-f565-4b69-aa94-9619a30a3ef2 to target\junit8973344500841027367\junit8268548351748424386\data00000a.tar 14:25:14.957 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByteChange2 14:25:14.957 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:25:14.957 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:25:15.019 DEBUG [main] TarWriter.java:185 Writing segment d5c6b74d-f1bd-4735-a463-f535e10f539f to target\junit8973344500841027367\junit4053337186445340863\data00000a.tar 14:25:15.057 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> d5c6b74d-f1bd-4735-a463-f535e10f539f.0000000c 14:25:15.188 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xfc77ed64]' 14:25:15.188 DEBUG [main] StandbyServer.java:249 Binding was successful 14:25:15.288 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 104b5a2a-1741-469e-b330-7e4024ef79b7 for current head 14:25:15.341 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:49264 is allowed 14:25:15.341 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:25:15.341 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head d5c6b74d-f1bd-4735-a463-f535e10f539f.0000000c to client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:15.341 DEBUG [standby-run-31] StandbyClientSyncExecution.java:103 Found missing segment d5c6b74d-f1bd-4735-a463-f535e10f539f 14:25:15.341 DEBUG [standby-run-31] StandbyClientSyncExecution.java:124 Inspecting segment d5c6b74d-f1bd-4735-a463-f535e10f539f 14:25:15.341 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 104b5a2a-1741-469e-b330-7e4024ef79b7 for references of segment d5c6b74d-f1bd-4735-a463-f535e10f539f 14:25:15.341 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:25:15.341 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment d5c6b74d-f1bd-4735-a463-f535e10f539f for client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment d5c6b74d-f1bd-4735-a463-f535e10f539f to client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:15.341 DEBUG [standby-run-31] StandbyClientSyncExecution.java:184 Found reference from d5c6b74d-f1bd-4735-a463-f535e10f539f to d8182e5c-c31c-4cbd-a8e8-0d5d27c49467 14:25:15.341 DEBUG [standby-run-31] StandbyClientSyncExecution.java:124 Inspecting segment d8182e5c-c31c-4cbd-a8e8-0d5d27c49467 14:25:15.341 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 104b5a2a-1741-469e-b330-7e4024ef79b7 for references of segment d8182e5c-c31c-4cbd-a8e8-0d5d27c49467 14:25:15.341 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:25:15.341 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment d8182e5c-c31c-4cbd-a8e8-0d5d27c49467 for client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment d8182e5c-c31c-4cbd-a8e8-0d5d27c49467 to client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:15.341 INFO [standby-run-31] StandbyClientSyncExecution.java:196 Copying data segment d8182e5c-c31c-4cbd-a8e8-0d5d27c49467 from primary 14:25:15.341 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 104b5a2a-1741-469e-b330-7e4024ef79b7 for segment d8182e5c-c31c-4cbd-a8e8-0d5d27c49467 14:25:15.341 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:25:15.341 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment d8182e5c-c31c-4cbd-a8e8-0d5d27c49467 for client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment d8182e5c-c31c-4cbd-a8e8-0d5d27c49467 to client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:15.341 DEBUG [standby-run-31] TarWriter.java:185 Writing segment d8182e5c-c31c-4cbd-a8e8-0d5d27c49467 to target\junit8973344500841027367\junit8268548351748424386\data00000a.tar 14:25:15.341 INFO [standby-run-31] StandbyClientSyncExecution.java:196 Copying data segment d5c6b74d-f1bd-4735-a463-f535e10f539f from primary 14:25:15.341 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 104b5a2a-1741-469e-b330-7e4024ef79b7 for segment d5c6b74d-f1bd-4735-a463-f535e10f539f 14:25:15.341 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:25:15.341 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment d5c6b74d-f1bd-4735-a463-f535e10f539f for client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment d5c6b74d-f1bd-4735-a463-f535e10f539f to client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:15.341 DEBUG [standby-run-31] TarWriter.java:185 Writing segment d5c6b74d-f1bd-4735-a463-f535e10f539f to target\junit8973344500841027367\junit8268548351748424386\data00000a.tar 14:25:15.341 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client 104b5a2a-1741-469e-b330-7e4024ef79b7 for blob 4d47be93b611794caa08a28a50e4eb353a49b76d3a164d45bb08bee7576dc2a0#5242880 14:25:15.341 DEBUG [primary-1] RequestDecoder.java:39 Parsed 'get blob' request 14:25:15.341 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get blob id' received from client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] GetBlobRequestHandler.java:41 Reading blob 4d47be93b611794caa08a28a50e4eb353a49b76d3a164d45bb08bee7576dc2a0#5242880 for client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.341 DEBUG [primary-1] CommunicationObserver.java:130 Binary with size 5242880 sent to client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.357 DEBUG [primary-1] GetBlobResponseEncoder.java:41 Sending blob 4d47be93b611794caa08a28a50e4eb353a49b76d3a164d45bb08bee7576dc2a0#5242880 to client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.357 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 1/5 of size 1048576 from blob 4d47be93b611794caa08a28a50e4eb353a49b76d3a164d45bb08bee7576dc2a0#5242880 to client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:15.388 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 104b5a2a-1741-469e-b330-7e4024ef79b7 io.netty.handler.codec.compression.DecompressionException: mismatching checksum: a5db1637 (expected: a281f680) at io.netty.handler.codec.compression.Snappy.validateChecksum(Snappy.java:640) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.compression.SnappyFrameDecoder.decode(SnappyFrameDecoder.java:181) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:489) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:428) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1342) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:934) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 14:25:15.388 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 2/5 of size 1048576 from blob 4d47be93b611794caa08a28a50e4eb353a49b76d3a164d45bb08bee7576dc2a0#5242880 to client 104b5a2a-1741-469e-b330-7e4024ef79b7 14:25:19.961 DEBUG [TarMK flush [target\junit8973344500841027367\junit4053337186445340863]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:19.993 DEBUG [TarMK flush [target\junit8973344500841027367\junit8268548351748424386]] TarRevisions.java:220 TarMK journal update null -> d401deab-f565-4b69-aa94-9619a30a3ef2.00000005 14:25:20.361 DEBUG [standby-run-31] StandbyClient.java:157 Channel closed 14:25:20.361 ERROR [standby-run-31] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to load remote blob 4d47be93b611794caa08a28a50e4eb353a49b76d3a164d45bb08bee7576dc2a0#5242880 at /root/server/#testBlob in 5000ms. Please increase the timeout and try again. at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchAndStoreBlob(StandbyDiff.java:208) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchBinary(StandbyDiff.java:196) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchBinary(StandbyDiff.java:181) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchBinary(StandbyDiff.java:169) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.diff(StandbyDiff.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.process(StandbyDiff.java:121) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.childNodeAdded(StandbyDiff.java:94) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.CancelableDiff.childNodeAdded(CancelableDiff.java:76) ~[oak-segment-tar-1.8-SNAPSHOT.jar:na] at org.apache.jackrabbit.oak.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:562) ~[oak-segment-tar-1.8-SNAPSHOT.jar:na] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.diff(StandbyDiff.java:143) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.process(StandbyDiff.java:121) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.childNodeChanged(StandbyDiff.java:105) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:566) ~[oak-segment-tar-1.8-SNAPSHOT.jar:na] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:101) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxyFlippedIntermediateByteChange2(DataStoreTestBase.java:326) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 14:25:22.582 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:22.650 DEBUG [main] TarWriter.java:185 Writing segment dae19a6c-4554-4b6e-a7c1-8db56db1bd7d to target\junit8973344500841027367\junit4053337186445340863\data00000a.tar 14:25:22.698 DEBUG [main] TarRevisions.java:220 TarMK journal update d5c6b74d-f1bd-4735-a463-f535e10f539f.0000000c -> dae19a6c-4554-4b6e-a7c1-8db56db1bd7d.00000006 14:25:22.849 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client d1c7877d-145f-490c-b89b-191413d54614 for current head 14:25:22.850 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:49290 is allowed 14:25:22.850 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:25:22.850 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head dae19a6c-4554-4b6e-a7c1-8db56db1bd7d.00000006 to client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:22.851 DEBUG [standby-run-32] StandbyClientSyncExecution.java:103 Found missing segment dae19a6c-4554-4b6e-a7c1-8db56db1bd7d 14:25:22.851 DEBUG [standby-run-32] StandbyClientSyncExecution.java:124 Inspecting segment dae19a6c-4554-4b6e-a7c1-8db56db1bd7d 14:25:22.851 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client d1c7877d-145f-490c-b89b-191413d54614 for references of segment dae19a6c-4554-4b6e-a7c1-8db56db1bd7d 14:25:22.851 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:22.851 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment dae19a6c-4554-4b6e-a7c1-8db56db1bd7d for client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment dae19a6c-4554-4b6e-a7c1-8db56db1bd7d to client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:22.851 INFO [standby-run-32] StandbyClientSyncExecution.java:196 Copying data segment dae19a6c-4554-4b6e-a7c1-8db56db1bd7d from primary 14:25:22.851 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client d1c7877d-145f-490c-b89b-191413d54614 for segment dae19a6c-4554-4b6e-a7c1-8db56db1bd7d 14:25:22.851 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:22.851 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment dae19a6c-4554-4b6e-a7c1-8db56db1bd7d for client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment dae19a6c-4554-4b6e-a7c1-8db56db1bd7d to client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:22.851 DEBUG [standby-run-32] TarWriter.java:185 Writing segment dae19a6c-4554-4b6e-a7c1-8db56db1bd7d to target\junit8973344500841027367\junit8268548351748424386\data00000a.tar 14:25:22.851 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client d1c7877d-145f-490c-b89b-191413d54614 for blob a204b572aa6821c5bec908f51ef3812ceefafb970d18abf9921941181bd25875#2097152 14:25:22.851 DEBUG [primary-2] RequestDecoder.java:39 Parsed 'get blob' request 14:25:22.851 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get blob id' received from client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [primary-2] GetBlobRequestHandler.java:41 Reading blob a204b572aa6821c5bec908f51ef3812ceefafb970d18abf9921941181bd25875#2097152 for client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [primary-2] CommunicationObserver.java:130 Binary with size 2097152 sent to client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [primary-2] GetBlobResponseEncoder.java:41 Sending blob a204b572aa6821c5bec908f51ef3812ceefafb970d18abf9921941181bd25875#2097152 to client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.851 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 1/2 of size 1048576 from blob a204b572aa6821c5bec908f51ef3812ceefafb970d18abf9921941181bd25875#2097152 to client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.882 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:22.882 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 1/2 of size 1048576 from blob a204b572aa6821c5bec908f51ef3812ceefafb970d18abf9921941181bd25875#2097152 14:25:22.882 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 2/2 of size 1048576 from blob a204b572aa6821c5bec908f51ef3812ceefafb970d18abf9921941181bd25875#2097152 to client d1c7877d-145f-490c-b89b-191413d54614 14:25:22.882 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\a204b572aa6821c5bec908f51ef3812ceefafb970d18abf9921941181bd25875#2097152.tmp 14:25:22.914 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:22.914 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 2/2 of size 1048576 from blob a204b572aa6821c5bec908f51ef3812ceefafb970d18abf9921941181bd25875#2097152 14:25:22.914 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\a204b572aa6821c5bec908f51ef3812ceefafb970d18abf9921941181bd25875#2097152.tmp 14:25:22.929 DEBUG [standby-1] ResponseDecoder.java:167 Received entire blob a204b572aa6821c5bec908f51ef3812ceefafb970d18abf9921941181bd25875#2097152 14:25:22.951 DEBUG [standby-run-32] ResponseDecoder.java:66 Processing input stream finished! Deleting file C:\tmp\a204b572aa6821c5bec908f51ef3812ceefafb970d18abf9921941181bd25875#2097152.tmp 14:25:22.998 DEBUG [standby-run-32] TarRevisions.java:220 TarMK journal update d401deab-f565-4b69-aa94-9619a30a3ef2.00000005 -> dae19a6c-4554-4b6e-a7c1-8db56db1bd7d.00000006 14:25:23.082 INFO [standby-run-32] StandbyClientSyncExecution.java:82 updated head state successfully: true in 231ms. 14:25:23.082 DEBUG [standby-run-32] StandbyClient.java:157 Channel closed 14:25:24.947 DEBUG [TarMK flush [target\junit8973344500841027367\junit4053337186445340863]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:24.968 DEBUG [TarMK flush [target\junit8973344500841027367\junit8268548351748424386]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:25.285 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:25.285 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:25.285 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:25.285 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:25:25.285 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:25:25.285 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByteChange2 14:25:25.285 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:25.285 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:25.316 INFO [main] FileStore.java:467 TarMK closed: target\junit8973344500841027367\junit8268548351748424386 14:25:25.316 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:25.316 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:25.353 INFO [main] FileStore.java:467 TarMK closed: target\junit8973344500841027367\junit4053337186445340863 14:25:25.369 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit8889099500407944205\junit5327560267299129034, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:25.385 INFO [main] FileStore.java:240 TarMK opened: target\junit8889099500407944205\junit5327560267299129034 (mmap=false) 14:25:25.385 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit8889099500407944205\junit5327560267299129034\data00000a.tar} 14:25:25.385 DEBUG [main] TarWriter.java:185 Writing segment c0097fa0-38a5-434e-a0d7-ac5a01ad37e6 to target\junit8889099500407944205\junit5327560267299129034\data00000a.tar 14:25:25.416 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit8889099500407944205\junit5179391908162460078, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:25.432 INFO [main] FileStore.java:240 TarMK opened: target\junit8889099500407944205\junit5179391908162460078 (mmap=false) 14:25:25.432 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit8889099500407944205\junit5179391908162460078\data00000a.tar} 14:25:25.432 DEBUG [main] TarWriter.java:185 Writing segment a3cc559b-7072-4a31-ab28-cb48e536ca44 to target\junit8889099500407944205\junit5179391908162460078\data00000a.tar 14:25:25.469 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByteChange 14:25:25.469 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:25:25.469 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:25:25.554 DEBUG [main] TarWriter.java:185 Writing segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 to target\junit8889099500407944205\junit5327560267299129034\data00000a.tar 14:25:25.617 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> f2f39149-ea13-4a86-ac9b-8cf903b10ae7.0000000c 14:25:25.755 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xca84c646]' 14:25:25.755 DEBUG [main] StandbyServer.java:249 Binding was successful 14:25:25.943 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client fe663405-7feb-407f-81ea-0c890a4e16bc for current head 14:25:26.001 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:49385 is allowed 14:25:26.001 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:25:26.001 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client fe663405-7feb-407f-81ea-0c890a4e16bc 14:25:26.001 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client fe663405-7feb-407f-81ea-0c890a4e16bc 14:25:26.002 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head f2f39149-ea13-4a86-ac9b-8cf903b10ae7.0000000c to client fe663405-7feb-407f-81ea-0c890a4e16bc 14:25:26.002 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:26.003 DEBUG [standby-run-33] StandbyClientSyncExecution.java:103 Found missing segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 14:25:26.003 DEBUG [standby-run-33] StandbyClientSyncExecution.java:124 Inspecting segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 14:25:26.003 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client fe663405-7feb-407f-81ea-0c890a4e16bc for references of segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 14:25:26.004 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:25:26.004 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 for client fe663405-7feb-407f-81ea-0c890a4e16bc 14:25:26.005 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 to client fe663405-7feb-407f-81ea-0c890a4e16bc 14:25:26.006 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client fe663405-7feb-407f-81ea-0c890a4e16bc io.netty.handler.codec.compression.DecompressionException: mismatching checksum: 4e0bb357 (expected: a282d20c) at io.netty.handler.codec.compression.Snappy.validateChecksum(Snappy.java:640) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.compression.SnappyFrameDecoder.decode(SnappyFrameDecoder.java:181) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:489) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:428) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1342) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:934) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 14:25:30.395 DEBUG [TarMK flush [target\junit8889099500407944205\junit5327560267299129034]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:30.479 DEBUG [TarMK flush [target\junit8889099500407944205\junit5179391908162460078]] TarRevisions.java:220 TarMK journal update null -> a3cc559b-7072-4a31-ab28-cb48e536ca44.00000005 14:25:31.011 DEBUG [standby-run-33] StandbyClient.java:157 Channel closed 14:25:31.011 ERROR [standby-run-33] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxyFlippedIntermediateByteChange(DataStoreTestBase.java:321) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 14:25:33.212 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:33.250 DEBUG [main] TarWriter.java:185 Writing segment 84c18831-94ba-4ff8-a70c-4fd63b828137 to target\junit8889099500407944205\junit5327560267299129034\data00000a.tar 14:25:33.312 DEBUG [main] TarRevisions.java:220 TarMK journal update f2f39149-ea13-4a86-ac9b-8cf903b10ae7.0000000c -> 84c18831-94ba-4ff8-a70c-4fd63b828137.00000006 14:25:33.435 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 719a1938-abac-481f-8263-3cc07f225188 for current head 14:25:33.435 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:49410 is allowed 14:25:33.435 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:25:33.435 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.435 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.435 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 84c18831-94ba-4ff8-a70c-4fd63b828137.00000006 to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.435 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:33.435 DEBUG [standby-run-34] StandbyClientSyncExecution.java:103 Found missing segment 84c18831-94ba-4ff8-a70c-4fd63b828137 14:25:33.435 DEBUG [standby-run-34] StandbyClientSyncExecution.java:124 Inspecting segment 84c18831-94ba-4ff8-a70c-4fd63b828137 14:25:33.435 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 719a1938-abac-481f-8263-3cc07f225188 for references of segment 84c18831-94ba-4ff8-a70c-4fd63b828137 14:25:33.435 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:33.435 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 84c18831-94ba-4ff8-a70c-4fd63b828137 for client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.435 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 84c18831-94ba-4ff8-a70c-4fd63b828137 to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.435 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:33.435 DEBUG [standby-run-34] StandbyClientSyncExecution.java:184 Found reference from 84c18831-94ba-4ff8-a70c-4fd63b828137 to f2f39149-ea13-4a86-ac9b-8cf903b10ae7 14:25:33.450 DEBUG [standby-run-34] StandbyClientSyncExecution.java:184 Found reference from 84c18831-94ba-4ff8-a70c-4fd63b828137 to c0097fa0-38a5-434e-a0d7-ac5a01ad37e6 14:25:33.450 DEBUG [standby-run-34] StandbyClientSyncExecution.java:124 Inspecting segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 14:25:33.450 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 719a1938-abac-481f-8263-3cc07f225188 for references of segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 14:25:33.450 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:33.450 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 for client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:33.450 DEBUG [standby-run-34] StandbyClientSyncExecution.java:124 Inspecting segment c0097fa0-38a5-434e-a0d7-ac5a01ad37e6 14:25:33.450 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 719a1938-abac-481f-8263-3cc07f225188 for references of segment c0097fa0-38a5-434e-a0d7-ac5a01ad37e6 14:25:33.450 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:33.450 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment c0097fa0-38a5-434e-a0d7-ac5a01ad37e6 for client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment c0097fa0-38a5-434e-a0d7-ac5a01ad37e6 to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:33.450 INFO [standby-run-34] StandbyClientSyncExecution.java:196 Copying data segment c0097fa0-38a5-434e-a0d7-ac5a01ad37e6 from primary 14:25:33.450 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 719a1938-abac-481f-8263-3cc07f225188 for segment c0097fa0-38a5-434e-a0d7-ac5a01ad37e6 14:25:33.450 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:33.450 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment c0097fa0-38a5-434e-a0d7-ac5a01ad37e6 for client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment c0097fa0-38a5-434e-a0d7-ac5a01ad37e6 to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:33.450 DEBUG [standby-run-34] TarWriter.java:185 Writing segment c0097fa0-38a5-434e-a0d7-ac5a01ad37e6 to target\junit8889099500407944205\junit5179391908162460078\data00000a.tar 14:25:33.450 INFO [standby-run-34] StandbyClientSyncExecution.java:196 Copying data segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 from primary 14:25:33.450 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 719a1938-abac-481f-8263-3cc07f225188 for segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 14:25:33.450 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:33.450 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 for client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:33.450 DEBUG [standby-run-34] TarWriter.java:185 Writing segment f2f39149-ea13-4a86-ac9b-8cf903b10ae7 to target\junit8889099500407944205\junit5179391908162460078\data00000a.tar 14:25:33.450 INFO [standby-run-34] StandbyClientSyncExecution.java:196 Copying data segment 84c18831-94ba-4ff8-a70c-4fd63b828137 from primary 14:25:33.450 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 719a1938-abac-481f-8263-3cc07f225188 for segment 84c18831-94ba-4ff8-a70c-4fd63b828137 14:25:33.450 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:33.450 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 84c18831-94ba-4ff8-a70c-4fd63b828137 for client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 84c18831-94ba-4ff8-a70c-4fd63b828137 to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:33.450 DEBUG [standby-run-34] TarWriter.java:185 Writing segment 84c18831-94ba-4ff8-a70c-4fd63b828137 to target\junit8889099500407944205\junit5179391908162460078\data00000a.tar 14:25:33.450 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client 719a1938-abac-481f-8263-3cc07f225188 for blob 662dfc8d54a5ecfbcd07b9a9b81921b0771ce6fe00dde90aa47c19d3ad14a1ad#2097152 14:25:33.450 DEBUG [primary-2] RequestDecoder.java:39 Parsed 'get blob' request 14:25:33.450 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get blob id' received from client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] GetBlobRequestHandler.java:41 Reading blob 662dfc8d54a5ecfbcd07b9a9b81921b0771ce6fe00dde90aa47c19d3ad14a1ad#2097152 for client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] CommunicationObserver.java:130 Binary with size 2097152 sent to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] GetBlobResponseEncoder.java:41 Sending blob 662dfc8d54a5ecfbcd07b9a9b81921b0771ce6fe00dde90aa47c19d3ad14a1ad#2097152 to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.450 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 1/2 of size 1048576 from blob 662dfc8d54a5ecfbcd07b9a9b81921b0771ce6fe00dde90aa47c19d3ad14a1ad#2097152 to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.482 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:33.482 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 1/2 of size 1048576 from blob 662dfc8d54a5ecfbcd07b9a9b81921b0771ce6fe00dde90aa47c19d3ad14a1ad#2097152 14:25:33.482 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\662dfc8d54a5ecfbcd07b9a9b81921b0771ce6fe00dde90aa47c19d3ad14a1ad#2097152.tmp 14:25:33.482 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 2/2 of size 1048576 from blob 662dfc8d54a5ecfbcd07b9a9b81921b0771ce6fe00dde90aa47c19d3ad14a1ad#2097152 to client 719a1938-abac-481f-8263-3cc07f225188 14:25:33.513 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:33.513 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 2/2 of size 1048576 from blob 662dfc8d54a5ecfbcd07b9a9b81921b0771ce6fe00dde90aa47c19d3ad14a1ad#2097152 14:25:33.513 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\662dfc8d54a5ecfbcd07b9a9b81921b0771ce6fe00dde90aa47c19d3ad14a1ad#2097152.tmp 14:25:33.513 DEBUG [standby-1] ResponseDecoder.java:167 Received entire blob 662dfc8d54a5ecfbcd07b9a9b81921b0771ce6fe00dde90aa47c19d3ad14a1ad#2097152 14:25:33.535 DEBUG [standby-run-34] ResponseDecoder.java:66 Processing input stream finished! Deleting file C:\tmp\662dfc8d54a5ecfbcd07b9a9b81921b0771ce6fe00dde90aa47c19d3ad14a1ad#2097152.tmp 14:25:33.566 DEBUG [standby-run-34] TarRevisions.java:220 TarMK journal update a3cc559b-7072-4a31-ab28-cb48e536ca44.00000005 -> 84c18831-94ba-4ff8-a70c-4fd63b828137.00000006 14:25:33.635 INFO [standby-run-34] StandbyClientSyncExecution.java:82 updated head state successfully: true in 200ms. 14:25:33.635 DEBUG [standby-run-34] StandbyClient.java:157 Channel closed 14:25:35.398 DEBUG [TarMK flush [target\junit8889099500407944205\junit5327560267299129034]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:35.452 DEBUG [TarMK flush [target\junit8889099500407944205\junit5179391908162460078]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:35.867 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:35.867 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:35.867 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:35.867 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:25:35.867 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:25:35.882 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByteChange 14:25:35.882 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:35.882 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:35.934 INFO [main] FileStore.java:467 TarMK closed: target\junit8889099500407944205\junit5179391908162460078 14:25:35.935 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:35.935 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:35.951 INFO [main] FileStore.java:467 TarMK closed: target\junit8889099500407944205\junit5327560267299129034 14:25:35.982 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit9167793619489456400\junit6979446248781661724, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:35.982 INFO [main] FileStore.java:240 TarMK opened: target\junit9167793619489456400\junit6979446248781661724 (mmap=false) 14:25:35.982 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit9167793619489456400\junit6979446248781661724\data00000a.tar} 14:25:35.982 DEBUG [main] TarWriter.java:185 Writing segment 2c2a50c7-1cd6-4abc-ac8b-e02bc4abaa4c to target\junit9167793619489456400\junit6979446248781661724\data00000a.tar 14:25:36.098 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit9167793619489456400\junit4017587246890457404, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:36.098 INFO [main] FileStore.java:240 TarMK opened: target\junit9167793619489456400\junit4017587246890457404 (mmap=false) 14:25:36.098 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit9167793619489456400\junit4017587246890457404\data00000a.tar} 14:25:36.098 DEBUG [main] TarWriter.java:185 Writing segment 5852a1c0-8d22-4e9f-a6fd-d79386dfa683 to target\junit9167793619489456400\junit4017587246890457404\data00000a.tar 14:25:36.113 INFO [main] DataStoreTestBase.java:127 Test begin: testProxySkippedBytesIntermediateChange 14:25:36.113 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:25:36.113 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:25:36.198 DEBUG [main] TarWriter.java:185 Writing segment 403df8f1-21b2-4f91-a121-7a039f0aad45 to target\junit9167793619489456400\junit6979446248781661724\data00000a.tar 14:25:36.251 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 403df8f1-21b2-4f91-a121-7a039f0aad45.0000000c 14:25:36.367 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x3ad3afb4]' 14:25:36.367 DEBUG [main] StandbyServer.java:249 Binding was successful 14:25:36.468 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 799b433a-d691-4461-8770-99efc214c768 for current head 14:25:36.515 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:49499 is allowed 14:25:36.515 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:25:36.515 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 799b433a-d691-4461-8770-99efc214c768 14:25:36.515 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 799b433a-d691-4461-8770-99efc214c768 14:25:36.515 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 403df8f1-21b2-4f91-a121-7a039f0aad45.0000000c to client 799b433a-d691-4461-8770-99efc214c768 14:25:36.515 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:36.515 DEBUG [standby-run-35] StandbyClientSyncExecution.java:103 Found missing segment 403df8f1-21b2-4f91-a121-7a039f0aad45 14:25:36.515 DEBUG [standby-run-35] StandbyClientSyncExecution.java:124 Inspecting segment 403df8f1-21b2-4f91-a121-7a039f0aad45 14:25:36.515 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 799b433a-d691-4461-8770-99efc214c768 for references of segment 403df8f1-21b2-4f91-a121-7a039f0aad45 14:25:36.515 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:25:36.515 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 403df8f1-21b2-4f91-a121-7a039f0aad45 for client 799b433a-d691-4461-8770-99efc214c768 14:25:36.515 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 403df8f1-21b2-4f91-a121-7a039f0aad45 to client 799b433a-d691-4461-8770-99efc214c768 14:25:41.002 DEBUG [TarMK flush [target\junit9167793619489456400\junit6979446248781661724]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:41.156 DEBUG [TarMK flush [target\junit9167793619489456400\junit4017587246890457404]] TarRevisions.java:220 TarMK journal update null -> 5852a1c0-8d22-4e9f-a6fd-d79386dfa683.00000005 14:25:41.535 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 799b433a-d691-4461-8770-99efc214c768 io.netty.handler.timeout.ReadTimeoutException: null 14:25:41.536 DEBUG [standby-run-35] StandbyClient.java:157 Channel closed 14:25:41.540 ERROR [standby-run-35] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment 403df8f1-21b2-4f91-a121-7a039f0aad45 from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxySkippedBytesIntermediateChange(DataStoreTestBase.java:301) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 14:25:43.757 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:43.820 DEBUG [main] TarWriter.java:185 Writing segment 9d22b27e-e192-4504-ad1b-052487a03374 to target\junit9167793619489456400\junit6979446248781661724\data00000a.tar 14:25:43.860 DEBUG [main] TarRevisions.java:220 TarMK journal update 403df8f1-21b2-4f91-a121-7a039f0aad45.0000000c -> 9d22b27e-e192-4504-ad1b-052487a03374.00000006 14:25:43.976 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee for current head 14:25:43.976 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:49523 is allowed 14:25:43.976 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:25:43.976 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.976 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.976 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 9d22b27e-e192-4504-ad1b-052487a03374.00000006 to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.976 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:43.976 DEBUG [standby-run-36] StandbyClientSyncExecution.java:103 Found missing segment 9d22b27e-e192-4504-ad1b-052487a03374 14:25:43.976 DEBUG [standby-run-36] StandbyClientSyncExecution.java:124 Inspecting segment 9d22b27e-e192-4504-ad1b-052487a03374 14:25:43.976 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee for references of segment 9d22b27e-e192-4504-ad1b-052487a03374 14:25:43.992 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:43.992 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 9d22b27e-e192-4504-ad1b-052487a03374 for client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 9d22b27e-e192-4504-ad1b-052487a03374 to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:43.992 DEBUG [standby-run-36] StandbyClientSyncExecution.java:184 Found reference from 9d22b27e-e192-4504-ad1b-052487a03374 to 403df8f1-21b2-4f91-a121-7a039f0aad45 14:25:43.992 DEBUG [standby-run-36] StandbyClientSyncExecution.java:184 Found reference from 9d22b27e-e192-4504-ad1b-052487a03374 to 2c2a50c7-1cd6-4abc-ac8b-e02bc4abaa4c 14:25:43.992 DEBUG [standby-run-36] StandbyClientSyncExecution.java:124 Inspecting segment 403df8f1-21b2-4f91-a121-7a039f0aad45 14:25:43.992 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee for references of segment 403df8f1-21b2-4f91-a121-7a039f0aad45 14:25:43.992 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:43.992 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 403df8f1-21b2-4f91-a121-7a039f0aad45 for client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 403df8f1-21b2-4f91-a121-7a039f0aad45 to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:43.992 DEBUG [standby-run-36] StandbyClientSyncExecution.java:124 Inspecting segment 2c2a50c7-1cd6-4abc-ac8b-e02bc4abaa4c 14:25:43.992 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee for references of segment 2c2a50c7-1cd6-4abc-ac8b-e02bc4abaa4c 14:25:43.992 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:43.992 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 2c2a50c7-1cd6-4abc-ac8b-e02bc4abaa4c for client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 2c2a50c7-1cd6-4abc-ac8b-e02bc4abaa4c to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:43.992 INFO [standby-run-36] StandbyClientSyncExecution.java:196 Copying data segment 2c2a50c7-1cd6-4abc-ac8b-e02bc4abaa4c from primary 14:25:43.992 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee for segment 2c2a50c7-1cd6-4abc-ac8b-e02bc4abaa4c 14:25:43.992 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:43.992 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 2c2a50c7-1cd6-4abc-ac8b-e02bc4abaa4c for client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 2c2a50c7-1cd6-4abc-ac8b-e02bc4abaa4c to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:43.992 DEBUG [standby-run-36] TarWriter.java:185 Writing segment 2c2a50c7-1cd6-4abc-ac8b-e02bc4abaa4c to target\junit9167793619489456400\junit4017587246890457404\data00000a.tar 14:25:43.992 INFO [standby-run-36] StandbyClientSyncExecution.java:196 Copying data segment 403df8f1-21b2-4f91-a121-7a039f0aad45 from primary 14:25:43.992 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee for segment 403df8f1-21b2-4f91-a121-7a039f0aad45 14:25:43.992 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:43.992 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 403df8f1-21b2-4f91-a121-7a039f0aad45 for client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 403df8f1-21b2-4f91-a121-7a039f0aad45 to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:43.992 DEBUG [standby-run-36] TarWriter.java:185 Writing segment 403df8f1-21b2-4f91-a121-7a039f0aad45 to target\junit9167793619489456400\junit4017587246890457404\data00000a.tar 14:25:43.992 INFO [standby-run-36] StandbyClientSyncExecution.java:196 Copying data segment 9d22b27e-e192-4504-ad1b-052487a03374 from primary 14:25:43.992 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee for segment 9d22b27e-e192-4504-ad1b-052487a03374 14:25:43.992 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:43.992 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 9d22b27e-e192-4504-ad1b-052487a03374 for client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 9d22b27e-e192-4504-ad1b-052487a03374 to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:43.992 DEBUG [standby-run-36] TarWriter.java:185 Writing segment 9d22b27e-e192-4504-ad1b-052487a03374 to target\junit9167793619489456400\junit4017587246890457404\data00000a.tar 14:25:43.992 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee for blob 322699405720a9404b5780e85ad1c31db69d0d7d9eddd9fc46231a98a636ee40#2097152 14:25:43.992 DEBUG [primary-2] RequestDecoder.java:39 Parsed 'get blob' request 14:25:43.992 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get blob id' received from client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] GetBlobRequestHandler.java:41 Reading blob 322699405720a9404b5780e85ad1c31db69d0d7d9eddd9fc46231a98a636ee40#2097152 for client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] CommunicationObserver.java:130 Binary with size 2097152 sent to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] GetBlobResponseEncoder.java:41 Sending blob 322699405720a9404b5780e85ad1c31db69d0d7d9eddd9fc46231a98a636ee40#2097152 to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:43.992 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 1/2 of size 1048576 from blob 322699405720a9404b5780e85ad1c31db69d0d7d9eddd9fc46231a98a636ee40#2097152 to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:44.023 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:44.023 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 1/2 of size 1048576 from blob 322699405720a9404b5780e85ad1c31db69d0d7d9eddd9fc46231a98a636ee40#2097152 14:25:44.023 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\322699405720a9404b5780e85ad1c31db69d0d7d9eddd9fc46231a98a636ee40#2097152.tmp 14:25:44.023 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 2/2 of size 1048576 from blob 322699405720a9404b5780e85ad1c31db69d0d7d9eddd9fc46231a98a636ee40#2097152 to client d49f824e-51df-4dbe-94e2-ba2b56cbf1ee 14:25:44.045 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:44.045 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 2/2 of size 1048576 from blob 322699405720a9404b5780e85ad1c31db69d0d7d9eddd9fc46231a98a636ee40#2097152 14:25:44.061 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\322699405720a9404b5780e85ad1c31db69d0d7d9eddd9fc46231a98a636ee40#2097152.tmp 14:25:44.061 DEBUG [standby-1] ResponseDecoder.java:167 Received entire blob 322699405720a9404b5780e85ad1c31db69d0d7d9eddd9fc46231a98a636ee40#2097152 14:25:44.076 DEBUG [standby-run-36] ResponseDecoder.java:66 Processing input stream finished! Deleting file C:\tmp\322699405720a9404b5780e85ad1c31db69d0d7d9eddd9fc46231a98a636ee40#2097152.tmp 14:25:44.145 DEBUG [standby-run-36] TarRevisions.java:220 TarMK journal update 5852a1c0-8d22-4e9f-a6fd-d79386dfa683.00000005 -> 9d22b27e-e192-4504-ad1b-052487a03374.00000006 14:25:44.223 INFO [standby-run-36] StandbyClientSyncExecution.java:82 updated head state successfully: true in 247ms. 14:25:44.223 DEBUG [standby-run-36] StandbyClient.java:157 Channel closed 14:25:45.992 DEBUG [TarMK flush [target\junit9167793619489456400\junit6979446248781661724]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:46.123 DEBUG [TarMK flush [target\junit9167793619489456400\junit4017587246890457404]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:46.461 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:46.461 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:46.461 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:46.461 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:25:46.461 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:25:46.477 INFO [main] DataStoreTestBase.java:132 Test end: testProxySkippedBytesIntermediateChange 14:25:46.477 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:46.477 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:46.524 INFO [main] FileStore.java:467 TarMK closed: target\junit9167793619489456400\junit4017587246890457404 14:25:46.524 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:46.524 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:46.546 INFO [main] FileStore.java:467 TarMK closed: target\junit9167793619489456400\junit6979446248781661724 14:25:46.561 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit3635960661649353540\junit3475168011428579466, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:46.577 INFO [main] FileStore.java:240 TarMK opened: target\junit3635960661649353540\junit3475168011428579466 (mmap=false) 14:25:46.577 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit3635960661649353540\junit3475168011428579466\data00000a.tar} 14:25:46.577 DEBUG [main] TarWriter.java:185 Writing segment 27571e50-b533-465f-a2d4-6e4ae88da307 to target\junit3635960661649353540\junit3475168011428579466\data00000a.tar 14:25:46.692 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit3635960661649353540\junit6063370048779848439, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:46.708 INFO [main] FileStore.java:240 TarMK opened: target\junit3635960661649353540\junit6063370048779848439 (mmap=false) 14:25:46.708 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit3635960661649353540\junit6063370048779848439\data00000a.tar} 14:25:46.708 DEBUG [main] TarWriter.java:185 Writing segment 0440d629-b5fd-49e9-a05d-fbbedf02689e to target\junit3635960661649353540\junit6063370048779848439\data00000a.tar 14:25:46.724 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByte 14:25:46.724 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:25:46.724 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:25:46.808 DEBUG [main] TarWriter.java:185 Writing segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 to target\junit3635960661649353540\junit3475168011428579466\data00000a.tar 14:25:46.861 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 69a6fa89-a5c0-4294-a047-46d8110e1ff8.0000000c 14:25:46.993 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xf1a37bd5]' 14:25:47.008 DEBUG [main] StandbyServer.java:249 Binding was successful 14:25:47.108 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client a9e9fae6-e549-484b-9cbf-95484f1bd9a2 for current head 14:25:47.146 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:49612 is allowed 14:25:47.146 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:25:47.146 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client a9e9fae6-e549-484b-9cbf-95484f1bd9a2 14:25:47.146 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client a9e9fae6-e549-484b-9cbf-95484f1bd9a2 14:25:47.146 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 69a6fa89-a5c0-4294-a047-46d8110e1ff8.0000000c to client a9e9fae6-e549-484b-9cbf-95484f1bd9a2 14:25:47.146 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:47.146 DEBUG [standby-run-37] StandbyClientSyncExecution.java:103 Found missing segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 14:25:47.146 DEBUG [standby-run-37] StandbyClientSyncExecution.java:124 Inspecting segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 14:25:47.146 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client a9e9fae6-e549-484b-9cbf-95484f1bd9a2 for references of segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 14:25:47.146 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:25:47.146 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 for client a9e9fae6-e549-484b-9cbf-95484f1bd9a2 14:25:47.146 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 to client a9e9fae6-e549-484b-9cbf-95484f1bd9a2 14:25:47.146 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client a9e9fae6-e549-484b-9cbf-95484f1bd9a2 io.netty.handler.codec.compression.DecompressionException: mismatching checksum: a28299c3 (expected: c9236c78) at io.netty.handler.codec.compression.Snappy.validateChecksum(Snappy.java:640) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.compression.SnappyFrameDecoder.decode(SnappyFrameDecoder.java:181) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:489) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:428) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1342) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:934) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 14:25:51.582 DEBUG [TarMK flush [target\junit3635960661649353540\junit3475168011428579466]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:51.751 DEBUG [TarMK flush [target\junit3635960661649353540\junit6063370048779848439]] TarRevisions.java:220 TarMK journal update null -> 0440d629-b5fd-49e9-a05d-fbbedf02689e.00000005 14:25:52.167 DEBUG [standby-run-37] StandbyClient.java:157 Channel closed 14:25:52.167 ERROR [standby-run-37] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxyFlippedIntermediateByte(DataStoreTestBase.java:311) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 14:25:54.384 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:54.453 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client f3231f41-7346-4d0a-8311-2130af5d4802 for current head 14:25:54.453 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:49636 is allowed 14:25:54.453 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:25:54.453 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 69a6fa89-a5c0-4294-a047-46d8110e1ff8.0000000c to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:54.453 DEBUG [standby-run-38] StandbyClientSyncExecution.java:103 Found missing segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 14:25:54.453 DEBUG [standby-run-38] StandbyClientSyncExecution.java:124 Inspecting segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 14:25:54.453 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client f3231f41-7346-4d0a-8311-2130af5d4802 for references of segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 14:25:54.453 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:54.453 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 for client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:54.453 DEBUG [standby-run-38] StandbyClientSyncExecution.java:184 Found reference from 69a6fa89-a5c0-4294-a047-46d8110e1ff8 to 27571e50-b533-465f-a2d4-6e4ae88da307 14:25:54.453 DEBUG [standby-run-38] StandbyClientSyncExecution.java:124 Inspecting segment 27571e50-b533-465f-a2d4-6e4ae88da307 14:25:54.453 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client f3231f41-7346-4d0a-8311-2130af5d4802 for references of segment 27571e50-b533-465f-a2d4-6e4ae88da307 14:25:54.453 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:25:54.453 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 27571e50-b533-465f-a2d4-6e4ae88da307 for client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 27571e50-b533-465f-a2d4-6e4ae88da307 to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:54.453 INFO [standby-run-38] StandbyClientSyncExecution.java:196 Copying data segment 27571e50-b533-465f-a2d4-6e4ae88da307 from primary 14:25:54.453 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client f3231f41-7346-4d0a-8311-2130af5d4802 for segment 27571e50-b533-465f-a2d4-6e4ae88da307 14:25:54.453 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:54.453 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 27571e50-b533-465f-a2d4-6e4ae88da307 for client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 27571e50-b533-465f-a2d4-6e4ae88da307 to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:54.453 DEBUG [standby-run-38] TarWriter.java:185 Writing segment 27571e50-b533-465f-a2d4-6e4ae88da307 to target\junit3635960661649353540\junit6063370048779848439\data00000a.tar 14:25:54.453 INFO [standby-run-38] StandbyClientSyncExecution.java:196 Copying data segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 from primary 14:25:54.453 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client f3231f41-7346-4d0a-8311-2130af5d4802 for segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 14:25:54.453 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:25:54.453 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 for client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:54.453 DEBUG [standby-run-38] TarWriter.java:185 Writing segment 69a6fa89-a5c0-4294-a047-46d8110e1ff8 to target\junit3635960661649353540\junit6063370048779848439\data00000a.tar 14:25:54.453 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client f3231f41-7346-4d0a-8311-2130af5d4802 for blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 14:25:54.453 DEBUG [primary-2] RequestDecoder.java:39 Parsed 'get blob' request 14:25:54.453 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get blob id' received from client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] GetBlobRequestHandler.java:41 Reading blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 for client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] CommunicationObserver.java:130 Binary with size 5242880 sent to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] GetBlobResponseEncoder.java:41 Sending blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.453 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 1/5 of size 1048576 from blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.484 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:54.484 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 1/5 of size 1048576 from blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 14:25:54.484 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 2/5 of size 1048576 from blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.484 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880.tmp 14:25:54.515 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:54.515 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 2/5 of size 1048576 from blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 14:25:54.515 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880.tmp 14:25:54.515 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 3/5 of size 1048576 from blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.531 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:54.531 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 3/5 of size 1048576 from blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 14:25:54.531 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880.tmp 14:25:54.531 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 4/5 of size 1048576 from blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.553 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:54.553 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 4/5 of size 1048576 from blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 14:25:54.569 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880.tmp 14:25:54.569 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 5/5 of size 1048576 from blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 to client f3231f41-7346-4d0a-8311-2130af5d4802 14:25:54.584 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:25:54.584 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 5/5 of size 1048576 from blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 14:25:54.600 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880.tmp 14:25:54.600 DEBUG [standby-1] ResponseDecoder.java:167 Received entire blob 87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880 14:25:54.669 DEBUG [standby-run-38] ResponseDecoder.java:66 Processing input stream finished! Deleting file C:\tmp\87fae8cc241dab130d19b2d291df608ea161a4844ad52fbcd3a8187b4a7b3679#5242880.tmp 14:25:54.731 DEBUG [standby-run-38] TarRevisions.java:220 TarMK journal update 0440d629-b5fd-49e9-a05d-fbbedf02689e.00000005 -> 69a6fa89-a5c0-4294-a047-46d8110e1ff8.0000000c 14:25:54.815 INFO [standby-run-38] StandbyClientSyncExecution.java:82 updated head state successfully: true in 362ms. 14:25:54.815 DEBUG [standby-run-38] StandbyClient.java:157 Channel closed 14:25:56.585 DEBUG [TarMK flush [target\junit3635960661649353540\junit3475168011428579466]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:56.716 DEBUG [TarMK flush [target\junit3635960661649353540\junit6063370048779848439]] TarRevisions.java:217 Head state did not change, skipping flush 14:25:57.016 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:25:57.016 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:57.016 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:25:57.016 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:25:57.016 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:25:57.052 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByte 14:25:57.052 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:57.053 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:57.070 INFO [main] FileStore.java:467 TarMK closed: target\junit3635960661649353540\junit6063370048779848439 14:25:57.070 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:25:57.070 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:25:57.101 INFO [main] FileStore.java:467 TarMK closed: target\junit3635960661649353540\junit3475168011428579466 14:25:57.132 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit3981927684638373879\junit3713086843122236130, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:57.132 INFO [main] FileStore.java:240 TarMK opened: target\junit3981927684638373879\junit3713086843122236130 (mmap=false) 14:25:57.132 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit3981927684638373879\junit3713086843122236130\data00000a.tar} 14:25:57.132 DEBUG [main] TarWriter.java:185 Writing segment 90d67eb4-3648-4328-a018-5c9331ae33f5 to target\junit3981927684638373879\junit3713086843122236130\data00000a.tar 14:25:57.149 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit3981927684638373879\junit2973385292568942003, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:25:57.152 INFO [main] FileStore.java:240 TarMK opened: target\junit3981927684638373879\junit2973385292568942003 (mmap=false) 14:25:57.152 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit3981927684638373879\junit2973385292568942003\data00000a.tar} 14:25:57.152 DEBUG [main] TarWriter.java:185 Writing segment 80919eac-d0e5-4d51-a889-10d4fc648b35 to target\junit3981927684638373879\junit2973385292568942003\data00000a.tar 14:25:57.153 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByte2 14:25:57.154 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:25:57.154 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:25:57.217 DEBUG [main] TarWriter.java:185 Writing segment cae5273d-49f7-4cec-aa5e-cb815e776da6 to target\junit3981927684638373879\junit3713086843122236130\data00000a.tar 14:25:57.254 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> cae5273d-49f7-4cec-aa5e-cb815e776da6.0000000c 14:25:57.386 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x91532e4d]' 14:25:57.402 DEBUG [main] StandbyServer.java:249 Binding was successful 14:25:57.502 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client e0c486d0-cd67-4f8e-8387-833a97c1fd39 for current head 14:25:57.533 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:49731 is allowed 14:25:57.533 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:25:57.533 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.533 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.533 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head cae5273d-49f7-4cec-aa5e-cb815e776da6.0000000c to client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.533 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:25:57.533 DEBUG [standby-run-39] StandbyClientSyncExecution.java:103 Found missing segment cae5273d-49f7-4cec-aa5e-cb815e776da6 14:25:57.533 DEBUG [standby-run-39] StandbyClientSyncExecution.java:124 Inspecting segment cae5273d-49f7-4cec-aa5e-cb815e776da6 14:25:57.533 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client e0c486d0-cd67-4f8e-8387-833a97c1fd39 for references of segment cae5273d-49f7-4cec-aa5e-cb815e776da6 14:25:57.533 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:25:57.533 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment cae5273d-49f7-4cec-aa5e-cb815e776da6 for client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.533 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment cae5273d-49f7-4cec-aa5e-cb815e776da6 to client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.533 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:57.533 DEBUG [standby-run-39] StandbyClientSyncExecution.java:184 Found reference from cae5273d-49f7-4cec-aa5e-cb815e776da6 to 90d67eb4-3648-4328-a018-5c9331ae33f5 14:25:57.533 DEBUG [standby-run-39] StandbyClientSyncExecution.java:124 Inspecting segment 90d67eb4-3648-4328-a018-5c9331ae33f5 14:25:57.533 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client e0c486d0-cd67-4f8e-8387-833a97c1fd39 for references of segment 90d67eb4-3648-4328-a018-5c9331ae33f5 14:25:57.533 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:25:57.533 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 90d67eb4-3648-4328-a018-5c9331ae33f5 for client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.533 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 90d67eb4-3648-4328-a018-5c9331ae33f5 to client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.549 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:25:57.550 INFO [standby-run-39] StandbyClientSyncExecution.java:196 Copying data segment 90d67eb4-3648-4328-a018-5c9331ae33f5 from primary 14:25:57.550 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client e0c486d0-cd67-4f8e-8387-833a97c1fd39 for segment 90d67eb4-3648-4328-a018-5c9331ae33f5 14:25:57.551 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:25:57.551 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.551 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 90d67eb4-3648-4328-a018-5c9331ae33f5 for client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.551 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.551 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 90d67eb4-3648-4328-a018-5c9331ae33f5 to client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.552 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:57.552 DEBUG [standby-run-39] TarWriter.java:185 Writing segment 90d67eb4-3648-4328-a018-5c9331ae33f5 to target\junit3981927684638373879\junit2973385292568942003\data00000a.tar 14:25:57.553 INFO [standby-run-39] StandbyClientSyncExecution.java:196 Copying data segment cae5273d-49f7-4cec-aa5e-cb815e776da6 from primary 14:25:57.553 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client e0c486d0-cd67-4f8e-8387-833a97c1fd39 for segment cae5273d-49f7-4cec-aa5e-cb815e776da6 14:25:57.553 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:25:57.553 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.553 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment cae5273d-49f7-4cec-aa5e-cb815e776da6 for client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.554 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.554 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment cae5273d-49f7-4cec-aa5e-cb815e776da6 to client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.554 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:25:57.555 DEBUG [standby-run-39] TarWriter.java:185 Writing segment cae5273d-49f7-4cec-aa5e-cb815e776da6 to target\junit3981927684638373879\junit2973385292568942003\data00000a.tar 14:25:57.555 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client e0c486d0-cd67-4f8e-8387-833a97c1fd39 for blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 14:25:57.555 DEBUG [primary-1] RequestDecoder.java:39 Parsed 'get blob' request 14:25:57.555 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get blob id' received from client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.555 DEBUG [primary-1] GetBlobRequestHandler.java:41 Reading blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 for client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.555 DEBUG [primary-1] CommunicationObserver.java:130 Binary with size 5242880 sent to client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.555 DEBUG [primary-1] GetBlobResponseEncoder.java:41 Sending blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 to client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.555 DEBUG [primary-1] ChunkedBlobStream.java:128 Sending chunk 1/5 of size 1048576 from blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 to client e0c486d0-cd67-4f8e-8387-833a97c1fd39 14:25:57.571 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client e0c486d0-cd67-4f8e-8387-833a97c1fd39 io.netty.handler.codec.compression.DecompressionException: mismatching checksum: 815d6f08 (expected: a2828f9f) at io.netty.handler.codec.compression.Snappy.validateChecksum(Snappy.java:640) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.compression.SnappyFrameDecoder.decode(SnappyFrameDecoder.java:181) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:489) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:428) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1342) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:934) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 14:26:02.151 DEBUG [TarMK flush [target\junit3981927684638373879\junit3713086843122236130]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:02.204 DEBUG [TarMK flush [target\junit3981927684638373879\junit2973385292568942003]] TarRevisions.java:220 TarMK journal update null -> 80919eac-d0e5-4d51-a889-10d4fc648b35.00000005 14:26:02.573 DEBUG [standby-run-39] StandbyClient.java:157 Channel closed 14:26:02.573 ERROR [standby-run-39] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to load remote blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 at /root/server/#testBlob in 5000ms. Please increase the timeout and try again. at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchAndStoreBlob(StandbyDiff.java:208) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchBinary(StandbyDiff.java:196) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchBinary(StandbyDiff.java:181) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.fetchBinary(StandbyDiff.java:169) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.diff(StandbyDiff.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.process(StandbyDiff.java:121) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.childNodeAdded(StandbyDiff.java:94) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.CancelableDiff.childNodeAdded(CancelableDiff.java:76) ~[oak-segment-tar-1.8-SNAPSHOT.jar:na] at org.apache.jackrabbit.oak.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:562) ~[oak-segment-tar-1.8-SNAPSHOT.jar:na] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.diff(StandbyDiff.java:143) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.process(StandbyDiff.java:121) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyDiff.childNodeChanged(StandbyDiff.java:105) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:566) ~[oak-segment-tar-1.8-SNAPSHOT.jar:na] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:101) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxyFlippedIntermediateByte2(DataStoreTestBase.java:316) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 14:26:04.805 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:26:04.858 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 152f32cb-1506-455d-8730-666c3ede79ec for current head 14:26:04.858 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:49756 is allowed 14:26:04.858 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:26:04.858 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.858 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.858 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head cae5273d-49f7-4cec-aa5e-cb815e776da6.0000000c to client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.858 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:26:04.858 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client 152f32cb-1506-455d-8730-666c3ede79ec for blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 14:26:04.858 DEBUG [primary-2] RequestDecoder.java:39 Parsed 'get blob' request 14:26:04.858 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get blob id' received from client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.858 DEBUG [primary-2] GetBlobRequestHandler.java:41 Reading blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 for client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.858 DEBUG [primary-2] CommunicationObserver.java:130 Binary with size 5242880 sent to client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.858 DEBUG [primary-2] GetBlobResponseEncoder.java:41 Sending blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 to client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.858 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 1/5 of size 1048576 from blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 to client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.889 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:26:04.889 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 1/5 of size 1048576 from blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 14:26:04.905 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 2/5 of size 1048576 from blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 to client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.905 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880.tmp 14:26:04.936 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:26:04.936 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 2/5 of size 1048576 from blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 14:26:04.936 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880.tmp 14:26:04.936 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 3/5 of size 1048576 from blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 to client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.958 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:26:04.958 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 3/5 of size 1048576 from blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 14:26:04.958 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880.tmp 14:26:04.958 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 4/5 of size 1048576 from blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 to client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.989 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:26:04.989 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 4/5 of size 1048576 from blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 14:26:04.989 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 5/5 of size 1048576 from blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 to client 152f32cb-1506-455d-8730-666c3ede79ec 14:26:04.989 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880.tmp 14:26:05.005 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:26:05.005 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 5/5 of size 1048576 from blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 14:26:05.021 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880.tmp 14:26:05.021 DEBUG [standby-1] ResponseDecoder.java:167 Received entire blob 52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880 14:26:05.074 DEBUG [standby-run-40] ResponseDecoder.java:66 Processing input stream finished! Deleting file C:\tmp\52d3fd46cf3300f05996147b8c949c16dda412d580817953ef4845e70a0e50e8#5242880.tmp 14:26:05.121 DEBUG [standby-run-40] TarRevisions.java:220 TarMK journal update 80919eac-d0e5-4d51-a889-10d4fc648b35.00000005 -> cae5273d-49f7-4cec-aa5e-cb815e776da6.0000000c 14:26:05.205 INFO [standby-run-40] StandbyClientSyncExecution.java:82 updated head state successfully: true in 347ms. 14:26:05.205 DEBUG [standby-run-40] StandbyClient.java:157 Channel closed 14:26:07.156 DEBUG [TarMK flush [target\junit3981927684638373879\junit3713086843122236130]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:07.157 DEBUG [TarMK flush [target\junit3981927684638373879\junit2973385292568942003]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:07.440 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:26:07.440 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:26:07.440 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:26:07.440 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:26:07.440 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:26:07.462 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByte2 14:26:07.462 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:26:07.462 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:26:07.509 INFO [main] FileStore.java:467 TarMK closed: target\junit3981927684638373879\junit2973385292568942003 14:26:07.509 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:26:07.509 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:26:07.524 INFO [main] FileStore.java:467 TarMK closed: target\junit3981927684638373879\junit3713086843122236130 14:26:07.561 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit3034737711866713864\junit4262009065397381414, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:26:07.562 INFO [main] FileStore.java:240 TarMK opened: target\junit3034737711866713864\junit4262009065397381414 (mmap=false) 14:26:07.562 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit3034737711866713864\junit4262009065397381414\data00000a.tar} 14:26:07.562 DEBUG [main] TarWriter.java:185 Writing segment d92c5951-7af4-4f3b-a838-5e2044c4463d to target\junit3034737711866713864\junit4262009065397381414\data00000a.tar 14:26:07.625 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit3034737711866713864\junit4281842659447566135, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:26:07.625 INFO [main] FileStore.java:240 TarMK opened: target\junit3034737711866713864\junit4281842659447566135 (mmap=false) 14:26:07.625 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit3034737711866713864\junit4281842659447566135\data00000a.tar} 14:26:07.625 DEBUG [main] TarWriter.java:185 Writing segment 7b19b289-4942-4a79-a251-de7c80ccc6bf to target\junit3034737711866713864\junit4281842659447566135\data00000a.tar 14:26:07.625 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedStartByte 14:26:07.625 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:26:07.625 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:26:07.694 DEBUG [main] TarWriter.java:185 Writing segment acb0b826-f89a-4763-a791-c71cfd9d94da to target\junit3034737711866713864\junit4262009065397381414\data00000a.tar 14:26:07.741 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> acb0b826-f89a-4763-a791-c71cfd9d94da.0000000c 14:26:07.863 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x31d96333]' 14:26:07.863 DEBUG [main] StandbyServer.java:249 Binding was successful 14:26:07.979 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client e6ede16d-4d82-46c3-a5b2-ee6c0eee9cf3 for current head 14:26:08.026 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:49846 is allowed 14:26:08.026 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:26:08.026 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client e6ede16d-4d82-46c3-a5b2-ee6c0eee9cf3 14:26:08.026 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client e6ede16d-4d82-46c3-a5b2-ee6c0eee9cf3 14:26:08.026 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head acb0b826-f89a-4763-a791-c71cfd9d94da.0000000c to client e6ede16d-4d82-46c3-a5b2-ee6c0eee9cf3 14:26:08.026 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client e6ede16d-4d82-46c3-a5b2-ee6c0eee9cf3 io.netty.handler.codec.compression.DecompressionException: Received COMPRESSED_DATA tag before STREAM_IDENTIFIER at io.netty.handler.codec.compression.SnappyFrameDecoder.decode(SnappyFrameDecoder.java:162) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:489) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:428) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1342) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:934) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 14:26:12.580 DEBUG [TarMK flush [target\junit3034737711866713864\junit4262009065397381414]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:12.664 DEBUG [TarMK flush [target\junit3034737711866713864\junit4281842659447566135]] TarRevisions.java:220 TarMK journal update null -> 7b19b289-4942-4a79-a251-de7c80ccc6bf.00000005 14:26:12.996 ERROR [standby-run-41] StandbyClientSyncExecution.java:67 Unable to fetch remote head 14:26:12.996 DEBUG [standby-run-41] StandbyClient.java:157 Channel closed 14:26:15.216 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:26:15.300 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 2b25e167-6151-47be-abfa-398f2db4d387 for current head 14:26:15.300 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:49870 is allowed 14:26:15.300 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:26:15.300 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.300 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.300 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head acb0b826-f89a-4763-a791-c71cfd9d94da.0000000c to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:26:15.316 DEBUG [standby-run-42] StandbyClientSyncExecution.java:103 Found missing segment acb0b826-f89a-4763-a791-c71cfd9d94da 14:26:15.316 DEBUG [standby-run-42] StandbyClientSyncExecution.java:124 Inspecting segment acb0b826-f89a-4763-a791-c71cfd9d94da 14:26:15.316 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 2b25e167-6151-47be-abfa-398f2db4d387 for references of segment acb0b826-f89a-4763-a791-c71cfd9d94da 14:26:15.316 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:26:15.316 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment acb0b826-f89a-4763-a791-c71cfd9d94da for client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment acb0b826-f89a-4763-a791-c71cfd9d94da to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:26:15.316 DEBUG [standby-run-42] StandbyClientSyncExecution.java:184 Found reference from acb0b826-f89a-4763-a791-c71cfd9d94da to d92c5951-7af4-4f3b-a838-5e2044c4463d 14:26:15.316 DEBUG [standby-run-42] StandbyClientSyncExecution.java:124 Inspecting segment d92c5951-7af4-4f3b-a838-5e2044c4463d 14:26:15.316 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 2b25e167-6151-47be-abfa-398f2db4d387 for references of segment d92c5951-7af4-4f3b-a838-5e2044c4463d 14:26:15.316 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:26:15.316 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment d92c5951-7af4-4f3b-a838-5e2044c4463d for client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment d92c5951-7af4-4f3b-a838-5e2044c4463d to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:26:15.316 INFO [standby-run-42] StandbyClientSyncExecution.java:196 Copying data segment d92c5951-7af4-4f3b-a838-5e2044c4463d from primary 14:26:15.316 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 2b25e167-6151-47be-abfa-398f2db4d387 for segment d92c5951-7af4-4f3b-a838-5e2044c4463d 14:26:15.316 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:26:15.316 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment d92c5951-7af4-4f3b-a838-5e2044c4463d for client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment d92c5951-7af4-4f3b-a838-5e2044c4463d to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:26:15.316 DEBUG [standby-run-42] TarWriter.java:185 Writing segment d92c5951-7af4-4f3b-a838-5e2044c4463d to target\junit3034737711866713864\junit4281842659447566135\data00000a.tar 14:26:15.316 INFO [standby-run-42] StandbyClientSyncExecution.java:196 Copying data segment acb0b826-f89a-4763-a791-c71cfd9d94da from primary 14:26:15.316 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 2b25e167-6151-47be-abfa-398f2db4d387 for segment acb0b826-f89a-4763-a791-c71cfd9d94da 14:26:15.316 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:26:15.316 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment acb0b826-f89a-4763-a791-c71cfd9d94da for client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment acb0b826-f89a-4763-a791-c71cfd9d94da to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:26:15.316 DEBUG [standby-run-42] TarWriter.java:185 Writing segment acb0b826-f89a-4763-a791-c71cfd9d94da to target\junit3034737711866713864\junit4281842659447566135\data00000a.tar 14:26:15.316 DEBUG [standby-1] GetBlobRequestEncoder.java:33 Sending request from client 2b25e167-6151-47be-abfa-398f2db4d387 for blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 14:26:15.316 DEBUG [primary-2] RequestDecoder.java:39 Parsed 'get blob' request 14:26:15.316 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get blob id' received from client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [primary-2] GetBlobRequestHandler.java:41 Reading blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 for client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [primary-2] CommunicationObserver.java:130 Binary with size 5242880 sent to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.316 DEBUG [primary-2] GetBlobResponseEncoder.java:41 Sending blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.332 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 1/5 of size 1048576 from blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.369 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:26:15.369 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 1/5 of size 1048576 from blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 14:26:15.385 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880.tmp 14:26:15.385 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 2/5 of size 1048576 from blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.448 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:26:15.448 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 2/5 of size 1048576 from blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 14:26:15.448 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880.tmp 14:26:15.448 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 3/5 of size 1048576 from blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.501 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:26:15.501 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 3/5 of size 1048576 from blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 14:26:15.501 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880.tmp 14:26:15.501 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 4/5 of size 1048576 from blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.548 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:26:15.548 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 4/5 of size 1048576 from blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 14:26:15.548 DEBUG [primary-2] ChunkedBlobStream.java:128 Sending chunk 5/5 of size 1048576 from blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 to client 2b25e167-6151-47be-abfa-398f2db4d387 14:26:15.548 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880.tmp 14:26:15.588 DEBUG [standby-1] ResponseDecoder.java:90 Decoding 'get blob' response 14:26:15.588 DEBUG [standby-1] ResponseDecoder.java:150 Received chunk 5/5 of size 1048576 from blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 14:26:15.588 DEBUG [standby-1] ResponseDecoder.java:159 All checks OK. Appending chunk to disk to C:\tmp\8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880.tmp 14:26:15.604 DEBUG [standby-1] ResponseDecoder.java:167 Received entire blob 8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880 14:26:15.651 DEBUG [standby-run-42] ResponseDecoder.java:66 Processing input stream finished! Deleting file C:\tmp\8fd52bb05e12015665f1038f873446477903457a114b44c5069d832b38f9dcf9#5242880.tmp 14:26:15.704 DEBUG [standby-run-42] TarRevisions.java:220 TarMK journal update 7b19b289-4942-4a79-a251-de7c80ccc6bf.00000005 -> acb0b826-f89a-4763-a791-c71cfd9d94da.0000000c 14:26:15.772 INFO [standby-run-42] StandbyClientSyncExecution.java:82 updated head state successfully: true in 456ms. 14:26:15.772 DEBUG [standby-run-42] StandbyClient.java:157 Channel closed 14:26:17.567 DEBUG [TarMK flush [target\junit3034737711866713864\junit4262009065397381414]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:17.636 DEBUG [TarMK flush [target\junit3034737711866713864\junit4281842659447566135]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:18.106 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:26:18.106 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:26:18.106 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:26:18.106 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:26:18.106 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:26:18.106 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedStartByte 14:26:18.106 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:26:18.106 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:26:18.137 INFO [main] FileStore.java:467 TarMK closed: target\junit3034737711866713864\junit4281842659447566135 14:26:18.137 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:26:18.137 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:26:18.175 INFO [main] FileStore.java:467 TarMK closed: target\junit3034737711866713864\junit4262009065397381414 14:26:18.191 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit1204193530398667087\junit5980022768716933972, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:26:18.191 INFO [main] FileStore.java:240 TarMK opened: target\junit1204193530398667087\junit5980022768716933972 (mmap=false) 14:26:18.191 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit1204193530398667087\junit5980022768716933972\data00000a.tar} 14:26:18.191 DEBUG [main] TarWriter.java:185 Writing segment 46a2f1ed-60ea-4036-ad1c-4162f964a6ba to target\junit1204193530398667087\junit5980022768716933972\data00000a.tar 14:26:18.206 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit1204193530398667087\junit4376159587715675755, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:26:18.206 INFO [main] FileStore.java:240 TarMK opened: target\junit1204193530398667087\junit4376159587715675755 (mmap=false) 14:26:18.206 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit1204193530398667087\junit4376159587715675755\data00000a.tar} 14:26:18.206 DEBUG [main] TarWriter.java:185 Writing segment dfe05104-b47f-40aa-aa36-3bbcfa2c269b to target\junit1204193530398667087\junit4376159587715675755\data00000a.tar 14:26:18.206 INFO [main] DataStoreTestBase.java:127 Test begin: testSyncBigBlob 14:26:18.206 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:26:18.206 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:26:24.477 DEBUG [TarMK flush [target\junit1204193530398667087\junit4376159587715675755]] TarRevisions.java:220 TarMK journal update null -> dfe05104-b47f-40aa-aa36-3bbcfa2c269b.00000005 14:26:28.225 DEBUG [TarMK flush [target\junit1204193530398667087\junit4376159587715675755]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:33.214 DEBUG [TarMK flush [target\junit1204193530398667087\junit4376159587715675755]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:38.214 DEBUG [TarMK flush [target\junit1204193530398667087\junit4376159587715675755]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:43.224 DEBUG [TarMK flush [target\junit1204193530398667087\junit4376159587715675755]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:48.218 DEBUG [TarMK flush [target\junit1204193530398667087\junit4376159587715675755]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:49.970 DEBUG [TarMK flush [target\junit1204193530398667087\junit5980022768716933972]] TarWriter.java:185 Writing segment 14237e66-43cb-4b98-a0c4-185a1822b2bf to target\junit1204193530398667087\junit5980022768716933972\data00000a.tar 14:26:50.149 DEBUG [TarMK flush [target\junit1204193530398667087\junit5980022768716933972]] TarRevisions.java:220 TarMK journal update null -> 46a2f1ed-60ea-4036-ad1c-4162f964a6ba.00000005 14:26:50.272 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xd561ef1a]' 14:26:50.272 DEBUG [main] StandbyServer.java:249 Binding was successful 14:26:50.272 DEBUG [main] TarRevisions.java:208 Unable to lock the journal, skipping flush 14:26:50.287 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 70103bca-b997-4d03-bbbf-4e862a6b8e04 for current head 14:26:50.287 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:49960 is allowed 14:26:50.287 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:26:50.287 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 70103bca-b997-4d03-bbbf-4e862a6b8e04 14:26:50.287 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 70103bca-b997-4d03-bbbf-4e862a6b8e04 14:26:50.641 DEBUG [TarMK flush [target\junit1204193530398667087\junit5980022768716933972]] TarWriter.java:185 Writing segment f8225e28-3e02-4cc2-a39f-76d36ce8f3cf to target\junit1204193530398667087\junit5980022768716933972\data00000a.tar 14:26:50.671 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 46a2f1ed-60ea-4036-ad1c-4162f964a6ba.00000005 to client 70103bca-b997-4d03-bbbf-4e862a6b8e04 14:26:50.671 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:26:50.671 DEBUG [standby-run-43] StandbyClientSyncExecution.java:103 Found missing segment 46a2f1ed-60ea-4036-ad1c-4162f964a6ba 14:26:50.671 DEBUG [standby-run-43] StandbyClientSyncExecution.java:124 Inspecting segment 46a2f1ed-60ea-4036-ad1c-4162f964a6ba 14:26:50.671 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 70103bca-b997-4d03-bbbf-4e862a6b8e04 for references of segment 46a2f1ed-60ea-4036-ad1c-4162f964a6ba 14:26:50.671 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:26:50.671 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 46a2f1ed-60ea-4036-ad1c-4162f964a6ba for client 70103bca-b997-4d03-bbbf-4e862a6b8e04 14:26:50.808 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 46a2f1ed-60ea-4036-ad1c-4162f964a6ba to client 70103bca-b997-4d03-bbbf-4e862a6b8e04 14:26:50.808 DEBUG [TarMK flush [target\junit1204193530398667087\junit5980022768716933972]] TarRevisions.java:220 TarMK journal update 46a2f1ed-60ea-4036-ad1c-4162f964a6ba.00000005 -> f8225e28-3e02-4cc2-a39f-76d36ce8f3cf.0000000b 14:26:50.808 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:26:50.808 INFO [standby-run-43] StandbyClientSyncExecution.java:196 Copying data segment 46a2f1ed-60ea-4036-ad1c-4162f964a6ba from primary 14:26:50.808 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 70103bca-b997-4d03-bbbf-4e862a6b8e04 for segment 46a2f1ed-60ea-4036-ad1c-4162f964a6ba 14:26:50.808 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:26:50.808 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 70103bca-b997-4d03-bbbf-4e862a6b8e04 14:26:50.808 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 46a2f1ed-60ea-4036-ad1c-4162f964a6ba for client 70103bca-b997-4d03-bbbf-4e862a6b8e04 14:26:50.808 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 70103bca-b997-4d03-bbbf-4e862a6b8e04 14:26:50.808 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 46a2f1ed-60ea-4036-ad1c-4162f964a6ba to client 70103bca-b997-4d03-bbbf-4e862a6b8e04 14:26:50.808 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:26:50.808 DEBUG [standby-run-43] TarWriter.java:185 Writing segment 46a2f1ed-60ea-4036-ad1c-4162f964a6ba to target\junit1204193530398667087\junit4376159587715675755\data00000a.tar 14:26:51.092 DEBUG [standby-run-43] TarRevisions.java:220 TarMK journal update dfe05104-b47f-40aa-aa36-3bbcfa2c269b.00000005 -> 46a2f1ed-60ea-4036-ad1c-4162f964a6ba.00000005 14:26:51.155 DEBUG [TarMK flush [target\junit1204193530398667087\junit5980022768716933972]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:51.155 DEBUG [TarMK flush [target\junit1204193530398667087\junit5980022768716933972]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:51.155 DEBUG [TarMK flush [target\junit1204193530398667087\junit5980022768716933972]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:51.155 DEBUG [TarMK flush [target\junit1204193530398667087\junit5980022768716933972]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:51.355 INFO [standby-run-43] StandbyClientSyncExecution.java:82 updated head state successfully: true in 684ms. 14:26:51.355 DEBUG [standby-run-43] StandbyClient.java:157 Channel closed 14:26:53.211 DEBUG [TarMK flush [target\junit1204193530398667087\junit5980022768716933972]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:53.227 DEBUG [TarMK flush [target\junit1204193530398667087\junit4376159587715675755]] TarRevisions.java:217 Head state did not change, skipping flush 14:26:53.574 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:26:53.574 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:26:53.574 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:26:53.574 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:26:53.596 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:26:53.596 INFO [main] DataStoreTestBase.java:132 Test end: testSyncBigBlob 14:26:53.596 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:26:53.596 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:26:53.674 INFO [main] FileStore.java:467 TarMK closed: target\junit1204193530398667087\junit4376159587715675755 14:26:53.674 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:26:53.674 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:26:53.712 INFO [main] FileStore.java:467 TarMK closed: target\junit1204193530398667087\junit5980022768716933972