14:26:54.798 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit4496683605241071202\junit7011143792181717797, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:26:54.798 INFO [main] FileStore.java:240 TarMK opened: target\junit4496683605241071202\junit7011143792181717797 (mmap=false) 14:26:54.798 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit4496683605241071202\junit7011143792181717797\data00000a.tar} 14:26:54.798 DEBUG [main] TarWriter.java:185 Writing segment 39331ebd-9039-4850-a63b-d352137ef4a5 to target\junit4496683605241071202\junit7011143792181717797\data00000a.tar 14:26:54.798 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit4496683605241071202\junit8202800825968279509, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:26:54.814 INFO [main] FileStore.java:240 TarMK opened: target\junit4496683605241071202\junit8202800825968279509 (mmap=false) 14:26:54.814 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit4496683605241071202\junit8202800825968279509\data00000a.tar} 14:26:54.814 DEBUG [main] TarWriter.java:185 Writing segment ac626077-8efa-4ebe-a5c6-9f2e692dbfde to target\junit4496683605241071202\junit8202800825968279509\data00000a.tar 14:26:54.814 INFO [main] DataStoreTestBase.java:127 Test begin: testResilientSync 14:26:54.814 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:26:54.814 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:26:54.976 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xc8e61dce]' 14:26:54.976 DEBUG [main] StandbyServer.java:249 Binding was successful 14:26:54.976 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 4294db66-fda3-4f0a-b0b5-16e61f38d66a for current head 14:26:54.976 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50005 is allowed 14:26:54.976 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:26:54.976 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 4294db66-fda3-4f0a-b0b5-16e61f38d66a 14:26:54.976 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 4294db66-fda3-4f0a-b0b5-16e61f38d66a 14:26:58.987 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 4294db66-fda3-4f0a-b0b5-16e61f38d66a io.netty.handler.timeout.ReadTimeoutException: null 14:26:58.988 ERROR [standby-run-44] StandbyClientSyncExecution.java:67 Unable to fetch remote head 14:26:58.988 DEBUG [standby-run-44] StandbyClient.java:157 Channel closed 14:26:59.805 DEBUG [TarMK flush [target\junit4496683605241071202\junit7011143792181717797]] TarWriter.java:185 Writing segment 1fc51717-3e5c-4f57-aedf-8e446c90a590 to target\junit4496683605241071202\junit7011143792181717797\data00000a.tar 14:26:59.897 DEBUG [TarMK flush [target\junit4496683605241071202\junit7011143792181717797]] TarRevisions.java:220 TarMK journal update null -> 1fc51717-3e5c-4f57-aedf-8e446c90a590.0000000c 14:26:59.919 DEBUG [TarMK flush [target\junit4496683605241071202\junit8202800825968279509]] TarRevisions.java:220 TarMK journal update null -> ac626077-8efa-4ebe-a5c6-9f2e692dbfde.00000005 14:27:00.022 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 1fc51717-3e5c-4f57-aedf-8e446c90a590.0000000c to client 4294db66-fda3-4f0a-b0b5-16e61f38d66a 14:27:00.022 WARN [primary-1] ExceptionHandler.java:31 Exception caught on the server java.io.IOException: Eine bestehende Verbindung wurde softwaregesteuert durch den Hostcomputer abgebrochen at sun.nio.ch.SocketDispatcher.read0(Native Method) ~[na:1.8.0_151] at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43) ~[na:1.8.0_151] at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) ~[na:1.8.0_151] at sun.nio.ch.IOUtil.read(IOUtil.java:192) ~[na:1.8.0_151] at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) ~[na:1.8.0_151] at io.netty.buffer.PooledUnsafeDirectByteBuf.setBytes(PooledUnsafeDirectByteBuf.java:288) ~[netty-buffer-4.1.14.Final.jar:4.1.14.Final] at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1106) ~[netty-buffer-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:372) ~[netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:123) ~[netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 14:27:01.228 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:01.228 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:01.228 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:01.228 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:27:01.228 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:27:01.329 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x09bc776f]' 14:27:01.329 DEBUG [main] StandbyServer.java:249 Binding was successful 14:27:01.329 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client c1a3d484-75d1-4f74-99a7-9387e770e05f for current head 14:27:01.329 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50047 is allowed 14:27:01.329 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:27:01.329 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.329 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.329 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 1fc51717-3e5c-4f57-aedf-8e446c90a590.0000000c to client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.329 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:01.329 DEBUG [standby-run-45] StandbyClientSyncExecution.java:103 Found missing segment 1fc51717-3e5c-4f57-aedf-8e446c90a590 14:27:01.329 DEBUG [standby-run-45] StandbyClientSyncExecution.java:124 Inspecting segment 1fc51717-3e5c-4f57-aedf-8e446c90a590 14:27:01.329 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client c1a3d484-75d1-4f74-99a7-9387e770e05f for references of segment 1fc51717-3e5c-4f57-aedf-8e446c90a590 14:27:01.329 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:01.329 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 1fc51717-3e5c-4f57-aedf-8e446c90a590 for client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.329 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 1fc51717-3e5c-4f57-aedf-8e446c90a590 to client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.329 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:01.329 DEBUG [standby-run-45] StandbyClientSyncExecution.java:184 Found reference from 1fc51717-3e5c-4f57-aedf-8e446c90a590 to 39331ebd-9039-4850-a63b-d352137ef4a5 14:27:01.329 DEBUG [standby-run-45] StandbyClientSyncExecution.java:124 Inspecting segment 39331ebd-9039-4850-a63b-d352137ef4a5 14:27:01.329 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client c1a3d484-75d1-4f74-99a7-9387e770e05f for references of segment 39331ebd-9039-4850-a63b-d352137ef4a5 14:27:01.329 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:01.329 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 39331ebd-9039-4850-a63b-d352137ef4a5 for client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.329 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 39331ebd-9039-4850-a63b-d352137ef4a5 to client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.329 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:01.329 INFO [standby-run-45] StandbyClientSyncExecution.java:196 Copying data segment 39331ebd-9039-4850-a63b-d352137ef4a5 from primary 14:27:01.329 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client c1a3d484-75d1-4f74-99a7-9387e770e05f for segment 39331ebd-9039-4850-a63b-d352137ef4a5 14:27:01.329 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:27:01.329 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.329 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 39331ebd-9039-4850-a63b-d352137ef4a5 for client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.329 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.329 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 39331ebd-9039-4850-a63b-d352137ef4a5 to client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.329 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:01.329 DEBUG [standby-run-45] TarWriter.java:185 Writing segment 39331ebd-9039-4850-a63b-d352137ef4a5 to target\junit4496683605241071202\junit8202800825968279509\data00000a.tar 14:27:01.329 INFO [standby-run-45] StandbyClientSyncExecution.java:196 Copying data segment 1fc51717-3e5c-4f57-aedf-8e446c90a590 from primary 14:27:01.344 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client c1a3d484-75d1-4f74-99a7-9387e770e05f for segment 1fc51717-3e5c-4f57-aedf-8e446c90a590 14:27:01.344 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:27:01.344 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.344 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 1fc51717-3e5c-4f57-aedf-8e446c90a590 for client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.344 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.344 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 1fc51717-3e5c-4f57-aedf-8e446c90a590 to client c1a3d484-75d1-4f74-99a7-9387e770e05f 14:27:01.344 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:01.344 DEBUG [standby-run-45] TarWriter.java:185 Writing segment 1fc51717-3e5c-4f57-aedf-8e446c90a590 to target\junit4496683605241071202\junit8202800825968279509\data00000a.tar 14:27:01.391 DEBUG [standby-run-45] TarRevisions.java:220 TarMK journal update ac626077-8efa-4ebe-a5c6-9f2e692dbfde.00000005 -> 1fc51717-3e5c-4f57-aedf-8e446c90a590.0000000c 14:27:01.460 INFO [standby-run-45] StandbyClientSyncExecution.java:82 updated head state successfully: true in 131ms. 14:27:01.460 DEBUG [standby-run-45] StandbyClient.java:157 Channel closed 14:27:03.711 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:03.711 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:03.712 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:03.713 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:27:03.716 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:27:03.716 INFO [main] DataStoreTestBase.java:132 Test end: testResilientSync 14:27:03.716 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:03.716 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:03.812 INFO [main] FileStore.java:467 TarMK closed: target\junit4496683605241071202\junit8202800825968279509 14:27:03.812 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:03.813 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:03.831 INFO [main] FileStore.java:467 TarMK closed: target\junit4496683605241071202\junit7011143792181717797 14:27:03.863 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit2312103719061330945\junit3005515481789662794, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:03.863 INFO [main] FileStore.java:240 TarMK opened: target\junit2312103719061330945\junit3005515481789662794 (mmap=false) 14:27:03.863 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit2312103719061330945\junit3005515481789662794\data00000a.tar} 14:27:03.863 DEBUG [main] TarWriter.java:185 Writing segment 2a503c57-a13b-4aaa-abcc-831592f8f075 to target\junit2312103719061330945\junit3005515481789662794\data00000a.tar 14:27:03.878 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit2312103719061330945\junit2135031827135405294, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:03.878 INFO [main] FileStore.java:240 TarMK opened: target\junit2312103719061330945\junit2135031827135405294 (mmap=false) 14:27:03.878 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit2312103719061330945\junit2135031827135405294\data00000a.tar} 14:27:03.878 DEBUG [main] TarWriter.java:185 Writing segment 7aa0ffff-9948-4bf2-a116-f4a321268a7f to target\junit2312103719061330945\junit2135031827135405294\data00000a.tar 14:27:03.878 INFO [main] DataStoreTestBase.java:127 Test begin: testProxySkippedBytes 14:27:03.878 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:27:03.878 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:27:03.963 DEBUG [main] TarWriter.java:185 Writing segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 to target\junit2312103719061330945\junit3005515481789662794\data00000a.tar 14:27:04.032 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> ceb7b317-8b4c-4ed0-a3ea-88a8d0974944.0000000c 14:27:04.168 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x726c07df]' 14:27:04.170 DEBUG [main] StandbyServer.java:249 Binding was successful 14:27:04.309 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client dbc19062-847e-41a1-bb29-3d52efb2bea0 for current head 14:27:04.340 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50139 is allowed 14:27:04.340 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:27:04.340 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client dbc19062-847e-41a1-bb29-3d52efb2bea0 14:27:04.340 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client dbc19062-847e-41a1-bb29-3d52efb2bea0 14:27:04.340 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head ceb7b317-8b4c-4ed0-a3ea-88a8d0974944.0000000c to client dbc19062-847e-41a1-bb29-3d52efb2bea0 14:27:04.340 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:04.340 DEBUG [standby-run-46] StandbyClientSyncExecution.java:103 Found missing segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 14:27:04.340 DEBUG [standby-run-46] StandbyClientSyncExecution.java:124 Inspecting segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 14:27:04.340 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client dbc19062-847e-41a1-bb29-3d52efb2bea0 for references of segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 14:27:04.340 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:04.340 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 for client dbc19062-847e-41a1-bb29-3d52efb2bea0 14:27:04.340 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 to client dbc19062-847e-41a1-bb29-3d52efb2bea0 14:27:08.890 DEBUG [TarMK flush [target\junit2312103719061330945\junit3005515481789662794]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:08.908 DEBUG [TarMK flush [target\junit2312103719061330945\junit2135031827135405294]] TarRevisions.java:220 TarMK journal update null -> 7aa0ffff-9948-4bf2-a116-f4a321268a7f.00000005 14:27:09.360 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client dbc19062-847e-41a1-bb29-3d52efb2bea0 io.netty.handler.timeout.ReadTimeoutException: null 14:27:09.360 DEBUG [standby-run-46] StandbyClient.java:157 Channel closed 14:27:09.360 ERROR [standby-run-46] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxySkippedBytes(DataStoreTestBase.java:296) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 14:27:11.679 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:11.717 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client c768272d-5d85-402d-8c62-39d12c1aafe1 for current head 14:27:11.717 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:50164 is allowed 14:27:11.733 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:27:11.733 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head ceb7b317-8b4c-4ed0-a3ea-88a8d0974944.0000000c to client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:11.733 DEBUG [standby-run-47] StandbyClientSyncExecution.java:103 Found missing segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 14:27:11.733 DEBUG [standby-run-47] StandbyClientSyncExecution.java:124 Inspecting segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 14:27:11.733 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client c768272d-5d85-402d-8c62-39d12c1aafe1 for references of segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 14:27:11.733 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:11.733 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 for client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 to client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:11.733 DEBUG [standby-run-47] StandbyClientSyncExecution.java:184 Found reference from ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 to 2a503c57-a13b-4aaa-abcc-831592f8f075 14:27:11.733 DEBUG [standby-run-47] StandbyClientSyncExecution.java:124 Inspecting segment 2a503c57-a13b-4aaa-abcc-831592f8f075 14:27:11.733 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client c768272d-5d85-402d-8c62-39d12c1aafe1 for references of segment 2a503c57-a13b-4aaa-abcc-831592f8f075 14:27:11.733 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:11.733 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 2a503c57-a13b-4aaa-abcc-831592f8f075 for client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 2a503c57-a13b-4aaa-abcc-831592f8f075 to client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:11.733 INFO [standby-run-47] StandbyClientSyncExecution.java:196 Copying data segment 2a503c57-a13b-4aaa-abcc-831592f8f075 from primary 14:27:11.733 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client c768272d-5d85-402d-8c62-39d12c1aafe1 for segment 2a503c57-a13b-4aaa-abcc-831592f8f075 14:27:11.733 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:11.733 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 2a503c57-a13b-4aaa-abcc-831592f8f075 for client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 2a503c57-a13b-4aaa-abcc-831592f8f075 to client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:11.733 DEBUG [standby-run-47] TarWriter.java:185 Writing segment 2a503c57-a13b-4aaa-abcc-831592f8f075 to target\junit2312103719061330945\junit2135031827135405294\data00000a.tar 14:27:11.733 INFO [standby-run-47] StandbyClientSyncExecution.java:196 Copying data segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 from primary 14:27:11.733 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client c768272d-5d85-402d-8c62-39d12c1aafe1 for segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 14:27:11.733 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:11.733 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 for client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 to client c768272d-5d85-402d-8c62-39d12c1aafe1 14:27:11.733 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:11.733 DEBUG [standby-run-47] TarWriter.java:185 Writing segment ceb7b317-8b4c-4ed0-a3ea-88a8d0974944 to target\junit2312103719061330945\junit2135031827135405294\data00000a.tar 14:27:11.764 DEBUG [standby-run-47] TarRevisions.java:220 TarMK journal update 7aa0ffff-9948-4bf2-a116-f4a321268a7f.00000005 -> ceb7b317-8b4c-4ed0-a3ea-88a8d0974944.0000000c 14:27:11.833 INFO [standby-run-47] StandbyClientSyncExecution.java:82 updated head state successfully: true in 100ms. 14:27:11.833 DEBUG [standby-run-47] StandbyClient.java:157 Channel closed 14:27:13.883 DEBUG [TarMK flush [target\junit2312103719061330945\junit3005515481789662794]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:13.883 DEBUG [TarMK flush [target\junit2312103719061330945\junit2135031827135405294]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:14.137 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:14.137 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:14.137 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:14.137 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:27:14.137 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:27:14.137 INFO [main] DataStoreTestBase.java:132 Test end: testProxySkippedBytes 14:27:14.137 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:14.137 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:14.216 INFO [main] FileStore.java:467 TarMK closed: target\junit2312103719061330945\junit2135031827135405294 14:27:14.217 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:14.217 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:14.237 INFO [main] FileStore.java:467 TarMK closed: target\junit2312103719061330945\junit3005515481789662794 14:27:14.269 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit2093627154151323365\junit7700809919995565716, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:14.269 INFO [main] FileStore.java:240 TarMK opened: target\junit2093627154151323365\junit7700809919995565716 (mmap=false) 14:27:14.269 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit2093627154151323365\junit7700809919995565716\data00000a.tar} 14:27:14.269 DEBUG [main] TarWriter.java:185 Writing segment 55a318ba-7ca3-4e27-a14a-7c8e48f8dc4a to target\junit2093627154151323365\junit7700809919995565716\data00000a.tar 14:27:14.269 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit2093627154151323365\junit2002148481134286372, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:14.269 INFO [main] FileStore.java:240 TarMK opened: target\junit2093627154151323365\junit2002148481134286372 (mmap=false) 14:27:14.269 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit2093627154151323365\junit2002148481134286372\data00000a.tar} 14:27:14.269 DEBUG [main] TarWriter.java:185 Writing segment 5b2f51cc-ecb4-4b18-a376-18450b788bbd to target\junit2093627154151323365\junit2002148481134286372\data00000a.tar 14:27:14.269 INFO [main] DataStoreTestBase.java:127 Test begin: testSyncUpdatedBinaryProperty 14:27:14.269 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:27:14.269 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:27:14.369 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x9c31c04f]' 14:27:14.369 DEBUG [main] StandbyServer.java:249 Binding was successful 14:27:14.453 DEBUG [main] TarWriter.java:185 Writing segment 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a to target\junit2093627154151323365\junit7700809919995565716\data00000a.tar 14:27:14.500 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a.0000000c 14:27:14.569 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 for current head 14:27:14.569 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50204 is allowed 14:27:14.569 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:27:14.569 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.569 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.569 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a.0000000c to client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.569 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:14.569 DEBUG [standby-run-48] StandbyClientSyncExecution.java:103 Found missing segment 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a 14:27:14.569 DEBUG [standby-run-48] StandbyClientSyncExecution.java:124 Inspecting segment 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a 14:27:14.569 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 for references of segment 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a 14:27:14.569 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:14.569 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a for client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.569 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a to client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.569 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:14.569 DEBUG [standby-run-48] StandbyClientSyncExecution.java:184 Found reference from 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a to 55a318ba-7ca3-4e27-a14a-7c8e48f8dc4a 14:27:14.569 DEBUG [standby-run-48] StandbyClientSyncExecution.java:124 Inspecting segment 55a318ba-7ca3-4e27-a14a-7c8e48f8dc4a 14:27:14.569 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 for references of segment 55a318ba-7ca3-4e27-a14a-7c8e48f8dc4a 14:27:14.569 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:14.569 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 55a318ba-7ca3-4e27-a14a-7c8e48f8dc4a for client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.569 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 55a318ba-7ca3-4e27-a14a-7c8e48f8dc4a to client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.585 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:14.585 INFO [standby-run-48] StandbyClientSyncExecution.java:196 Copying data segment 55a318ba-7ca3-4e27-a14a-7c8e48f8dc4a from primary 14:27:14.585 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 for segment 55a318ba-7ca3-4e27-a14a-7c8e48f8dc4a 14:27:14.585 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:27:14.585 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.585 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 55a318ba-7ca3-4e27-a14a-7c8e48f8dc4a for client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.585 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.585 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 55a318ba-7ca3-4e27-a14a-7c8e48f8dc4a to client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.585 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:14.585 DEBUG [standby-run-48] TarWriter.java:185 Writing segment 55a318ba-7ca3-4e27-a14a-7c8e48f8dc4a to target\junit2093627154151323365\junit2002148481134286372\data00000a.tar 14:27:14.585 INFO [standby-run-48] StandbyClientSyncExecution.java:196 Copying data segment 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a from primary 14:27:14.585 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 for segment 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a 14:27:14.585 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:27:14.585 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.585 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a for client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.585 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.585 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a to client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:14.585 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:14.585 DEBUG [standby-run-48] TarWriter.java:185 Writing segment 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a to target\junit2093627154151323365\junit2002148481134286372\data00000a.tar 14:27:14.622 DEBUG [standby-run-48] TarRevisions.java:220 TarMK journal update null -> 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a.0000000c 14:27:14.684 INFO [standby-run-48] StandbyClientSyncExecution.java:82 updated head state successfully: true in 115ms. 14:27:14.684 DEBUG [standby-run-48] StandbyClient.java:157 Channel closed 14:27:14.901 DEBUG [main] TarWriter.java:185 Writing segment ad73072a-67d5-4eaf-abe8-ecf99db3a9fa to target\junit2093627154151323365\junit7700809919995565716\data00000a.tar 14:27:14.938 DEBUG [main] TarRevisions.java:220 TarMK journal update 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a.0000000c -> ad73072a-67d5-4eaf-abe8-ecf99db3a9fa.00000006 14:27:15.038 DEBUG [standby-2] GetHeadRequestEncoder.java:33 Sending request from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 for current head 14:27:15.038 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:50205 is allowed 14:27:15.038 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:27:15.038 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:15.038 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:15.038 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head ad73072a-67d5-4eaf-abe8-ecf99db3a9fa.00000006 to client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:15.038 DEBUG [standby-2] ResponseDecoder.java:82 Decoding 'get head' response 14:27:15.038 DEBUG [standby-run-49] StandbyClientSyncExecution.java:103 Found missing segment ad73072a-67d5-4eaf-abe8-ecf99db3a9fa 14:27:15.038 DEBUG [standby-run-49] StandbyClientSyncExecution.java:124 Inspecting segment ad73072a-67d5-4eaf-abe8-ecf99db3a9fa 14:27:15.038 DEBUG [standby-2] GetReferencesRequestEncoder.java:33 Sending request from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 for references of segment ad73072a-67d5-4eaf-abe8-ecf99db3a9fa 14:27:15.038 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:15.038 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment ad73072a-67d5-4eaf-abe8-ecf99db3a9fa for client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:15.038 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment ad73072a-67d5-4eaf-abe8-ecf99db3a9fa to client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:15.038 DEBUG [standby-2] ResponseDecoder.java:94 Decoding 'get references' response 14:27:15.038 INFO [standby-run-49] StandbyClientSyncExecution.java:196 Copying data segment ad73072a-67d5-4eaf-abe8-ecf99db3a9fa from primary 14:27:15.038 DEBUG [standby-2] GetSegmentRequestEncoder.java:33 Sending request from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 for segment ad73072a-67d5-4eaf-abe8-ecf99db3a9fa 14:27:15.038 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:15.038 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:15.038 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment ad73072a-67d5-4eaf-abe8-ecf99db3a9fa for client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:15.038 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:15.038 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment ad73072a-67d5-4eaf-abe8-ecf99db3a9fa to client 35fe29aa-cd07-4c75-aaab-67ec03928e18 14:27:15.038 DEBUG [standby-2] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:15.038 DEBUG [standby-run-49] TarWriter.java:185 Writing segment ad73072a-67d5-4eaf-abe8-ecf99db3a9fa to target\junit2093627154151323365\junit2002148481134286372\data00000a.tar 14:27:15.122 DEBUG [standby-run-49] TarRevisions.java:220 TarMK journal update 4ec4e0ce-f3fa-47b1-a4e7-087582cdcf5a.0000000c -> ad73072a-67d5-4eaf-abe8-ecf99db3a9fa.00000006 14:27:15.238 INFO [standby-run-49] StandbyClientSyncExecution.java:82 updated head state successfully: true in 200ms. 14:27:15.238 DEBUG [standby-run-49] StandbyClient.java:157 Channel closed 14:27:17.554 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:17.554 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:17.554 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:17.554 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:27:17.554 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:27:17.554 INFO [main] DataStoreTestBase.java:132 Test end: testSyncUpdatedBinaryProperty 14:27:17.554 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:17.554 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:17.620 INFO [main] FileStore.java:467 TarMK closed: target\junit2093627154151323365\junit2002148481134286372 14:27:17.620 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:17.621 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:17.639 INFO [main] FileStore.java:467 TarMK closed: target\junit2093627154151323365\junit7700809919995565716 14:27:17.670 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit5586806176092288049\junit4581121786677137491, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:17.670 INFO [main] FileStore.java:240 TarMK opened: target\junit5586806176092288049\junit4581121786677137491 (mmap=false) 14:27:17.670 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit5586806176092288049\junit4581121786677137491\data00000a.tar} 14:27:17.670 DEBUG [main] TarWriter.java:185 Writing segment ab3aa719-ee02-421a-a61d-278ac86b0e38 to target\junit5586806176092288049\junit4581121786677137491\data00000a.tar 14:27:17.670 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit5586806176092288049\junit1963727167439425614, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:17.670 INFO [main] FileStore.java:240 TarMK opened: target\junit5586806176092288049\junit1963727167439425614 (mmap=false) 14:27:17.670 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit5586806176092288049\junit1963727167439425614\data00000a.tar} 14:27:17.670 DEBUG [main] TarWriter.java:185 Writing segment fa3fb6bc-6b0b-4a2b-ae15-450002f2f702 to target\junit5586806176092288049\junit1963727167439425614\data00000a.tar 14:27:17.670 INFO [main] DataStoreTestBase.java:127 Test begin: testSync 14:27:17.670 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:27:17.670 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:27:17.823 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x61964988]' 14:27:17.823 DEBUG [main] StandbyServer.java:249 Binding was successful 14:27:17.823 DEBUG [main] TarWriter.java:185 Writing segment 7051bfd0-05cc-4b69-a773-46661e3f2856 to target\junit5586806176092288049\junit4581121786677137491\data00000a.tar 14:27:17.886 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 7051bfd0-05cc-4b69-a773-46661e3f2856.0000000c 14:27:17.971 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a for current head 14:27:17.971 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50245 is allowed 14:27:17.971 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:27:17.971 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 7051bfd0-05cc-4b69-a773-46661e3f2856.0000000c to client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:17.971 DEBUG [standby-run-50] StandbyClientSyncExecution.java:103 Found missing segment 7051bfd0-05cc-4b69-a773-46661e3f2856 14:27:17.971 DEBUG [standby-run-50] StandbyClientSyncExecution.java:124 Inspecting segment 7051bfd0-05cc-4b69-a773-46661e3f2856 14:27:17.971 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a for references of segment 7051bfd0-05cc-4b69-a773-46661e3f2856 14:27:17.971 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:17.971 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 7051bfd0-05cc-4b69-a773-46661e3f2856 for client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 7051bfd0-05cc-4b69-a773-46661e3f2856 to client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:17.971 DEBUG [standby-run-50] StandbyClientSyncExecution.java:184 Found reference from 7051bfd0-05cc-4b69-a773-46661e3f2856 to ab3aa719-ee02-421a-a61d-278ac86b0e38 14:27:17.971 DEBUG [standby-run-50] StandbyClientSyncExecution.java:124 Inspecting segment ab3aa719-ee02-421a-a61d-278ac86b0e38 14:27:17.971 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a for references of segment ab3aa719-ee02-421a-a61d-278ac86b0e38 14:27:17.971 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:17.971 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment ab3aa719-ee02-421a-a61d-278ac86b0e38 for client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment ab3aa719-ee02-421a-a61d-278ac86b0e38 to client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:17.971 INFO [standby-run-50] StandbyClientSyncExecution.java:196 Copying data segment ab3aa719-ee02-421a-a61d-278ac86b0e38 from primary 14:27:17.971 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a for segment ab3aa719-ee02-421a-a61d-278ac86b0e38 14:27:17.971 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:27:17.971 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment ab3aa719-ee02-421a-a61d-278ac86b0e38 for client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment ab3aa719-ee02-421a-a61d-278ac86b0e38 to client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:17.971 DEBUG [standby-run-50] TarWriter.java:185 Writing segment ab3aa719-ee02-421a-a61d-278ac86b0e38 to target\junit5586806176092288049\junit1963727167439425614\data00000a.tar 14:27:17.971 INFO [standby-run-50] StandbyClientSyncExecution.java:196 Copying data segment 7051bfd0-05cc-4b69-a773-46661e3f2856 from primary 14:27:17.971 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a for segment 7051bfd0-05cc-4b69-a773-46661e3f2856 14:27:17.971 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:27:17.971 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 7051bfd0-05cc-4b69-a773-46661e3f2856 for client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 7051bfd0-05cc-4b69-a773-46661e3f2856 to client 70f3d8cd-b93a-4b4c-8496-3f4cfba3398a 14:27:17.971 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:17.971 DEBUG [standby-run-50] TarWriter.java:185 Writing segment 7051bfd0-05cc-4b69-a773-46661e3f2856 to target\junit5586806176092288049\junit1963727167439425614\data00000a.tar 14:27:18.002 DEBUG [standby-run-50] TarRevisions.java:220 TarMK journal update null -> 7051bfd0-05cc-4b69-a773-46661e3f2856.0000000c 14:27:18.071 INFO [standby-run-50] StandbyClientSyncExecution.java:82 updated head state successfully: true in 100ms. 14:27:18.071 DEBUG [standby-run-50] StandbyClient.java:157 Channel closed 14:27:20.288 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:20.288 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:20.288 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:20.288 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:27:20.288 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:27:20.324 INFO [main] DataStoreTestBase.java:132 Test end: testSync 14:27:20.324 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:20.325 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:20.373 INFO [main] FileStore.java:467 TarMK closed: target\junit5586806176092288049\junit1963727167439425614 14:27:20.373 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:20.373 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:20.404 INFO [main] FileStore.java:467 TarMK closed: target\junit5586806176092288049\junit4581121786677137491 14:27:20.425 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit4299899524586601485\junit3618698125703405089, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:20.426 INFO [main] FileStore.java:240 TarMK opened: target\junit4299899524586601485\junit3618698125703405089 (mmap=false) 14:27:20.426 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit4299899524586601485\junit3618698125703405089\data00000a.tar} 14:27:20.426 DEBUG [main] TarWriter.java:185 Writing segment cc2347c9-7586-499d-abc8-d65ae0f909c3 to target\junit4299899524586601485\junit3618698125703405089\data00000a.tar 14:27:20.426 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit4299899524586601485\junit5630778205064979375, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:20.426 INFO [main] FileStore.java:240 TarMK opened: target\junit4299899524586601485\junit5630778205064979375 (mmap=false) 14:27:20.426 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit4299899524586601485\junit5630778205064979375\data00000a.tar} 14:27:20.426 DEBUG [main] TarWriter.java:185 Writing segment 88518ade-10b0-44f7-a40f-bf72d7857c9e to target\junit4299899524586601485\junit5630778205064979375\data00000a.tar 14:27:20.426 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByteChange2 14:27:20.426 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:27:20.426 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:27:20.504 DEBUG [main] TarWriter.java:185 Writing segment d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 to target\junit4299899524586601485\junit3618698125703405089\data00000a.tar 14:27:20.541 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> d1e0b5b9-cd6f-46e3-afba-8eb0902cc073.0000000c 14:27:20.674 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x7733234f]' 14:27:20.674 DEBUG [main] StandbyServer.java:249 Binding was successful 14:27:20.822 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 2323ab2e-e1e6-4528-b880-65e598d316cc for current head 14:27:20.858 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50333 is allowed 14:27:20.858 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:27:20.858 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.858 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.858 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head d1e0b5b9-cd6f-46e3-afba-8eb0902cc073.0000000c to client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.858 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:20.858 DEBUG [standby-run-51] StandbyClientSyncExecution.java:103 Found missing segment d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 14:27:20.858 DEBUG [standby-run-51] StandbyClientSyncExecution.java:124 Inspecting segment d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 14:27:20.858 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 2323ab2e-e1e6-4528-b880-65e598d316cc for references of segment d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 14:27:20.858 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:20.858 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 for client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.858 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 to client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.858 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:20.858 DEBUG [standby-run-51] StandbyClientSyncExecution.java:184 Found reference from d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 to cc2347c9-7586-499d-abc8-d65ae0f909c3 14:27:20.858 DEBUG [standby-run-51] StandbyClientSyncExecution.java:124 Inspecting segment cc2347c9-7586-499d-abc8-d65ae0f909c3 14:27:20.858 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 2323ab2e-e1e6-4528-b880-65e598d316cc for references of segment cc2347c9-7586-499d-abc8-d65ae0f909c3 14:27:20.858 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:20.858 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment cc2347c9-7586-499d-abc8-d65ae0f909c3 for client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.858 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment cc2347c9-7586-499d-abc8-d65ae0f909c3 to client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.858 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:20.858 INFO [standby-run-51] StandbyClientSyncExecution.java:196 Copying data segment cc2347c9-7586-499d-abc8-d65ae0f909c3 from primary 14:27:20.858 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 2323ab2e-e1e6-4528-b880-65e598d316cc for segment cc2347c9-7586-499d-abc8-d65ae0f909c3 14:27:20.858 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:27:20.858 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.858 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment cc2347c9-7586-499d-abc8-d65ae0f909c3 for client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.858 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.858 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment cc2347c9-7586-499d-abc8-d65ae0f909c3 to client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.858 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:20.858 DEBUG [standby-run-51] TarWriter.java:185 Writing segment cc2347c9-7586-499d-abc8-d65ae0f909c3 to target\junit4299899524586601485\junit5630778205064979375\data00000a.tar 14:27:20.858 INFO [standby-run-51] StandbyClientSyncExecution.java:196 Copying data segment d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 from primary 14:27:20.858 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 2323ab2e-e1e6-4528-b880-65e598d316cc for segment d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 14:27:20.874 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:27:20.874 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.874 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 for client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.874 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.874 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 to client 2323ab2e-e1e6-4528-b880-65e598d316cc 14:27:20.874 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:20.874 DEBUG [standby-run-51] TarWriter.java:185 Writing segment d1e0b5b9-cd6f-46e3-afba-8eb0902cc073 to target\junit4299899524586601485\junit5630778205064979375\data00000a.tar 14:27:20.905 DEBUG [standby-run-51] TarRevisions.java:220 TarMK journal update null -> d1e0b5b9-cd6f-46e3-afba-8eb0902cc073.0000000c 14:27:20.974 INFO [standby-run-51] StandbyClientSyncExecution.java:82 updated head state successfully: true in 116ms. 14:27:20.974 DEBUG [standby-run-51] StandbyClient.java:157 Channel closed 14:27:23.207 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:23.229 DEBUG [main] TarWriter.java:185 Writing segment 58956c2f-42b8-44c2-ac11-311ab84ad109 to target\junit4299899524586601485\junit3618698125703405089\data00000a.tar 14:27:23.292 DEBUG [main] TarRevisions.java:220 TarMK journal update d1e0b5b9-cd6f-46e3-afba-8eb0902cc073.0000000c -> 58956c2f-42b8-44c2-ac11-311ab84ad109.00000006 14:27:23.429 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 9898b73d-89e9-4d95-83fc-0e58d009c55b for current head 14:27:23.429 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:50352 is allowed 14:27:23.429 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:27:23.429 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client 9898b73d-89e9-4d95-83fc-0e58d009c55b 14:27:23.429 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client 9898b73d-89e9-4d95-83fc-0e58d009c55b 14:27:23.429 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 58956c2f-42b8-44c2-ac11-311ab84ad109.00000006 to client 9898b73d-89e9-4d95-83fc-0e58d009c55b 14:27:23.429 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:23.429 DEBUG [standby-run-52] StandbyClientSyncExecution.java:103 Found missing segment 58956c2f-42b8-44c2-ac11-311ab84ad109 14:27:23.429 DEBUG [standby-run-52] StandbyClientSyncExecution.java:124 Inspecting segment 58956c2f-42b8-44c2-ac11-311ab84ad109 14:27:23.429 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 9898b73d-89e9-4d95-83fc-0e58d009c55b for references of segment 58956c2f-42b8-44c2-ac11-311ab84ad109 14:27:23.429 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:23.429 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 58956c2f-42b8-44c2-ac11-311ab84ad109 for client 9898b73d-89e9-4d95-83fc-0e58d009c55b 14:27:23.429 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 58956c2f-42b8-44c2-ac11-311ab84ad109 to client 9898b73d-89e9-4d95-83fc-0e58d009c55b 14:27:23.429 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:23.445 INFO [standby-run-52] StandbyClientSyncExecution.java:196 Copying data segment 58956c2f-42b8-44c2-ac11-311ab84ad109 from primary 14:27:23.445 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 9898b73d-89e9-4d95-83fc-0e58d009c55b for segment 58956c2f-42b8-44c2-ac11-311ab84ad109 14:27:23.445 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:23.445 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 9898b73d-89e9-4d95-83fc-0e58d009c55b 14:27:23.445 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 58956c2f-42b8-44c2-ac11-311ab84ad109 for client 9898b73d-89e9-4d95-83fc-0e58d009c55b 14:27:23.445 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client 9898b73d-89e9-4d95-83fc-0e58d009c55b 14:27:23.445 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 58956c2f-42b8-44c2-ac11-311ab84ad109 to client 9898b73d-89e9-4d95-83fc-0e58d009c55b 14:27:23.445 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:23.445 DEBUG [standby-run-52] TarWriter.java:185 Writing segment 58956c2f-42b8-44c2-ac11-311ab84ad109 to target\junit4299899524586601485\junit5630778205064979375\data00000a.tar 14:27:23.476 DEBUG [standby-run-52] TarRevisions.java:220 TarMK journal update d1e0b5b9-cd6f-46e3-afba-8eb0902cc073.0000000c -> 58956c2f-42b8-44c2-ac11-311ab84ad109.00000006 14:27:23.545 INFO [standby-run-52] StandbyClientSyncExecution.java:82 updated head state successfully: true in 116ms. 14:27:23.545 DEBUG [standby-run-52] StandbyClient.java:157 Channel closed 14:27:25.446 DEBUG [TarMK flush [target\junit4299899524586601485\junit3618698125703405089]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:25.446 DEBUG [TarMK flush [target\junit4299899524586601485\junit5630778205064979375]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:25.747 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:25.747 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:25.747 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:25.747 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:27:25.747 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:27:25.747 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByteChange2 14:27:25.747 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:25.747 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:25.778 INFO [main] FileStore.java:467 TarMK closed: target\junit4299899524586601485\junit5630778205064979375 14:27:25.778 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:25.778 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:25.794 INFO [main] FileStore.java:467 TarMK closed: target\junit4299899524586601485\junit3618698125703405089 14:27:25.831 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit4064263225221432996\junit2356282778671296443, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:25.832 INFO [main] FileStore.java:240 TarMK opened: target\junit4064263225221432996\junit2356282778671296443 (mmap=false) 14:27:25.832 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit4064263225221432996\junit2356282778671296443\data00000a.tar} 14:27:25.832 DEBUG [main] TarWriter.java:185 Writing segment 06422b4e-0e5f-4d41-a84e-5c183291fb02 to target\junit4064263225221432996\junit2356282778671296443\data00000a.tar 14:27:25.863 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit4064263225221432996\junit6207367567864156102, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:25.863 INFO [main] FileStore.java:240 TarMK opened: target\junit4064263225221432996\junit6207367567864156102 (mmap=false) 14:27:25.863 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit4064263225221432996\junit6207367567864156102\data00000a.tar} 14:27:25.863 DEBUG [main] TarWriter.java:185 Writing segment 0bd09606-2a87-4eb7-ae5d-703bff79b88f to target\junit4064263225221432996\junit6207367567864156102\data00000a.tar 14:27:25.863 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByteChange 14:27:25.863 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:27:25.863 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:27:25.948 DEBUG [main] TarWriter.java:185 Writing segment 3f897178-098f-4fc3-a4de-8f653110842d to target\junit4064263225221432996\junit2356282778671296443\data00000a.tar 14:27:26.032 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 3f897178-098f-4fc3-a4de-8f653110842d.0000000c 14:27:26.210 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x6ff38507]' 14:27:26.210 DEBUG [main] StandbyServer.java:249 Binding was successful 14:27:26.332 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 0a0247f1-74de-4562-9af6-de779b8134a1 for current head 14:27:26.363 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50441 is allowed 14:27:26.363 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:27:26.363 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 0a0247f1-74de-4562-9af6-de779b8134a1 14:27:26.363 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 0a0247f1-74de-4562-9af6-de779b8134a1 14:27:26.363 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 3f897178-098f-4fc3-a4de-8f653110842d.0000000c to client 0a0247f1-74de-4562-9af6-de779b8134a1 14:27:26.363 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:26.363 DEBUG [standby-run-53] StandbyClientSyncExecution.java:103 Found missing segment 3f897178-098f-4fc3-a4de-8f653110842d 14:27:26.363 DEBUG [standby-run-53] StandbyClientSyncExecution.java:124 Inspecting segment 3f897178-098f-4fc3-a4de-8f653110842d 14:27:26.363 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 0a0247f1-74de-4562-9af6-de779b8134a1 for references of segment 3f897178-098f-4fc3-a4de-8f653110842d 14:27:26.363 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:26.363 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 3f897178-098f-4fc3-a4de-8f653110842d for client 0a0247f1-74de-4562-9af6-de779b8134a1 14:27:26.363 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 3f897178-098f-4fc3-a4de-8f653110842d to client 0a0247f1-74de-4562-9af6-de779b8134a1 14:27:26.363 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 0a0247f1-74de-4562-9af6-de779b8134a1 io.netty.handler.codec.compression.DecompressionException: mismatching checksum: c0ab24f6 (expected: a282002d) at io.netty.handler.codec.compression.Snappy.validateChecksum(Snappy.java:640) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.compression.SnappyFrameDecoder.decode(SnappyFrameDecoder.java:181) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:489) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:428) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1342) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:934) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 14:27:30.850 DEBUG [TarMK flush [target\junit4064263225221432996\junit2356282778671296443]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:30.912 DEBUG [TarMK flush [target\junit4064263225221432996\junit6207367567864156102]] TarRevisions.java:220 TarMK journal update null -> 0bd09606-2a87-4eb7-ae5d-703bff79b88f.00000005 14:27:31.381 DEBUG [standby-run-53] StandbyClient.java:157 Channel closed 14:27:31.381 ERROR [standby-run-53] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment 3f897178-098f-4fc3-a4de-8f653110842d from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxyFlippedIntermediateByteChange(DataStoreTestBase.java:321) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 14:27:33.583 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:33.637 DEBUG [main] TarWriter.java:185 Writing segment cdadd8ad-eaef-4d0c-aeec-33124c9120fd to target\junit4064263225221432996\junit2356282778671296443\data00000a.tar 14:27:33.668 DEBUG [main] TarRevisions.java:220 TarMK journal update 3f897178-098f-4fc3-a4de-8f653110842d.0000000c -> cdadd8ad-eaef-4d0c-aeec-33124c9120fd.00000006 14:27:33.814 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client d6e82abe-910d-4d3c-95ff-a6793f32546d for current head 14:27:33.814 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:50469 is allowed 14:27:33.814 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:27:33.814 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head cdadd8ad-eaef-4d0c-aeec-33124c9120fd.00000006 to client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:33.814 DEBUG [standby-run-54] StandbyClientSyncExecution.java:103 Found missing segment cdadd8ad-eaef-4d0c-aeec-33124c9120fd 14:27:33.814 DEBUG [standby-run-54] StandbyClientSyncExecution.java:124 Inspecting segment cdadd8ad-eaef-4d0c-aeec-33124c9120fd 14:27:33.814 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client d6e82abe-910d-4d3c-95ff-a6793f32546d for references of segment cdadd8ad-eaef-4d0c-aeec-33124c9120fd 14:27:33.814 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:33.814 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment cdadd8ad-eaef-4d0c-aeec-33124c9120fd for client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment cdadd8ad-eaef-4d0c-aeec-33124c9120fd to client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:33.814 DEBUG [standby-run-54] StandbyClientSyncExecution.java:184 Found reference from cdadd8ad-eaef-4d0c-aeec-33124c9120fd to 3f897178-098f-4fc3-a4de-8f653110842d 14:27:33.814 DEBUG [standby-run-54] StandbyClientSyncExecution.java:184 Found reference from cdadd8ad-eaef-4d0c-aeec-33124c9120fd to 06422b4e-0e5f-4d41-a84e-5c183291fb02 14:27:33.814 DEBUG [standby-run-54] StandbyClientSyncExecution.java:124 Inspecting segment 3f897178-098f-4fc3-a4de-8f653110842d 14:27:33.814 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client d6e82abe-910d-4d3c-95ff-a6793f32546d for references of segment 3f897178-098f-4fc3-a4de-8f653110842d 14:27:33.814 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:33.814 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 3f897178-098f-4fc3-a4de-8f653110842d for client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 3f897178-098f-4fc3-a4de-8f653110842d to client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:33.814 DEBUG [standby-run-54] StandbyClientSyncExecution.java:124 Inspecting segment 06422b4e-0e5f-4d41-a84e-5c183291fb02 14:27:33.814 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client d6e82abe-910d-4d3c-95ff-a6793f32546d for references of segment 06422b4e-0e5f-4d41-a84e-5c183291fb02 14:27:33.814 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:33.814 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 06422b4e-0e5f-4d41-a84e-5c183291fb02 for client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 06422b4e-0e5f-4d41-a84e-5c183291fb02 to client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:33.814 INFO [standby-run-54] StandbyClientSyncExecution.java:196 Copying data segment 06422b4e-0e5f-4d41-a84e-5c183291fb02 from primary 14:27:33.814 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client d6e82abe-910d-4d3c-95ff-a6793f32546d for segment 06422b4e-0e5f-4d41-a84e-5c183291fb02 14:27:33.814 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:33.814 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 06422b4e-0e5f-4d41-a84e-5c183291fb02 for client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.814 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 06422b4e-0e5f-4d41-a84e-5c183291fb02 to client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.830 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:33.830 DEBUG [standby-run-54] TarWriter.java:185 Writing segment 06422b4e-0e5f-4d41-a84e-5c183291fb02 to target\junit4064263225221432996\junit6207367567864156102\data00000a.tar 14:27:33.831 INFO [standby-run-54] StandbyClientSyncExecution.java:196 Copying data segment 3f897178-098f-4fc3-a4de-8f653110842d from primary 14:27:33.831 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client d6e82abe-910d-4d3c-95ff-a6793f32546d for segment 3f897178-098f-4fc3-a4de-8f653110842d 14:27:33.832 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:33.832 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.832 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 3f897178-098f-4fc3-a4de-8f653110842d for client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.832 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.832 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 3f897178-098f-4fc3-a4de-8f653110842d to client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.833 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:33.833 DEBUG [standby-run-54] TarWriter.java:185 Writing segment 3f897178-098f-4fc3-a4de-8f653110842d to target\junit4064263225221432996\junit6207367567864156102\data00000a.tar 14:27:33.833 INFO [standby-run-54] StandbyClientSyncExecution.java:196 Copying data segment cdadd8ad-eaef-4d0c-aeec-33124c9120fd from primary 14:27:33.833 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client d6e82abe-910d-4d3c-95ff-a6793f32546d for segment cdadd8ad-eaef-4d0c-aeec-33124c9120fd 14:27:33.834 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:33.834 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.834 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment cdadd8ad-eaef-4d0c-aeec-33124c9120fd for client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.834 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.834 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment cdadd8ad-eaef-4d0c-aeec-33124c9120fd to client d6e82abe-910d-4d3c-95ff-a6793f32546d 14:27:33.835 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:33.835 DEBUG [standby-run-54] TarWriter.java:185 Writing segment cdadd8ad-eaef-4d0c-aeec-33124c9120fd to target\junit4064263225221432996\junit6207367567864156102\data00000a.tar 14:27:33.868 DEBUG [standby-run-54] TarRevisions.java:220 TarMK journal update 0bd09606-2a87-4eb7-ae5d-703bff79b88f.00000005 -> cdadd8ad-eaef-4d0c-aeec-33124c9120fd.00000006 14:27:33.952 INFO [standby-run-54] StandbyClientSyncExecution.java:82 updated head state successfully: true in 138ms. 14:27:33.967 DEBUG [standby-run-54] StandbyClient.java:157 Channel closed 14:27:35.851 DEBUG [TarMK flush [target\junit4064263225221432996\junit2356282778671296443]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:35.883 DEBUG [TarMK flush [target\junit4064263225221432996\junit6207367567864156102]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:36.198 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:36.198 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:36.198 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:36.198 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:27:36.198 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:27:36.214 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByteChange 14:27:36.214 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:36.214 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:36.252 INFO [main] FileStore.java:467 TarMK closed: target\junit4064263225221432996\junit6207367567864156102 14:27:36.252 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:36.252 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:36.283 INFO [main] FileStore.java:467 TarMK closed: target\junit4064263225221432996\junit2356282778671296443 14:27:36.298 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6545603639172052406\junit1516084985759788284, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:36.314 INFO [main] FileStore.java:240 TarMK opened: target\junit6545603639172052406\junit1516084985759788284 (mmap=false) 14:27:36.314 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit6545603639172052406\junit1516084985759788284\data00000a.tar} 14:27:36.314 DEBUG [main] TarWriter.java:185 Writing segment 937e69de-0408-41d9-a79d-a9e7ac8222f6 to target\junit6545603639172052406\junit1516084985759788284\data00000a.tar 14:27:36.352 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit6545603639172052406\junit1594101551274962223, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:36.352 INFO [main] FileStore.java:240 TarMK opened: target\junit6545603639172052406\junit1594101551274962223 (mmap=false) 14:27:36.352 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit6545603639172052406\junit1594101551274962223\data00000a.tar} 14:27:36.352 DEBUG [main] TarWriter.java:185 Writing segment 79a8acdf-3a60-4647-a97a-4c9138e7ef6d to target\junit6545603639172052406\junit1594101551274962223\data00000a.tar 14:27:36.368 INFO [main] DataStoreTestBase.java:127 Test begin: testProxySkippedBytesIntermediateChange 14:27:36.368 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:27:36.368 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:27:36.436 DEBUG [main] TarWriter.java:185 Writing segment 8eae158e-886a-4b80-adbd-b4031c9859fd to target\junit6545603639172052406\junit1516084985759788284\data00000a.tar 14:27:36.499 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 8eae158e-886a-4b80-adbd-b4031c9859fd.0000000c 14:27:36.652 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0xd564bdd5]' 14:27:36.652 DEBUG [main] StandbyServer.java:249 Binding was successful 14:27:36.784 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 4af597a1-b2e0-468a-937c-368721763532 for current head 14:27:36.836 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50560 is allowed 14:27:36.836 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:27:36.836 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 4af597a1-b2e0-468a-937c-368721763532 14:27:36.836 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 4af597a1-b2e0-468a-937c-368721763532 14:27:36.836 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 8eae158e-886a-4b80-adbd-b4031c9859fd.0000000c to client 4af597a1-b2e0-468a-937c-368721763532 14:27:36.836 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:36.836 DEBUG [standby-run-55] StandbyClientSyncExecution.java:103 Found missing segment 8eae158e-886a-4b80-adbd-b4031c9859fd 14:27:36.836 DEBUG [standby-run-55] StandbyClientSyncExecution.java:124 Inspecting segment 8eae158e-886a-4b80-adbd-b4031c9859fd 14:27:36.836 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 4af597a1-b2e0-468a-937c-368721763532 for references of segment 8eae158e-886a-4b80-adbd-b4031c9859fd 14:27:36.836 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:36.836 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 8eae158e-886a-4b80-adbd-b4031c9859fd for client 4af597a1-b2e0-468a-937c-368721763532 14:27:36.836 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 8eae158e-886a-4b80-adbd-b4031c9859fd to client 4af597a1-b2e0-468a-937c-368721763532 14:27:41.330 DEBUG [TarMK flush [target\junit6545603639172052406\junit1516084985759788284]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:41.383 DEBUG [TarMK flush [target\junit6545603639172052406\junit1594101551274962223]] TarRevisions.java:220 TarMK journal update null -> 79a8acdf-3a60-4647-a97a-4c9138e7ef6d.00000005 14:27:41.853 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 4af597a1-b2e0-468a-937c-368721763532 io.netty.handler.timeout.ReadTimeoutException: null 14:27:41.853 DEBUG [standby-run-55] StandbyClient.java:157 Channel closed 14:27:41.853 ERROR [standby-run-55] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment 8eae158e-886a-4b80-adbd-b4031c9859fd from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxySkippedBytesIntermediateChange(DataStoreTestBase.java:301) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 14:27:44.085 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:44.116 DEBUG [main] TarWriter.java:185 Writing segment cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 to target\junit6545603639172052406\junit1516084985759788284\data00000a.tar 14:27:44.154 DEBUG [main] TarRevisions.java:220 TarMK journal update 8eae158e-886a-4b80-adbd-b4031c9859fd.0000000c -> cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8.00000006 14:27:44.285 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client de2de2d6-f396-40ef-aba8-a2541d66d50d for current head 14:27:44.285 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:50585 is allowed 14:27:44.285 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:27:44.285 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8.00000006 to client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:44.285 DEBUG [standby-run-56] StandbyClientSyncExecution.java:103 Found missing segment cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 14:27:44.285 DEBUG [standby-run-56] StandbyClientSyncExecution.java:124 Inspecting segment cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 14:27:44.285 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client de2de2d6-f396-40ef-aba8-a2541d66d50d for references of segment cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 14:27:44.285 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:44.285 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 for client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 to client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:44.285 DEBUG [standby-run-56] StandbyClientSyncExecution.java:184 Found reference from cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 to 8eae158e-886a-4b80-adbd-b4031c9859fd 14:27:44.285 DEBUG [standby-run-56] StandbyClientSyncExecution.java:184 Found reference from cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 to 937e69de-0408-41d9-a79d-a9e7ac8222f6 14:27:44.285 DEBUG [standby-run-56] StandbyClientSyncExecution.java:124 Inspecting segment 8eae158e-886a-4b80-adbd-b4031c9859fd 14:27:44.285 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client de2de2d6-f396-40ef-aba8-a2541d66d50d for references of segment 8eae158e-886a-4b80-adbd-b4031c9859fd 14:27:44.285 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:44.285 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 8eae158e-886a-4b80-adbd-b4031c9859fd for client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 8eae158e-886a-4b80-adbd-b4031c9859fd to client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:44.285 DEBUG [standby-run-56] StandbyClientSyncExecution.java:124 Inspecting segment 937e69de-0408-41d9-a79d-a9e7ac8222f6 14:27:44.285 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client de2de2d6-f396-40ef-aba8-a2541d66d50d for references of segment 937e69de-0408-41d9-a79d-a9e7ac8222f6 14:27:44.285 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:44.285 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 937e69de-0408-41d9-a79d-a9e7ac8222f6 for client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 937e69de-0408-41d9-a79d-a9e7ac8222f6 to client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:44.285 INFO [standby-run-56] StandbyClientSyncExecution.java:196 Copying data segment 937e69de-0408-41d9-a79d-a9e7ac8222f6 from primary 14:27:44.285 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client de2de2d6-f396-40ef-aba8-a2541d66d50d for segment 937e69de-0408-41d9-a79d-a9e7ac8222f6 14:27:44.285 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:44.285 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 937e69de-0408-41d9-a79d-a9e7ac8222f6 for client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 937e69de-0408-41d9-a79d-a9e7ac8222f6 to client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:44.285 DEBUG [standby-run-56] TarWriter.java:185 Writing segment 937e69de-0408-41d9-a79d-a9e7ac8222f6 to target\junit6545603639172052406\junit1594101551274962223\data00000a.tar 14:27:44.285 INFO [standby-run-56] StandbyClientSyncExecution.java:196 Copying data segment 8eae158e-886a-4b80-adbd-b4031c9859fd from primary 14:27:44.285 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client de2de2d6-f396-40ef-aba8-a2541d66d50d for segment 8eae158e-886a-4b80-adbd-b4031c9859fd 14:27:44.285 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:44.285 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 8eae158e-886a-4b80-adbd-b4031c9859fd for client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 8eae158e-886a-4b80-adbd-b4031c9859fd to client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:44.285 DEBUG [standby-run-56] TarWriter.java:185 Writing segment 8eae158e-886a-4b80-adbd-b4031c9859fd to target\junit6545603639172052406\junit1594101551274962223\data00000a.tar 14:27:44.285 INFO [standby-run-56] StandbyClientSyncExecution.java:196 Copying data segment cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 from primary 14:27:44.285 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client de2de2d6-f396-40ef-aba8-a2541d66d50d for segment cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 14:27:44.285 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:44.285 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 for client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 352 sent to client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.285 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 to client de2de2d6-f396-40ef-aba8-a2541d66d50d 14:27:44.301 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:44.301 DEBUG [standby-run-56] TarWriter.java:185 Writing segment cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8 to target\junit6545603639172052406\junit1594101551274962223\data00000a.tar 14:27:44.338 DEBUG [standby-run-56] TarRevisions.java:220 TarMK journal update 79a8acdf-3a60-4647-a97a-4c9138e7ef6d.00000005 -> cb8b4b27-61d8-482d-aaf1-7c296cfbb7d8.00000006 14:27:44.400 INFO [standby-run-56] StandbyClientSyncExecution.java:82 updated head state successfully: true in 115ms. 14:27:44.400 DEBUG [standby-run-56] StandbyClient.java:157 Channel closed 14:27:46.320 DEBUG [TarMK flush [target\junit6545603639172052406\junit1516084985759788284]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:46.357 DEBUG [TarMK flush [target\junit6545603639172052406\junit1594101551274962223]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:46.637 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:46.637 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:46.638 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:46.638 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:27:46.640 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:27:46.642 INFO [main] DataStoreTestBase.java:132 Test end: testProxySkippedBytesIntermediateChange 14:27:46.642 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:46.642 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:46.657 INFO [main] FileStore.java:467 TarMK closed: target\junit6545603639172052406\junit1594101551274962223 14:27:46.657 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:46.657 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:46.689 INFO [main] FileStore.java:467 TarMK closed: target\junit6545603639172052406\junit1516084985759788284 14:27:46.704 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit1170382860632074466\junit3460910749927561519, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:46.720 INFO [main] FileStore.java:240 TarMK opened: target\junit1170382860632074466\junit3460910749927561519 (mmap=false) 14:27:46.720 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit1170382860632074466\junit3460910749927561519\data00000a.tar} 14:27:46.720 DEBUG [main] TarWriter.java:185 Writing segment 26377198-fdad-4774-a097-2d9bf24e78e5 to target\junit1170382860632074466\junit3460910749927561519\data00000a.tar 14:27:46.720 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit1170382860632074466\junit2992468799456967276, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:46.720 INFO [main] FileStore.java:240 TarMK opened: target\junit1170382860632074466\junit2992468799456967276 (mmap=false) 14:27:46.720 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit1170382860632074466\junit2992468799456967276\data00000a.tar} 14:27:46.720 DEBUG [main] TarWriter.java:185 Writing segment 7f5c69a6-b099-4f12-ac72-a7926e95e65c to target\junit1170382860632074466\junit2992468799456967276\data00000a.tar 14:27:46.720 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByte 14:27:46.720 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:27:46.720 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:27:46.789 DEBUG [main] TarWriter.java:185 Writing segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 to target\junit1170382860632074466\junit3460910749927561519\data00000a.tar 14:27:46.841 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 1830fe38-76d4-47a4-afbc-1d9d9313abc4.0000000c 14:27:46.974 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x1050d215]' 14:27:46.974 DEBUG [main] StandbyServer.java:249 Binding was successful 14:27:47.074 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 05972798-41bb-4154-9358-73688a99a0e2 for current head 14:27:47.121 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50674 is allowed 14:27:47.121 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:27:47.121 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 05972798-41bb-4154-9358-73688a99a0e2 14:27:47.121 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 05972798-41bb-4154-9358-73688a99a0e2 14:27:47.121 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 1830fe38-76d4-47a4-afbc-1d9d9313abc4.0000000c to client 05972798-41bb-4154-9358-73688a99a0e2 14:27:47.121 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:47.121 DEBUG [standby-run-57] StandbyClientSyncExecution.java:103 Found missing segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 14:27:47.121 DEBUG [standby-run-57] StandbyClientSyncExecution.java:124 Inspecting segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 14:27:47.121 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 05972798-41bb-4154-9358-73688a99a0e2 for references of segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 14:27:47.121 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:47.121 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 for client 05972798-41bb-4154-9358-73688a99a0e2 14:27:47.121 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 to client 05972798-41bb-4154-9358-73688a99a0e2 14:27:47.121 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 05972798-41bb-4154-9358-73688a99a0e2 io.netty.handler.codec.compression.DecompressionException: mismatching checksum: 6805c725 (expected: a282ddde) at io.netty.handler.codec.compression.Snappy.validateChecksum(Snappy.java:640) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.compression.SnappyFrameDecoder.decode(SnappyFrameDecoder.java:181) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:489) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:428) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1342) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:934) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 14:27:51.723 DEBUG [TarMK flush [target\junit1170382860632074466\junit3460910749927561519]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:51.776 DEBUG [TarMK flush [target\junit1170382860632074466\junit2992468799456967276]] TarRevisions.java:220 TarMK journal update null -> 7f5c69a6-b099-4f12-ac72-a7926e95e65c.00000005 14:27:52.140 DEBUG [standby-run-57] StandbyClient.java:157 Channel closed 14:27:52.142 ERROR [standby-run-57] StandbyClientSync.java:171 Failed synchronizing state. java.lang.IllegalStateException: Unable to read references of segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 from primary at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.readReferences(StandbyClientSyncExecution.java:206) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.copySegmentHierarchyFromPrimary(StandbyClientSyncExecution.java:140) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.compareAgainstBaseState(StandbyClientSyncExecution.java:104) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSyncExecution.execute(StandbyClientSyncExecution.java:79) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.client.StandbyClientSync.run(StandbyClientSync.java:157) ~[oak-segment-tar-1.8-SNAPSHOT.jar:1.8-SNAPSHOT] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.useProxy(DataStoreTestBase.java:346) [test-classes/:na] at org.apache.jackrabbit.oak.segment.standby.DataStoreTestBase.testProxyFlippedIntermediateByte(DataStoreTestBase.java:311) [test-classes/:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_151] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_151] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_151] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_151] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [junit-4.12.jar:4.12] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [junit-4.12.jar:4.12] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) [junit-4.12.jar:4.12] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [junit-4.12.jar:4.12] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [junit-4.12.jar:4.12] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [junit-4.12.jar:4.12] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) [junit-4.12.jar:4.12] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [junit-4.12.jar:4.12] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) [surefire-junit4-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) [surefire-booter-2.20.1.jar:2.20.1] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) [surefire-booter-2.20.1.jar:2.20.1] 14:27:54.377 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:54.447 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb for current head 14:27:54.447 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:50698 is allowed 14:27:54.447 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:27:54.447 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 1830fe38-76d4-47a4-afbc-1d9d9313abc4.0000000c to client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:54.447 DEBUG [standby-run-58] StandbyClientSyncExecution.java:103 Found missing segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 14:27:54.447 DEBUG [standby-run-58] StandbyClientSyncExecution.java:124 Inspecting segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 14:27:54.447 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb for references of segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 14:27:54.447 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:54.447 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 for client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 to client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:54.447 DEBUG [standby-run-58] StandbyClientSyncExecution.java:184 Found reference from 1830fe38-76d4-47a4-afbc-1d9d9313abc4 to 26377198-fdad-4774-a097-2d9bf24e78e5 14:27:54.447 DEBUG [standby-run-58] StandbyClientSyncExecution.java:124 Inspecting segment 26377198-fdad-4774-a097-2d9bf24e78e5 14:27:54.447 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb for references of segment 26377198-fdad-4774-a097-2d9bf24e78e5 14:27:54.447 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:27:54.447 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 26377198-fdad-4774-a097-2d9bf24e78e5 for client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 26377198-fdad-4774-a097-2d9bf24e78e5 to client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:54.447 INFO [standby-run-58] StandbyClientSyncExecution.java:196 Copying data segment 26377198-fdad-4774-a097-2d9bf24e78e5 from primary 14:27:54.447 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb for segment 26377198-fdad-4774-a097-2d9bf24e78e5 14:27:54.447 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:54.447 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 26377198-fdad-4774-a097-2d9bf24e78e5 for client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 26377198-fdad-4774-a097-2d9bf24e78e5 to client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:54.447 DEBUG [standby-run-58] TarWriter.java:185 Writing segment 26377198-fdad-4774-a097-2d9bf24e78e5 to target\junit1170382860632074466\junit2992468799456967276\data00000a.tar 14:27:54.447 INFO [standby-run-58] StandbyClientSyncExecution.java:196 Copying data segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 from primary 14:27:54.447 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb for segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 14:27:54.447 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:27:54.447 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 for client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 to client 4ee5d6af-6bbe-45bf-a1f3-d2f113ad8ecb 14:27:54.447 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:54.447 DEBUG [standby-run-58] TarWriter.java:185 Writing segment 1830fe38-76d4-47a4-afbc-1d9d9313abc4 to target\junit1170382860632074466\junit2992468799456967276\data00000a.tar 14:27:54.478 DEBUG [standby-run-58] TarRevisions.java:220 TarMK journal update 7f5c69a6-b099-4f12-ac72-a7926e95e65c.00000005 -> 1830fe38-76d4-47a4-afbc-1d9d9313abc4.0000000c 14:27:54.578 INFO [standby-run-58] StandbyClientSyncExecution.java:82 updated head state successfully: true in 131ms. 14:27:54.578 DEBUG [standby-run-58] StandbyClient.java:157 Channel closed 14:27:56.730 DEBUG [TarMK flush [target\junit1170382860632074466\junit2992468799456967276]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:56.730 DEBUG [TarMK flush [target\junit1170382860632074466\junit3460910749927561519]] TarRevisions.java:217 Head state did not change, skipping flush 14:27:56.915 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:27:56.915 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:56.915 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:27:56.915 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:27:56.915 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:27:56.915 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByte 14:27:56.915 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:56.915 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:56.953 INFO [main] FileStore.java:467 TarMK closed: target\junit1170382860632074466\junit2992468799456967276 14:27:56.953 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:27:56.953 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:27:56.984 INFO [main] FileStore.java:467 TarMK closed: target\junit1170382860632074466\junit3460910749927561519 14:27:57.000 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit7574318640271817659\junit2806359717912129633, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:57.000 INFO [main] FileStore.java:240 TarMK opened: target\junit7574318640271817659\junit2806359717912129633 (mmap=false) 14:27:57.000 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit7574318640271817659\junit2806359717912129633\data00000a.tar} 14:27:57.000 DEBUG [main] TarWriter.java:185 Writing segment df6f6646-99f0-41bf-a8e9-c766f0d49df8 to target\junit7574318640271817659\junit2806359717912129633\data00000a.tar 14:27:57.015 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit7574318640271817659\junit386325259388123646, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:27:57.015 INFO [main] FileStore.java:240 TarMK opened: target\junit7574318640271817659\junit386325259388123646 (mmap=false) 14:27:57.015 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit7574318640271817659\junit386325259388123646\data00000a.tar} 14:27:57.015 DEBUG [main] TarWriter.java:185 Writing segment 459f44a9-dbf8-4069-a0c3-d4f37f6dc9b6 to target\junit7574318640271817659\junit386325259388123646\data00000a.tar 14:27:57.015 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedIntermediateByte2 14:27:57.015 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:27:57.015 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:27:57.131 DEBUG [main] TarWriter.java:185 Writing segment 24e28192-9793-45b5-aeba-b2299b18880a to target\junit7574318640271817659\junit2806359717912129633\data00000a.tar 14:27:57.370 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 24e28192-9793-45b5-aeba-b2299b18880a.0000000c 14:27:57.517 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x5626c47a]' 14:27:57.517 DEBUG [main] StandbyServer.java:249 Binding was successful 14:27:57.670 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb for current head 14:27:57.732 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50787 is allowed 14:27:57.732 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:27:57.732 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 24e28192-9793-45b5-aeba-b2299b18880a.0000000c to client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:27:57.732 DEBUG [standby-run-59] StandbyClientSyncExecution.java:103 Found missing segment 24e28192-9793-45b5-aeba-b2299b18880a 14:27:57.732 DEBUG [standby-run-59] StandbyClientSyncExecution.java:124 Inspecting segment 24e28192-9793-45b5-aeba-b2299b18880a 14:27:57.732 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb for references of segment 24e28192-9793-45b5-aeba-b2299b18880a 14:27:57.732 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:57.732 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 24e28192-9793-45b5-aeba-b2299b18880a for client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 24e28192-9793-45b5-aeba-b2299b18880a to client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:57.732 DEBUG [standby-run-59] StandbyClientSyncExecution.java:184 Found reference from 24e28192-9793-45b5-aeba-b2299b18880a to df6f6646-99f0-41bf-a8e9-c766f0d49df8 14:27:57.732 DEBUG [standby-run-59] StandbyClientSyncExecution.java:124 Inspecting segment df6f6646-99f0-41bf-a8e9-c766f0d49df8 14:27:57.732 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb for references of segment df6f6646-99f0-41bf-a8e9-c766f0d49df8 14:27:57.732 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:27:57.732 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment df6f6646-99f0-41bf-a8e9-c766f0d49df8 for client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment df6f6646-99f0-41bf-a8e9-c766f0d49df8 to client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:27:57.732 INFO [standby-run-59] StandbyClientSyncExecution.java:196 Copying data segment df6f6646-99f0-41bf-a8e9-c766f0d49df8 from primary 14:27:57.732 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb for segment df6f6646-99f0-41bf-a8e9-c766f0d49df8 14:27:57.732 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:27:57.732 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment df6f6646-99f0-41bf-a8e9-c766f0d49df8 for client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment df6f6646-99f0-41bf-a8e9-c766f0d49df8 to client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:57.732 DEBUG [standby-run-59] TarWriter.java:185 Writing segment df6f6646-99f0-41bf-a8e9-c766f0d49df8 to target\junit7574318640271817659\junit386325259388123646\data00000a.tar 14:27:57.732 INFO [standby-run-59] StandbyClientSyncExecution.java:196 Copying data segment 24e28192-9793-45b5-aeba-b2299b18880a from primary 14:27:57.732 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb for segment 24e28192-9793-45b5-aeba-b2299b18880a 14:27:57.732 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:27:57.732 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 24e28192-9793-45b5-aeba-b2299b18880a for client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 448 sent to client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 24e28192-9793-45b5-aeba-b2299b18880a to client 8e486b2b-33ac-4d1b-b96f-a5a57eea07bb 14:27:57.732 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:27:57.732 DEBUG [standby-run-59] TarWriter.java:185 Writing segment 24e28192-9793-45b5-aeba-b2299b18880a to target\junit7574318640271817659\junit386325259388123646\data00000a.tar 14:27:57.786 DEBUG [standby-run-59] TarRevisions.java:220 TarMK journal update null -> 24e28192-9793-45b5-aeba-b2299b18880a.0000000c 14:27:57.855 INFO [standby-run-59] StandbyClientSyncExecution.java:82 updated head state successfully: true in 123ms. 14:27:57.855 DEBUG [standby-run-59] StandbyClient.java:157 Channel closed 14:28:00.081 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:28:00.128 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client eea8172b-577b-45e1-bd73-b513ae7e8c31 for current head 14:28:00.128 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:50806 is allowed 14:28:00.128 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:28:00.128 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client eea8172b-577b-45e1-bd73-b513ae7e8c31 14:28:00.128 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client eea8172b-577b-45e1-bd73-b513ae7e8c31 14:28:00.128 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 24e28192-9793-45b5-aeba-b2299b18880a.0000000c to client eea8172b-577b-45e1-bd73-b513ae7e8c31 14:28:00.128 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:28:00.128 DEBUG [standby-run-60] StandbyClient.java:157 Channel closed 14:28:02.029 DEBUG [TarMK flush [target\junit7574318640271817659\junit386325259388123646]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:02.029 DEBUG [TarMK flush [target\junit7574318640271817659\junit2806359717912129633]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:02.345 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:28:02.345 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:28:02.345 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:28:02.345 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:28:02.345 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:28:02.367 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedIntermediateByte2 14:28:02.367 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:28:02.367 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:28:02.399 INFO [main] FileStore.java:467 TarMK closed: target\junit7574318640271817659\junit386325259388123646 14:28:02.399 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:28:02.399 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:28:02.430 INFO [main] FileStore.java:467 TarMK closed: target\junit7574318640271817659\junit2806359717912129633 14:28:02.445 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit3745367519923564957\junit859787863011968341, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:28:02.445 INFO [main] FileStore.java:240 TarMK opened: target\junit3745367519923564957\junit859787863011968341 (mmap=false) 14:28:02.445 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit3745367519923564957\junit859787863011968341\data00000a.tar} 14:28:02.445 DEBUG [main] TarWriter.java:185 Writing segment f12ebc8f-cde7-4996-abee-13ef5e4e83b6 to target\junit3745367519923564957\junit859787863011968341\data00000a.tar 14:28:02.463 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit3745367519923564957\junit8133462682832472893, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:28:02.466 INFO [main] FileStore.java:240 TarMK opened: target\junit3745367519923564957\junit8133462682832472893 (mmap=false) 14:28:02.466 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit3745367519923564957\junit8133462682832472893\data00000a.tar} 14:28:02.467 DEBUG [main] TarWriter.java:185 Writing segment a76f6dea-f85c-45ed-a569-b48d0a1f83b3 to target\junit3745367519923564957\junit8133462682832472893\data00000a.tar 14:28:02.468 INFO [main] DataStoreTestBase.java:127 Test begin: testProxyFlippedStartByte 14:28:02.468 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:28:02.468 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:28:02.546 DEBUG [main] TarWriter.java:185 Writing segment 039e6a3d-0c28-4b4c-aa53-b3fee878e438 to target\junit3745367519923564957\junit859787863011968341\data00000a.tar 14:28:02.699 DEBUG [main] TarRevisions.java:220 TarMK journal update null -> 039e6a3d-0c28-4b4c-aa53-b3fee878e438.0000000c 14:28:02.846 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x81d79132]' 14:28:02.846 DEBUG [main] StandbyServer.java:249 Binding was successful 14:28:02.965 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 42b61621-582b-46f5-8112-930c2fd25bad for current head 14:28:02.999 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50895 is allowed 14:28:02.999 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:28:02.999 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 42b61621-582b-46f5-8112-930c2fd25bad 14:28:02.999 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 42b61621-582b-46f5-8112-930c2fd25bad 14:28:02.999 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 039e6a3d-0c28-4b4c-aa53-b3fee878e438.0000000c to client 42b61621-582b-46f5-8112-930c2fd25bad 14:28:02.999 WARN [standby-1] ExceptionHandler.java:37 Exception caught on client 42b61621-582b-46f5-8112-930c2fd25bad io.netty.handler.codec.compression.DecompressionException: Received COMPRESSED_DATA tag before STREAM_IDENTIFIER at io.netty.handler.codec.compression.SnappyFrameDecoder.decode(SnappyFrameDecoder.java:162) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:489) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:428) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1342) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:934) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.14.Final.jar:4.1.14.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.14.Final.jar:4.1.14.Final] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151] 14:28:07.466 DEBUG [TarMK flush [target\junit3745367519923564957\junit859787863011968341]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:07.503 DEBUG [TarMK flush [target\junit3745367519923564957\junit8133462682832472893]] TarRevisions.java:220 TarMK journal update null -> a76f6dea-f85c-45ed-a569-b48d0a1f83b3.00000005 14:28:07.987 ERROR [standby-run-61] StandbyClientSyncExecution.java:67 Unable to fetch remote head 14:28:07.987 DEBUG [standby-run-61] StandbyClient.java:157 Channel closed 14:28:10.189 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:28:10.251 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client c444158c-f319-45ae-80c7-db93f93bf13f for current head 14:28:10.251 DEBUG [primary-2] ClientFilterHandler.java:53 Client /127.0.0.1:50921 is allowed 14:28:10.251 DEBUG [primary-2] RequestDecoder.java:42 Parsed 'get head' message 14:28:10.251 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get head' received from client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [primary-2] GetHeadRequestHandler.java:43 Reading head for client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [primary-2] GetHeadResponseEncoder.java:36 Sending head 039e6a3d-0c28-4b4c-aa53-b3fee878e438.0000000c to client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:28:10.251 DEBUG [standby-run-62] StandbyClientSyncExecution.java:103 Found missing segment 039e6a3d-0c28-4b4c-aa53-b3fee878e438 14:28:10.251 DEBUG [standby-run-62] StandbyClientSyncExecution.java:124 Inspecting segment 039e6a3d-0c28-4b4c-aa53-b3fee878e438 14:28:10.251 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client c444158c-f319-45ae-80c7-db93f93bf13f for references of segment 039e6a3d-0c28-4b4c-aa53-b3fee878e438 14:28:10.251 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:28:10.251 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment 039e6a3d-0c28-4b4c-aa53-b3fee878e438 for client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment 039e6a3d-0c28-4b4c-aa53-b3fee878e438 to client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:28:10.251 DEBUG [standby-run-62] StandbyClientSyncExecution.java:184 Found reference from 039e6a3d-0c28-4b4c-aa53-b3fee878e438 to f12ebc8f-cde7-4996-abee-13ef5e4e83b6 14:28:10.251 DEBUG [standby-run-62] StandbyClientSyncExecution.java:124 Inspecting segment f12ebc8f-cde7-4996-abee-13ef5e4e83b6 14:28:10.251 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client c444158c-f319-45ae-80c7-db93f93bf13f for references of segment f12ebc8f-cde7-4996-abee-13ef5e4e83b6 14:28:10.251 DEBUG [primary-2] RequestDecoder.java:48 Parsed 'get references' message 14:28:10.251 DEBUG [primary-2] GetReferencesRequestHandler.java:39 Reading references of segment f12ebc8f-cde7-4996-abee-13ef5e4e83b6 for client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [primary-2] GetReferencesResponseEncoder.java:34 Sending references of segment f12ebc8f-cde7-4996-abee-13ef5e4e83b6 to client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:28:10.251 INFO [standby-run-62] StandbyClientSyncExecution.java:196 Copying data segment f12ebc8f-cde7-4996-abee-13ef5e4e83b6 from primary 14:28:10.251 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client c444158c-f319-45ae-80c7-db93f93bf13f for segment f12ebc8f-cde7-4996-abee-13ef5e4e83b6 14:28:10.251 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:28:10.251 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment f12ebc8f-cde7-4996-abee-13ef5e4e83b6 for client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 192 sent to client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment f12ebc8f-cde7-4996-abee-13ef5e4e83b6 to client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:28:10.251 DEBUG [standby-run-62] TarWriter.java:185 Writing segment f12ebc8f-cde7-4996-abee-13ef5e4e83b6 to target\junit3745367519923564957\junit8133462682832472893\data00000a.tar 14:28:10.251 INFO [standby-run-62] StandbyClientSyncExecution.java:196 Copying data segment 039e6a3d-0c28-4b4c-aa53-b3fee878e438 from primary 14:28:10.251 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client c444158c-f319-45ae-80c7-db93f93bf13f for segment 039e6a3d-0c28-4b4c-aa53-b3fee878e438 14:28:10.251 DEBUG [primary-2] RequestDecoder.java:45 Parsed 'get segment' message 14:28:10.251 DEBUG [primary-2] CommunicationObserver.java:120 Message 'get segment' received from client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [primary-2] GetSegmentRequestHandler.java:39 Reading segment 039e6a3d-0c28-4b4c-aa53-b3fee878e438 for client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [primary-2] CommunicationObserver.java:125 Segment with size 448 sent to client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [primary-2] GetSegmentResponseEncoder.java:43 Sending segment 039e6a3d-0c28-4b4c-aa53-b3fee878e438 to client c444158c-f319-45ae-80c7-db93f93bf13f 14:28:10.251 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:28:10.251 DEBUG [standby-run-62] TarWriter.java:185 Writing segment 039e6a3d-0c28-4b4c-aa53-b3fee878e438 to target\junit3745367519923564957\junit8133462682832472893\data00000a.tar 14:28:10.304 DEBUG [standby-run-62] TarRevisions.java:220 TarMK journal update a76f6dea-f85c-45ed-a569-b48d0a1f83b3.00000005 -> 039e6a3d-0c28-4b4c-aa53-b3fee878e438.0000000c 14:28:10.388 INFO [standby-run-62] StandbyClientSyncExecution.java:82 updated head state successfully: true in 137ms. 14:28:10.388 DEBUG [standby-run-62] StandbyClient.java:157 Channel closed 14:28:12.467 DEBUG [TarMK flush [target\junit3745367519923564957\junit8133462682832472893]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:12.468 DEBUG [TarMK flush [target\junit3745367519923564957\junit859787863011968341]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:12.705 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:28:12.705 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:28:12.705 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:28:12.705 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:28:12.705 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:28:12.736 INFO [main] DataStoreTestBase.java:132 Test end: testProxyFlippedStartByte 14:28:12.736 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:28:12.736 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:28:12.774 INFO [main] FileStore.java:467 TarMK closed: target\junit3745367519923564957\junit8133462682832472893 14:28:12.774 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:28:12.774 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:28:12.805 INFO [main] FileStore.java:467 TarMK closed: target\junit3745367519923564957\junit859787863011968341 14:28:12.821 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit5951804749193783331\junit4144779007320170199, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:28:12.821 INFO [main] FileStore.java:240 TarMK opened: target\junit5951804749193783331\junit4144779007320170199 (mmap=false) 14:28:12.821 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit5951804749193783331\junit4144779007320170199\data00000a.tar} 14:28:12.821 DEBUG [main] TarWriter.java:185 Writing segment 575b9e0f-59d9-41df-ac9a-adc4d41933b4 to target\junit5951804749193783331\junit4144779007320170199\data00000a.tar 14:28:12.821 INFO [main] FileStoreBuilder.java:340 Creating file store FileStoreBuilder{version=1.8-SNAPSHOT, directory=target\junit5951804749193783331\junit8264139396534577193, blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore], maxFileSize=1, segmentCacheSize=0, stringCacheSize=0, templateCacheSize=0, stringDeduplicationCacheSize=15000, templateDeduplicationCacheSize=3000, nodeDeduplicationCacheSize=1, memoryMapping=false, gcOptions=SegmentGCOptions{paused=false, estimationDisabled=false, gcSizeDeltaEstimation=1073741824, retryCount=5, forceTimeout=60, retainedGenerations=2, gcType=FULL}} 14:28:12.821 INFO [main] FileStore.java:240 TarMK opened: target\junit5951804749193783331\junit8264139396534577193 (mmap=false) 14:28:12.821 DEBUG [main] FileStore.java:241 TAR files: TarFiles{readers=[],writer=target\junit5951804749193783331\junit8264139396534577193\data00000a.tar} 14:28:12.821 DEBUG [main] TarWriter.java:185 Writing segment 87f6e4d9-5808-42e9-a44c-a05ea8d5c090 to target\junit5951804749193783331\junit8264139396534577193\data00000a.tar 14:28:12.821 INFO [main] DataStoreTestBase.java:127 Test begin: testSyncBigBlob 14:28:12.821 INFO [main] SegmentNodeStore.java:120 Creating segment node store SegmentNodeStoreBuilder{blobStore=DataStore backed BlobStore [org.apache.jackrabbit.core.data.FileDataStore]} 14:28:12.821 INFO [main] LockBasedScheduler.java:155 Initializing SegmentNodeStore with the commitFairLock option enabled. 14:28:18.642 DEBUG [TarMK flush [target\junit5951804749193783331\junit8264139396534577193]] TarRevisions.java:220 TarMK journal update null -> 87f6e4d9-5808-42e9-a44c-a05ea8d5c090.00000005 14:28:22.852 DEBUG [TarMK flush [target\junit5951804749193783331\junit8264139396534577193]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:27.840 DEBUG [TarMK flush [target\junit5951804749193783331\junit8264139396534577193]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:32.834 DEBUG [TarMK flush [target\junit5951804749193783331\junit8264139396534577193]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:37.844 DEBUG [TarMK flush [target\junit5951804749193783331\junit8264139396534577193]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:41.749 DEBUG [TarMK flush [target\junit5951804749193783331\junit4144779007320170199]] TarWriter.java:185 Writing segment edd78d90-580b-4659-a731-b835dd80ef4f to target\junit5951804749193783331\junit4144779007320170199\data00000a.tar 14:28:42.212 DEBUG [TarMK flush [target\junit5951804749193783331\junit4144779007320170199]] TarRevisions.java:220 TarMK journal update null -> 575b9e0f-59d9-41df-ac9a-adc4d41933b4.00000005 14:28:42.297 WARN [main] Slf4JLogger.java:146 Unknown channel option 'TCP_NODELAY' for channel '[id: 0x0f7c216f]' 14:28:42.297 DEBUG [main] StandbyServer.java:249 Binding was successful 14:28:42.297 DEBUG [main] TarRevisions.java:208 Unable to lock the journal, skipping flush 14:28:42.297 DEBUG [standby-1] GetHeadRequestEncoder.java:33 Sending request from client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 for current head 14:28:42.297 DEBUG [primary-1] ClientFilterHandler.java:53 Client /127.0.0.1:50989 is allowed 14:28:42.297 DEBUG [primary-1] RequestDecoder.java:42 Parsed 'get head' message 14:28:42.297 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get head' received from client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 14:28:42.297 DEBUG [primary-1] GetHeadRequestHandler.java:43 Reading head for client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 14:28:42.454 DEBUG [TarMK flush [target\junit5951804749193783331\junit4144779007320170199]] TarWriter.java:185 Writing segment 7656030b-0d5f-49e2-a68a-56dca2c55bb6 to target\junit5951804749193783331\junit4144779007320170199\data00000a.tar 14:28:42.564 DEBUG [primary-1] GetHeadResponseEncoder.java:36 Sending head 575b9e0f-59d9-41df-ac9a-adc4d41933b4.00000005 to client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 14:28:42.564 DEBUG [standby-1] ResponseDecoder.java:82 Decoding 'get head' response 14:28:42.564 DEBUG [standby-run-63] StandbyClientSyncExecution.java:103 Found missing segment 575b9e0f-59d9-41df-ac9a-adc4d41933b4 14:28:42.564 DEBUG [standby-run-63] StandbyClientSyncExecution.java:124 Inspecting segment 575b9e0f-59d9-41df-ac9a-adc4d41933b4 14:28:42.564 DEBUG [standby-1] GetReferencesRequestEncoder.java:33 Sending request from client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 for references of segment 575b9e0f-59d9-41df-ac9a-adc4d41933b4 14:28:42.564 DEBUG [primary-1] RequestDecoder.java:48 Parsed 'get references' message 14:28:42.564 DEBUG [primary-1] GetReferencesRequestHandler.java:39 Reading references of segment 575b9e0f-59d9-41df-ac9a-adc4d41933b4 for client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 14:28:42.564 DEBUG [TarMK flush [target\junit5951804749193783331\junit4144779007320170199]] TarRevisions.java:220 TarMK journal update 575b9e0f-59d9-41df-ac9a-adc4d41933b4.00000005 -> 7656030b-0d5f-49e2-a68a-56dca2c55bb6.0000000b 14:28:42.564 DEBUG [primary-1] GetReferencesResponseEncoder.java:34 Sending references of segment 575b9e0f-59d9-41df-ac9a-adc4d41933b4 to client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 14:28:42.564 DEBUG [standby-1] ResponseDecoder.java:94 Decoding 'get references' response 14:28:42.564 INFO [standby-run-63] StandbyClientSyncExecution.java:196 Copying data segment 575b9e0f-59d9-41df-ac9a-adc4d41933b4 from primary 14:28:42.564 DEBUG [standby-1] GetSegmentRequestEncoder.java:33 Sending request from client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 for segment 575b9e0f-59d9-41df-ac9a-adc4d41933b4 14:28:42.564 DEBUG [primary-1] RequestDecoder.java:45 Parsed 'get segment' message 14:28:42.564 DEBUG [primary-1] CommunicationObserver.java:120 Message 'get segment' received from client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 14:28:42.564 DEBUG [primary-1] GetSegmentRequestHandler.java:39 Reading segment 575b9e0f-59d9-41df-ac9a-adc4d41933b4 for client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 14:28:42.564 DEBUG [primary-1] CommunicationObserver.java:125 Segment with size 192 sent to client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 14:28:42.564 DEBUG [primary-1] GetSegmentResponseEncoder.java:43 Sending segment 575b9e0f-59d9-41df-ac9a-adc4d41933b4 to client 4f4ca904-a163-435c-a6c2-9bfdd1e420c7 14:28:42.564 DEBUG [standby-1] ResponseDecoder.java:86 Decoding 'get segment' response 14:28:42.564 DEBUG [standby-run-63] TarWriter.java:185 Writing segment 575b9e0f-59d9-41df-ac9a-adc4d41933b4 to target\junit5951804749193783331\junit8264139396534577193\data00000a.tar 14:28:42.796 DEBUG [standby-run-63] TarRevisions.java:220 TarMK journal update 87f6e4d9-5808-42e9-a44c-a05ea8d5c090.00000005 -> 575b9e0f-59d9-41df-ac9a-adc4d41933b4.00000005 14:28:42.849 DEBUG [TarMK flush [target\junit5951804749193783331\junit8264139396534577193]] TarRevisions.java:208 Unable to lock the journal, skipping flush 14:28:42.913 DEBUG [TarMK flush [target\junit5951804749193783331\junit4144779007320170199]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:42.913 DEBUG [TarMK flush [target\junit5951804749193783331\junit4144779007320170199]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:42.913 DEBUG [TarMK flush [target\junit5951804749193783331\junit4144779007320170199]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:42.913 DEBUG [TarMK flush [target\junit5951804749193783331\junit4144779007320170199]] TarRevisions.java:217 Head state did not change, skipping flush 14:28:43.081 INFO [standby-run-63] StandbyClientSyncExecution.java:82 updated head state successfully: true in 517ms. 14:28:43.081 DEBUG [standby-run-63] StandbyClient.java:157 Channel closed 14:28:45.282 DEBUG [main] StandbyClientSync.java:277 Group shut down 14:28:45.282 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:28:45.282 DEBUG [main] StandbyServer.java:220 Channel disconnected 14:28:45.282 DEBUG [main] StandbyServer.java:231 Boss group shut down 14:28:45.282 DEBUG [main] StandbyServer.java:237 Worker group shut down 14:28:45.282 INFO [main] DataStoreTestBase.java:132 Test end: testSyncBigBlob 14:28:45.282 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:28:45.282 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:28:45.336 INFO [main] FileStore.java:467 TarMK closed: target\junit5951804749193783331\junit8264139396534577193 14:28:45.336 DEBUG [main] Scheduler.java:134 The scheduler FileStore background tasks was successfully shut down 14:28:45.336 DEBUG [main] TarRevisions.java:217 Head state did not change, skipping flush 14:28:45.367 INFO [main] FileStore.java:467 TarMK closed: target\junit5951804749193783331\junit4144779007320170199