[IGNITE-5604] Activate fails in case node was stopped with cancel=true and big objects in cache

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1
• Fix Version/s: 2.1
• Component/s: persistence
• Assignee: Dmitriy Govorukhin
• Reporter: Taras Ledkov
• Created: 28/Jun/17 12:53
• Updated: 13/Dec/18 15:06
• Resolved: 10/Jul/17 08:13

Description

Please take a look at the test IgniteWalRecoveryTest#testWalBigObjectNodeCancel.
The test is available at the pull request.

The error is:

[2017-06-28 15:50:46,020][ERROR][main][root] Test failed.
class org.apache.ignite.IgniteException: Fail activate
	at org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:957)
	at org.apache.ignite.internal.IgniteKernal.active(IgniteKernal.java:3408)
	at org.apache.ignite.internal.processors.cache.persistence.db.wal.IgniteWalRecoveryTest.testWalBigObjectNodeCancel(IgniteWalRecoveryTest.java:249)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:176)
	at org.apache.ignite.testframework.junits.GridAbstractTest.runTestInternal(GridAbstractTest.java:1995)
	at org.apache.ignite.testframework.junits.GridAbstractTest.access$000(GridAbstractTest.java:132)
	at org.apache.ignite.testframework.junits.GridAbstractTest$5.run(GridAbstractTest.java:1910)
	at java.lang.Thread.run(Thread.java:745)
Caused by: class org.apache.ignite.IgniteCheckedException: Fail activate
	Suppressed: class org.apache.ignite.IgniteCheckedException: Failed to restore memory state (checkpoint marker is present on disk, but checkpoint record is missed in WAL) [cpStatus=CheckpointStatus [cpStartTs=1498654243491, cpStartId=7f873e0b-b1ee-4bd6-8605-b139b82898c9, startPtr=FileWALPointer [idx=0, fileOffset=8657376, len=2425, forceFlush=false], cpEndId=00000000-0000-0000-0000-000000000000, endPtr=FileWALPointer [idx=0, fileOffset=0, len=0, forceFlush=false]], lastRead=FileWALPointer [idx=0, fileOffset=4340447, len=39, forceFlush=false]]
		at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreMemory(GridCacheDatabaseSharedManager.java:1471)
		at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readCheckpointAndRestoreMemory(GridCacheDatabaseSharedManager.java:578)
		at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.initCachesAndRestoreMemory(GridCacheDatabaseSharedManager.java:492)
		at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.onActivate(GridCacheDatabaseSharedManager.java:508)
		at org.apache.ignite.internal.processors.cluster.GridClusterStateProcessor.onActivate(GridClusterStateProcessor.java:747)
		at org.apache.ignite.internal.processors.cluster.GridClusterStateProcessor.onChangeGlobalState(GridClusterStateProcessor.java:655)
		at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onCacheChangeRequest(GridDhtPartitionsExchangeFuture.java:719)
		at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:563)
		at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1872)
		at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
		at java.lang.Thread.run(Thread.java:745)

Issue Links

• links to: GitHub Pull Request #2211
• links to: GitHub Pull Request #2244