Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
2.1
Description
IgnitePdsAtomicCacheRebalancingTest.testTopologyChangesWithConstantLoad
https://ci.ignite.apache.org/project.html?projectId=Ignite20Tests&testNameId=7598445566789774358&tab=testDetails&branch_Ignite20Tests=%3Cdefault%3E
Test was early fixed under following issues
https://issues.apache.org/jira/browse/IGNITE-5514
https://issues.apache.org/jira/browse/IGNITE-5692
But now it is still failed with:
[2017-09-18 00:19:02,892][ERROR][sys-stripe-22-#10154%persistence.IgnitePdsAtomicCacheRebalancingTest4%][GridCacheIoManager] Failed processing message [senderId=df3bec22-ebfb-4222-86d9-ab6117b00001, msg=GridDhtAtomicSingleUpdateRequest [key=KeyCacheObjectImpl [part=166, val=8358, hasValBytes=true], val=o.a.i.i.processors.cache.persistence.IgnitePdsCacheRebalancingAbstractTest$TestValue [idHash=595564816, hash=-2080068327, v1=866013082, v2=381254132], prevVal=null, super=GridDhtAtomicAbstractUpdateRequest [onRes=false, nearNodeId=52c634c0-6675-44eb-bf52-d2d0f0100000, nearFutId=588085, flags=hasRes]]] class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Failed to find a page for eviction [segmentCapacity=2545, loaded=458, maxDirtyPages=640, dirtyPages=458, cpPages=0, pinnedInSegment=0, failedToPrepare=459] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.tryToFindSequentially(PageMemoryImpl.java:1893) at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.evictPage(PageMemoryImpl.java:1817) at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.access$600(PageMemoryImpl.java:1550) at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:414) at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore$1.allocatePageNoReuse(GridCacheOffheapManager.java:925) at org.apache.ignite.internal.processors.cache.persistence.DataStructure.allocatePage(DataStructure.java:105) at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:416) at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:518) at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:618) at org.apache.ignite.internal.processors.cache.persistence.freelist.FreeListImpl$RemoveRowHandler.run(FreeListImpl.java:297) at org.apache.ignite.internal.processors.cache.persistence.freelist.FreeListImpl$RemoveRowHandler.run(FreeListImpl.java:264) at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:277) at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:223) at org.apache.ignite.internal.processors.cache.persistence.freelist.FreeListImpl.removeDataRowByLink(FreeListImpl.java:526) at org.apache.ignite.internal.processors.cache.persistence.RowStore.removeRow(RowStore.java:69) at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.finishUpdate(IgniteCacheOffheapManagerImpl.java:1371) at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke(IgniteCacheOffheapManagerImpl.java:1209) at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.invoke(GridCacheOffheapManager.java:1263) at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:343) at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerUpdate(GridCacheMapEntry.java:1693) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.processDhtAtomicUpdateRequest(GridDhtAtomicCache.java:3220) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.access$600(GridDhtAtomicCache.java:130) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$7.apply(GridDhtAtomicCache.java:304) at org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$7.apply(GridDhtAtomicCache.java:299) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:1060) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:579) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:378) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:304) at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100(GridCacheIoManager.java:99) at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:293) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1555) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1183) at org.apache.ignite.internal.managers.communication.GridIoManager.access$4200(GridIoManager.java:126) at org.apache.ignite.internal.managers.communication.GridIoManager$9.run(GridIoManager.java:1090) at org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505) at java.lang.Thread.run(Thread.java:745)
Most of runs locally test passes, but on TC it is stable failing, see test history.
Run after which test began to fail includes 16 changes: https://ci.ignite.apache.org/viewLog.html?buildId=772702&tab=buildChangesDiv&buildTypeId=Ignite20Tests_IgnitePdsIndexing
Default memory policy in this test is set to 100Mbytes, but in this test persistence is enabled.