[IGNITE-10815] NullPointerException in InitNewCoordinatorFuture.init() leads to cluster hang

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.4
• Fix Version/s: 2.8
• Assignee: Pavel Kovalenko
• Reporter: Anton Kurbanov
• Created: 25/Dec/18 13:17
• Updated: 27/Dec/18 08:36
• Resolved: 27/Dec/18 08:34

Description

Possible scenario to reproduce:

1. Force few consecutive exchange merges and finish.

2. Trigger exchange.

3. Shutdown coordinator node before sending/receiving full partitions message.

 

Stacktrace:

2018-12-24 15:54:02,664 sys-#48%gg% ERROR org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture - Failed to init new coordinator future: bd74f7ed-6984-4f78-9941-480df673ab77

java.lang.NullPointerException: null
at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.events(GridDhtPartitionsExchangeFuture.java:534) ~[ignite-core-2.4.13.b4.jar:2.4.13.b4]
at org.apache.ignite.internal.processors.cache.CacheAffinitySharedManager$18.applyx(CacheAffinitySharedManager.java:1790) ~[ignite-core-2.4.13.b4.jar:2.4.13.b4]
at org.apache.ignite.internal.processors.cache.CacheAffinitySharedManager$18.applyx(CacheAffinitySharedManager.java:1738) ~[ignite-core-2.4.13.b4.jar:2.4.13.b4]
at org.apache.ignite.internal.processors.cache.CacheAffinitySharedManager.forAllRegisteredCacheGroups(CacheAffinitySharedManager.java:1107) ~[ignite-core-2.4.13.b4.jar:2.4.13.b4]
at org.apache.ignite.internal.processors.cache.CacheAffinitySharedManager.initCoordinatorCaches(CacheAffinitySharedManager.java:1738) ~[ignite-core-2.4.13.b4.jar:2.4.13.b4]
at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.InitNewCoordinatorFuture.init(InitNewCoordinatorFuture.java:104) ~[ignite-core-2.4.13.b4.jar:2.4.13.b4]
at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture$8$1.call(GridDhtPartitionsExchangeFuture.java:3439) [ignite-core-2.4.13.b4.jar:2.4.13.b4]
at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture$8$1.call(GridDhtPartitionsExchangeFuture.java:3435) [ignite-core-2.4.13.b4.jar:2.4.13.b4]
at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6720) [ignite-core-2.4.13.b4.jar:2.4.13.b4]
at org.apache.ignite.internal.processors.closure.GridClosureProcessor$2.body(GridClosureProcessor.java:967) [ignite-core-2.4.13.b4.jar:2.4.13.b4]
at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) [ignite-core-2.4.13.b4.jar:2.4.13.b4]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_171]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_171]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_171]

 

Issue Links

• links to: GitHub Pull Request #5746