[IGNITE-5959] Ignite Hadoop: testClientReconnect and testClientReconnectMultithreaded fail

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.1
• Labels: MakeTeamcityGreenAgain test-failure
• Assignee: Unassigned
• Reporter: Pavel Kovalenko
• Created: 07/Aug/17 13:52
• Updated: 25/Sep/17 13:06

Description

Tests are flaky. Failure ratio ~ 30%

IgniteHadoopFileSystemClientBasedDualSyncSelfTest.testClientReconnectMultithreaded
IgniteHadoopFileSystemClientBasedDualAsyncSelfTest.testClientReconnect
IgniteHadoopFileSystemClientBasedDualAsyncSelfTest.testClientReconnectMultithreaded
IgniteHadoopFileSystemClientBasedPrimarySelfTest.testClientReconnectMultithreaded
IgniteHadoopFileSystemClientBasedProxySelfTest.testClientReconnect

Common case - test fails when tries to stop Ignite node:

[2017-08-07 03:29:26,089][ERROR][test-runner-#23774%grid%][root] Failed to stop grid [igniteInstanceName=grid3, cancel=false]
class org.apache.ignite.IgniteClientDisconnectedException: Client node disconnected: test-IGFS-cli
    at org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:92)
    at org.apache.ignite.internal.IgniteKernal.guard(IgniteKernal.java:3707)
    at org.apache.ignite.internal.IgniteKernal.active(IgniteKernal.java:3423)
    at org.apache.ignite.testframework.junits.GridAbstractTest.awaitTopologyChange(GridAbstractTest.java:2105)
    at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid(GridAbstractTest.java:1030)
    at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid(GridAbstractTest.java:1006)
    at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid(GridAbstractTest.java:1289)
    at org.apache.ignite.internal.processors.hadoop.impl.igfs.IgniteHadoopFileSystemClientBasedAbstractSelfTest.restartServerNodesExceptOne(IgniteHadoopFileSystemClientBasedAbstractSelfTest.java:166)
    at org.apache.ignite.internal.processors.hadoop.impl.igfs.IgniteHadoopFileSystemClientBasedAbstractSelfTest.testClientReconnectMultithreaded(IgniteHadoopFileSystemClientBasedAbstractSelfTest.java:134)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at junit.framework.TestCase.runTest(TestCase.java:176)
    at org.apache.ignite.testframework.junits.GridAbstractTest.runTestInternal(GridAbstractTest.java:2000)
    at org.apache.ignite.testframework.junits.GridAbstractTest.access$000(GridAbstractTest.java:132)
    at org.apache.ignite.testframework.junits.GridAbstractTest$5.run(GridAbstractTest.java:1915)
    at java.lang.Thread.run(Thread.java:745)