[IGNITE-8085] Flaky failures in Ignite Client Nodes test suite: Remote node could not start.

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.7
• Labels: MakeTeamcityGreenAgain
• Assignee: Ivan Fedotov
• Reporter: Dmitry Pavlov
• Created: 30/Mar/18 14:42
• Updated: 26/Jun/18 17:50
• Resolved: 18/May/18 16:39

Description

Ignite Start Nodes
IgniteStartStopRestartTestSuite: IgniteProjectionStartStopRestartSelfTest.testStartFiveNodesInTwoCalls (master fail rate 12,1%)
IgniteStartStopRestartTestSuite: IgniteProjectionStartStopRestartSelfTest.testStopNodes (master fail rate 10,1%)
IgniteStartStopRestartTestSuite: IgniteProjectionStartStopRestartSelfTest.testStopNodesByIds (master fail rate 10,1%)

https://ci.ignite.apache.org/project.html?projectId=IgniteTests24Java8&testNameId=6814497542781613621&branch=%3Cdefault%3E&tab=testDetails

https://ci.ignite.apache.org/project.html?projectId=IgniteTests24Java8&testNameId=1179745277331816127&branch=%3Cdefault%3E&tab=testDetails

https://ci.ignite.apache.org/project.html?projectId=IgniteTests24Java8&testNameId=-842929918974855010&branch=%3Cdefault%3E&tab=testDetails

Test itself is quite old. Last commits were from tledkov-gridgain at 2017.

class org.apache.ignite.IgniteException: Remote node could not start. See log for details: /data/teamcity/work/bd85361428dcdb1/work/log/ignite-startNodes/03-29-2018--02-47-24-2003434e.log
    at org.apache.ignite.internal.IgniteProjectionStartStopRestartSelfTest$7.apply(IgniteProjectionStartStopRestartSelfTest.java:388)
    at org.apache.ignite.internal.IgniteProjectionStartStopRestartSelfTest$7.apply(IgniteProjectionStartStopRestartSelfTest.java:383)
    at org.apache.ignite.internal.util.lang.GridFunc.forEach(GridFunc.java:1897)
    at org.apache.ignite.internal.IgniteProjectionStartStopRestartSelfTest.testStartFiveNodesInTwoCalls(IgniteProjectionStartStopRestartSelfTest.java:383)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at junit.framework.TestCase.runTest(TestCase.java:176)
    at org.apache.ignite.testframework.junits.GridAbstractTest.runTestInternal(GridAbstractTest.java:2002)
    at org.apache.ignite.testframework.junits.GridAbstractTest.access$000(GridAbstractTest.java:133)
    at org.apache.ignite.testframework.junits.GridAbstractTest$5.run(GridAbstractTest.java:1917)
    at java.lang.Thread.run(Thread.java:745)

Issue Links

• Blocked: IGNITE-5883 Ignite Start Nodes test suite is flaky
• causes: IGNITE-8533 Timeout collision in Client Nodes test suite
• is related to: IGNITE-538 IgniteProjectionStartStopRestartSelfTest.testStopNodes fails
• relates to: IGNITE-8469 Non-heap memory leak for calling cluster activation multi times
• relates to: IGNITE-8619 Remote node could not start in ssh connection
• links to: GitHub Pull Request #3767
• links to: Team City