[YARN-9784] org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestLeafQueue is flaky

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: test
• Assignee: Kinga Marton
• Reporter: Kinga Marton
• Created: 26/Aug/19 13:39
• Updated: 23/Sep/20 18:22
• Resolved: 07/Sep/19 12:38

Description

There are some test cases in TestLeafQueue which are failing intermittently.

From 100 runs, there were 16 failures. 

Some failure examples are the following ones:

2019-08-26 13:18:13 [ERROR] Errors: 
2019-08-26 13:18:13 [ERROR]   TestLeafQueue.setUp:144->setUpInternal:221 WrongTypeOfReturnValue 
2019-08-26 13:18:13 YarnConfigu...
2019-08-26 13:18:13 [ERROR]   TestLeafQueue.setUp:144->setUpInternal:221 WrongTypeOfReturnValue 
2019-08-26 13:18:13 YarnConfigu...
2019-08-26 13:18:13 [INFO] 
2019-08-26 13:18:13 [ERROR] Tests run: 36, Failures: 0, Errors: 2, Skipped: 0

2019-08-26 13:18:09 [ERROR] Failures: 
2019-08-26 13:18:09 [ERROR]   TestLeafQueue.testHeadroomWithMaxCap:1373 expected:<2048> but was:<0>
2019-08-26 13:18:09 [INFO] 
2019-08-26 13:18:09 [ERROR] Tests run: 36, Failures: 1, Errors: 0, Skipped: 0

2019-08-26 13:18:18 [ERROR] Errors: 
2019-08-26 13:18:18 [ERROR]   TestLeafQueue.setUp:144->setUpInternal:221 WrongTypeOfReturnValue 
2019-08-26 13:18:18 YarnConfigu...
2019-08-26 13:18:18 [ERROR]   TestLeafQueue.testHeadroomWithMaxCap:1307 ? ClassCast org.apache.hadoop.yarn.c...
2019-08-26 13:18:18 [INFO] 
2019-08-26 13:18:18 [ERROR] Tests run: 36, Failures: 0, Errors: 2, Skipped: 0

2019-08-26 13:18:10 [ERROR] Failures: 
2019-08-26 13:18:10 [ERROR]   TestLeafQueue.testDRFUserLimits:847 Verify user_0 got resources 
2019-08-26 13:18:10 [INFO] 
2019-08-26 13:18:10 [ERROR] Tests run: 36, Failures: 1, Errors: 0, Skipped: 0

Issue Links

• is related to: HADOOP-16503 [JDK11] TestLeafQueue tests are failing due to WrongTypeOfReturnValue
• is related to: YARN-9757 TestLeafQueue#testReservation fails intermittent
• relates to: YARN-10447 TestLeafQueue: ActivitiesManager thread might interfere with ongoing stubbing