[YARN-9940] avoid continuous scheduling thread crashes while sorting nodes get 'Comparison method violates its general contract'

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 2.7.2
• Component/s: fairscheduler
• Assignee: kailiu_dev
• Reporter: kailiu_dev
• Created: 29/Oct/19 12:35
• Updated: 18/Mar/20 04:55
• Resolved: 18/Mar/20 04:55

Description

2019-10-16 09:14:51,215 ERROR org.apache.hadoop.yarn.YarnUncaughtExceptionHandler: Thread Thread[FairSchedulerContinuousScheduling,5,main] threw an Exception.
java.lang.IllegalArgumentException: Comparison method violates its general contract!
        at java.util.TimSort.mergeHi(TimSort.java:868)
        at java.util.TimSort.mergeAt(TimSort.java:485)
        at java.util.TimSort.mergeForceCollapse(TimSort.java:426)
        at java.util.TimSort.sort(TimSort.java:223)
        at java.util.TimSort.sort(TimSort.java:173)
        at java.util.Arrays.sort(Arrays.java:659)
        at java.util.Collections.sort(Collections.java:217)
        at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.continuousSchedulingAttempt(FairScheduler.java:1117)
        at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler$ContinuousSchedulingThread.run(FairScheduler.java:296)

Issue Links

• is duplicated by: YARN-9952 Continuous scheduling thread crashes
• relates to: YARN-6448 Continuous scheduling thread crashes while sorting nodes
• relates to: YARN-8436 FSParentQueue: Comparison method violates its general contract