[YARN-5722] FairScheduler hides group resolution exceptions when assigning queue

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.6.5, 3.0.0-alpha1
• Fix Version/s: 2.9.0, 3.0.0-alpha2
• Component/s: fairscheduler
• Labels: oct16-easy
• Hadoop Flags: Reviewed
• Assignee: Wilfred Spiegelenburg
• Reporter: Wilfred Spiegelenburg
• Created: 12/Oct/16 03:19
• Updated: 26/Feb/20 05:29
• Resolved: 22/Nov/16 19:52

Description

When a group based placement rule is used and the user does not have any groups the reason for rejecting the application is hidden. An assignment will fail as follows:

<rule name="primaryGroup" create="true" /> 
<rule name="reject" /> 

The error logged on the client side:

09/30 15:59:27 INFO mapreduce.JobSubmitter: Cleaning up the staging area /user/test_user/.staging/job_1475223610304_6043 
16/09/30 15:59:27 WARN security.UserGroupInformation: PriviledgedActionException as:test_user (auth:SIMPLE) cause:java.io.IOException: Failed to run job : Error assigning app to queue default 
java.io.IOException: Failed to run job : Error assigning app to queue default 
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:301) 
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:244) 
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307) 

The default queue name is passed in as part of the application submission and not really the queue that is tried.