Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5722

FairScheduler hides group resolution exceptions when assigning queue

    Details

    • Hadoop Flags:
      Reviewed

      Description

      When a group based placement rule is used and the user does not have any groups the reason for rejecting the application is hidden. An assignment will fail as follows:

      <rule name="primaryGroup" create="true" /> 
      <rule name="reject" /> 
      

      The error logged on the client side:

      09/30 15:59:27 INFO mapreduce.JobSubmitter: Cleaning up the staging area /user/test_user/.staging/job_1475223610304_6043 
      16/09/30 15:59:27 WARN security.UserGroupInformation: PriviledgedActionException as:test_user (auth:SIMPLE) cause:java.io.IOException: Failed to run job : Error assigning app to queue default 
      java.io.IOException: Failed to run job : Error assigning app to queue default 
      at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:301) 
      at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:244) 
      at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307) 
      

      The default queue name is passed in as part of the application submission and not really the queue that is tried.

        Attachments

        1. YARN-5722.2.patch
          1 kB
          Wilfred Spiegelenburg
        2. YARN-5722.1.patch
          1 kB
          Wilfred Spiegelenburg

          Activity

            People

            • Assignee:
              wilfreds Wilfred Spiegelenburg
              Reporter:
              wilfreds Wilfred Spiegelenburg
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: