Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4028

Hadoop Capacity-Scheduler

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 1.0.0
    • None
    • capacity-sched
    • None

    Description

      I config success capacity-scheduler
      But when i run job has error:

      Queue "default" does not exist

      this error is :

      12/01/18 16:21:04 ERROR security.UserGroupInformation: PriviledgedActionException as:adtech cause:org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.io.IOException: Queue "default" does not exist
      at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3943)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563)
      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388)
      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
      at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382)
      Caused by: java.io.IOException: Queue "default" does not exist
      at org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:437)
      at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3941)
      ... 11 more

      i check hadoop queue

      hadoop queue -showacls
      Queue acls for user : john

      Queue Operations
      =====================
      queue1 submit-job,administer-jobs
      queue2 submit-job,administer-jobs
      queue3 submit-job,administer-jobs
      queue4 submit-job,administer-jobs
      queue5 submit-job,administer-jobs
      queue6 submit-job,administer-jobs

      my config in mapresite.xml:

      <property>
      <name>mapred.jobtracker.taskScheduler</name>
      <value>org.apache.hadoop.mapred.CapacityTaskScheduler</value>
      </property>

      <property>
      <name>mapred.queue.names</name>
      <value>queue1,queue2,queue3,queue4,queue5,queue6</value>
      </property>
      <property>

      <name>mapred.acls.enabled</name>
      <value>false</value>
      </property>

      Attachments

        Activity

          People

            Unassigned Unassigned
            cldoltd cldoltd
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: