Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2093

Fair Scheduler IllegalStateException after upgrade from 2.2.0 to 2.4.1-SNAP

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.4.1
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      After upgrading from 2.2.0 to 2.4.1-SNAP, I ran into the following on startup:

      21:19:34,308  INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000009 State change from SUBMITTED to SCHEDULED
      21:19:34,309  INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000008 State change from SUBMITTED to SCHEDULED
      21:19:34,310  INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000010 State change from SUBMITTED to SCHEDULED
      21:19:34,310  INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0003_000011 State change from SUBMITTED to SCHEDULED
      21:19:34,317  INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000009 to scheduler from user: samza-perf-playground
      21:19:34,318  INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000010 to scheduler from user: samza-perf-playground
      21:19:34,318  INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000009 State change from SUBMITTED to SCHEDULED
      21:19:34,318  INFO FairScheduler:733 - Application appattempt_1400092144371_0003_000005 is done. finalState=FAILED
      21:19:34,319  INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000010 State change from SUBMITTED to SCHEDULED
      21:19:34,319  INFO AppSchedulingInfo:108 - Application application_1400092144371_0003 requests cleared
      21:19:34,319  INFO FairScheduler:673 - Added Application Attempt appattempt_1400092144371_0004_000011 to scheduler from user: samza-perf-playground
      21:19:34,320  INFO FairScheduler:733 - Application appattempt_1400092144371_0003_000006 is done. finalState=FAILED
      21:19:34,320  INFO AppSchedulingInfo:108 - Application application_1400092144371_0003 requests cleared
      21:19:34,320  INFO RMAppAttemptImpl:659 - appattempt_1400092144371_0004_000011 State change from SUBMITTED to SCHEDULED
      21:19:34,323 FATAL ResourceManager:600 - Error in handling event type APP_ATTEMPT_REMOVED to the scheduler
      java.lang.IllegalStateException: Given app to remove org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerApp@429f809d does not exist in queue [root.samza-perf-playground, demand=<memory:0, vCores:0>, running=<memory:0, vCores:0>, share=<memory:368640, vCores:0>, w=<memory weight=1.0, cpu weight=1.0>]
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSLeafQueue.removeApp(FSLeafQueue.java:93)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.removeApplicationAttempt(FairScheduler.java:774)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1201)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:122)
      	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:591)
      	at java.lang.Thread.run(Thread.java:744)
      21:19:34,330  INFO ResourceManager:604 - Exiting, bbye..
      21:19:34,335  INFO log:67 - Stopped SelectChannelConnector@xxxx:8088
      21:19:34,437  INFO Server:2398 - Stopping server on 8033
      21:19:34,438  INFO Server:694 - Stopping IPC Server listener on 8033
      

      Last commit message for this build is (branch-2.4 on github.com/apache/hadoop-common):

      commit 09e24d5519187c0db67aacc1992be5d43829aa1e
      Author: Arpit Agarwal <arp@apache.org>
      Date:   Tue May 20 20:18:46 2014 +0000
      
          HADOOP-10562. Fix CHANGES.txt entry again
          
          git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2.4@1596389 13f79535-47bb-0310-9956-ffa450edef68
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                wilfreds Wilfred Spiegelenburg
                Reporter:
                jonbringhurst Jon Bringhurst
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: