Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6171

ConcurrentModificationException on FSAppAttempt.containersToPreempt

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha2
    • Fix Version/s: 2.9.0, 3.0.0-alpha4
    • Component/s: fairscheduler
    • Labels:
      None

      Description

      I have noticed an exception that closes the Application Master occasionally with Fair scheduler.

      Caused by: org.apache.hadoop.ipc.RemoteException(java.util.ConcurrentModificationException): java.util.ConcurrentModificationException
      	at java.util.HashMap$HashIterator.nextEntry(HashMap.java:922)
      	at java.util.HashMap$KeyIterator.next(HashMap.java:956)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:1005)
      	at org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService.allocate(ApplicationMasterService.java:532)
      	at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationMasterProtocolPBServiceImpl.allocate(ApplicationMasterProtocolPBServiceImpl.java:60)
      	at org.apache.hadoop.yarn.proto.ApplicationMasterProtocol$ApplicationMasterProtocolService$2.callBlockingMethod(ApplicationMasterProtocol.java:99)
      	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
      	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073)
      

        Attachments

        1. YARN-6171.000.patch
          5 kB
          Miklos Szegedi
        2. YARN-6171.001.patch
          5 kB
          Miklos Szegedi
        3. YARN-6171.002.patch
          6 kB
          Miklos Szegedi
        4. YARN-6171.003.patch
          6 kB
          Miklos Szegedi
        5. YARN-6171.004.patch
          7 kB
          Miklos Szegedi

          Activity

            People

            • Assignee:
              miklos.szegedi@cloudera.com Miklos Szegedi
              Reporter:
              miklos.szegedi@cloudera.com Miklos Szegedi
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: