2021-03-07 22:49:42,805 INFO [Time-limited test] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2828)) - resource-types.xml not found 2021-03-07 22:49:42,809 INFO [Time-limited test] resource.ResourceUtils (ResourceUtils.java:addResourcesFileToConf(475)) - Unable to find 'resource-types.xml'. 2021-03-07 22:49:43,085 WARN [Time-limited test] util.NativeCodeLoader (NativeCodeLoader.java:(60)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2021-03-07 22:49:43,186 INFO [Time-limited test] resourcemanager.RMNMInfo (RMInfo.java:register(55)) - Registered RMInfo MBean 2021-03-07 22:49:43,217 INFO [Time-limited test] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2831)) - found resource core-site.xml at file:/Users/szilardnemeth/development/apache/hadoop/hadoop-common-project/hadoop-common/target/test-classes/core-site.xml 2021-03-07 22:49:43,280 INFO [Time-limited test] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2831)) - found resource yarn-site.xml at file:/Users/szilardnemeth/development/apache/hadoop/hadoop-tools/hadoop-sls/target/test-classes/yarn-site.xml 2021-03-07 22:49:43,286 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher 2021-03-07 22:49:43,455 INFO [Time-limited test] security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:(75)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms 2021-03-07 22:49:43,462 INFO [Time-limited test] security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:(81)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms 2021-03-07 22:49:43,470 INFO [Time-limited test] security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:(94)) - AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms 2021-03-07 22:49:43,545 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler 2021-03-07 22:49:43,552 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager 2021-03-07 22:49:43,552 INFO [Time-limited test] resourcemanager.ResourceManager (ResourceManager.java:createScheduler(462)) - Using Scheduler: org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler 2021-03-07 22:49:43,575 WARN [Time-limited test] conf.Configuration (Configuration.java:getBoolean(1696)) - Invalid value for boolean: ON, choose default value: true for yarn.sls.metrics.switch 2021-03-07 22:49:43,662 INFO [Time-limited test] util.log (Log.java:initialized(169)) - Logging initialized @1768ms to org.eclipse.jetty.util.log.Slf4jLog 2021-03-07 22:49:43,855 INFO [Time-limited test] server.Server (Server.java:doStart(375)) - jetty-9.4.35.v20201120; built: 2020-11-20T21:17:03.964Z; git: bdc54f03a5e0a7e280fab27f55c3c75ee8da89fb; jvm 1.8.0_151-b12 2021-03-07 22:49:43,910 INFO [Time-limited test] server.AbstractConnector (AbstractConnector.java:doStart(331)) - Started ServerConnector@2f1df01c{HTTP/1.1, (http/1.1)}{0.0.0.0:10001} 2021-03-07 22:49:43,910 INFO [Time-limited test] server.Server (Server.java:doStart(415)) - Started @2017ms 2021-03-07 22:49:43,918 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.event.EventDispatcher 2021-03-07 22:49:43,920 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher 2021-03-07 22:49:43,923 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher 2021-03-07 22:49:43,926 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher 2021-03-07 22:49:44,029 INFO [Time-limited test] impl.MetricsConfig (MetricsConfig.java:loadFirst(120)) - Loaded properties from hadoop-metrics2.properties 2021-03-07 22:49:54,089 INFO [Time-limited test] impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(378)) - Scheduled Metric snapshot period at 10 second(s). 2021-03-07 22:49:54,090 INFO [Time-limited test] impl.MetricsSystemImpl (MetricsSystemImpl.java:start(191)) - ResourceManager metrics system started 2021-03-07 22:49:54,124 INFO [Time-limited test] resourcemanager.ResourceManager (ResourceManager.java:createReservationSystem(485)) - Using ReservationSystem: org.apache.hadoop.yarn.server.resourcemanager.reservation.FairReservationSystem 2021-03-07 22:49:54,129 INFO [Time-limited test] resourcemanager.ResourceManager (ResourceManager.java:serviceInit(816)) - Initialized Reservation system 2021-03-07 22:49:54,154 INFO [Time-limited test] security.YarnAuthorizationProvider (YarnAuthorizationProvider.java:getInstance(59)) - org.apache.hadoop.yarn.security.ConfiguredYarnAuthorizer is instantiated. 2021-03-07 22:49:54,189 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager 2021-03-07 22:49:54,222 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.sls.resourcemanager.MockAMLauncher 2021-03-07 22:49:54,594 INFO [Time-limited test] resourcemanager.RMNMInfo (RMNMInfo.java:(66)) - Registered RMNMInfo MBean 2021-03-07 22:49:54,594 INFO [Time-limited test] monitor.RMAppLifetimeMonitor (RMAppLifetimeMonitor.java:serviceInit(67)) - Application lifelime monitor interval set to 3000 ms. 2021-03-07 22:49:54,604 INFO [Time-limited test] placement.MultiNodeSortingManager (MultiNodeSortingManager.java:serviceInit(63)) - Initializing NodeSortingService=MultiNodeSortingManager 2021-03-07 22:49:54,612 INFO [Time-limited test] util.HostsFileReader (HostsFileReader.java:refresh(239)) - Refreshing hosts (include/exclude) list 2021-03-07 22:49:54,614 INFO [Time-limited test] scheduler.AbstractYarnScheduler (AbstractYarnScheduler.java:getMinimumAllocation(1532)) - Minimum allocation = 2021-03-07 22:49:54,614 INFO [Time-limited test] scheduler.AbstractYarnScheduler (AbstractYarnScheduler.java:getMaximumAllocation(1544)) - Maximum allocation = 2021-03-07 22:49:54,666 INFO [Time-limited test] placement.PlacementFactory (PlacementFactory.java:getPlacementRule(69)) - Creating PlacementRule implementation: class org.apache.hadoop.yarn.server.resourcemanager.placement.SpecifiedPlacementRule 2021-03-07 22:49:54,666 INFO [Time-limited test] placement.PlacementFactory (PlacementFactory.java:getPlacementRule(69)) - Creating PlacementRule implementation: class org.apache.hadoop.yarn.server.resourcemanager.placement.UserPlacementRule 2021-03-07 22:49:54,788 INFO [Time-limited test] fair.AllocationFileLoaderService (AllocationFileLoaderService.java:reloadAllocations(236)) - Loading allocation file file:/Users/szilardnemeth/development/apache/hadoop/hadoop-tools/hadoop-sls/target/test-classes/fair-scheduler.xml 2021-03-07 22:49:54,888 INFO [Time-limited test] placement.PlacementFactory (PlacementFactory.java:getPlacementRule(69)) - Creating PlacementRule implementation: class org.apache.hadoop.yarn.server.resourcemanager.placement.SpecifiedPlacementRule 2021-03-07 22:49:54,889 INFO [Time-limited test] placement.PlacementFactory (PlacementFactory.java:getPlacementRule(69)) - Creating PlacementRule implementation: class org.apache.hadoop.yarn.server.resourcemanager.placement.UserPlacementRule 2021-03-07 22:49:54,916 INFO [Time-limited test] monitor.SchedulingMonitor (SchedulingMonitor.java:serviceInit(61)) - Initializing SchedulingMonitor=SchedulingMonitor (ReservationInvariantsChecker) 2021-03-07 22:49:54,916 INFO [Time-limited test] invariants.InvariantsChecker (InvariantsChecker.java:init(57)) - Invariant checker ReservationInvariantsChecker enabled. Monitoring every 1000ms, throwOnViolation=true 2021-03-07 22:49:54,922 INFO [Time-limited test] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2828)) - dynamic-resources.xml not found 2021-03-07 22:49:54,925 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:initialize(146)) - Initializing Reservation system 2021-03-07 22:49:54,925 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:getAdmissionPolicy(491)) - Using AdmissionPolicy: org.apache.hadoop.yarn.server.resourcemanager.reservation.CapacityOverTimePolicy for queue: root.sls_queue_1 2021-03-07 22:49:54,935 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:getAgent(467)) - Using Agent: org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.AlignedPlannerWithGreedy for queue: root.sls_queue_1 2021-03-07 22:49:54,947 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:getReplanner(444)) - Using Replanner: org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.SimpleCapacityReplanner for queue: root.sls_queue_1 2021-03-07 22:49:54,950 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:initializePlan(435)) - Initialized plan In-memory Plan: Parent Queue: root.sls_queue_1 Total Capacity: Step: 1000 based on reservable queue root.sls_queue_1 2021-03-07 22:49:54,953 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:createPlanFollower(261)) - Using PlanFollowerPolicy: org.apache.hadoop.yarn.server.resourcemanager.reservation.FairSchedulerPlanFollower 2021-03-07 22:49:54,955 INFO [Time-limited test] reservation.FairSchedulerPlanFollower (FairSchedulerPlanFollower.java:init(47)) - Initializing Plan Follower Policy:org.apache.hadoop.yarn.server.resourcemanager.reservation.FairSchedulerPlanFollower 2021-03-07 22:49:54,955 INFO [Time-limited test] resourcemanager.AMSProcessingChain (AMSProcessingChain.java:init(63)) - Initializing AMS Processing chain. Root Processor=[org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor]. 2021-03-07 22:49:54,955 INFO [Time-limited test] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:addPlacementConstraintHandler(133)) - disabled placement handler will be used, all scheduling requests will be rejected. 2021-03-07 22:49:54,958 INFO [Time-limited test] resourcemanager.AMSProcessingChain (AMSProcessingChain.java:addProcessor(76)) - Adding [org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint.processor.DisabledPlacementProcessor] tp top of AMS Processing chain. 2021-03-07 22:49:54,966 INFO [Time-limited test] resourcemanager.ResourceManager (ResourceManager.java:createSystemMetricsPublisher(599)) - TimelineServicePublisher is not configured 2021-03-07 22:50:15,167 INFO [Time-limited test] http.HttpRequestLog (HttpRequestLog.java:getRequestLog(82)) - Http request log for http.requests.resourcemanager is not defined 2021-03-07 22:50:15,171 INFO [Time-limited test] http.HttpServer2 (HttpServer2.java:addGlobalFilter(1059)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2021-03-07 22:50:15,175 INFO [Time-limited test] http.HttpServer2 (HttpServer2.java:addFilter(1032)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster 2021-03-07 22:50:15,175 INFO [Time-limited test] http.HttpServer2 (HttpServer2.java:addFilter(1042)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs 2021-03-07 22:50:15,175 INFO [Time-limited test] http.HttpServer2 (HttpServer2.java:addFilter(1042)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static 2021-03-07 22:50:15,805 INFO [Time-limited test] webapp.WebApps (WebApps.java:build(428)) - Registered webapp guice modules 2021-03-07 22:50:15,808 INFO [Time-limited test] http.HttpServer2 (HttpServer2.java:bindListener(1280)) - Jetty bound to port 18088 2021-03-07 22:50:15,808 INFO [Time-limited test] server.Server (Server.java:doStart(375)) - jetty-9.4.35.v20201120; built: 2020-11-20T21:17:03.964Z; git: bdc54f03a5e0a7e280fab27f55c3c75ee8da89fb; jvm 1.8.0_151-b12 2021-03-07 22:50:15,820 INFO [Time-limited test] server.session (DefaultSessionIdManager.java:doStart(334)) - DefaultSessionIdManager workerName=node0 2021-03-07 22:50:15,820 INFO [Time-limited test] server.session (DefaultSessionIdManager.java:doStart(339)) - No SessionScavenger set, using defaults 2021-03-07 22:50:15,822 INFO [Time-limited test] server.session (HouseKeeper.java:startScavenging(132)) - node0 Scavenging every 660000ms 2021-03-07 22:50:15,866 INFO [Time-limited test] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(367)) - Updating the current master key for generating delegation tokens 2021-03-07 22:50:15,868 INFO [Thread[Thread-31,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(701)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s) 2021-03-07 22:50:15,869 INFO [Thread[Thread-31,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(367)) - Updating the current master key for generating delegation tokens 2021-03-07 22:50:15,902 INFO [Time-limited test] handler.ContextHandler (ContextHandler.java:doStart(916)) - Started o.e.j.s.ServletContextHandler@3476465f{logs,/logs,file:///Users/szilardnemeth/development/apache/hadoop/hadoop-tools/hadoop-sls/target/log,AVAILABLE} 2021-03-07 22:50:15,902 INFO [Time-limited test] handler.ContextHandler (ContextHandler.java:doStart(916)) - Started o.e.j.s.ServletContextHandler@1e627539{static,/static,file:///Users/szilardnemeth/development/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/classes/webapps/static/,AVAILABLE} Mar 07, 2021 10:50:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class Mar 07, 2021 10:50:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class Mar 07, 2021 10:50:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class Mar 07, 2021 10:50:16 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM' Mar 07, 2021 10:50:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" Mar 07, 2021 10:50:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" Mar 07, 2021 10:50:17 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2021-03-07 22:50:17,499 INFO [Time-limited test] handler.ContextHandler (ContextHandler.java:doStart(916)) - Started o.e.j.w.WebAppContext@47ae75d4{cluster,/,file:///Users/szilardnemeth/development/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/classes/webapps/cluster/,AVAILABLE}{file:/Users/szilardnemeth/development/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/classes/webapps/cluster} 2021-03-07 22:50:17,502 INFO [Time-limited test] server.AbstractConnector (AbstractConnector.java:doStart(331)) - Started ServerConnector@2121c076{HTTP/1.1, (http/1.1)}{localhost:18088} 2021-03-07 22:50:17,503 INFO [Time-limited test] server.Server (Server.java:doStart(415)) - Started @35610ms 2021-03-07 22:50:17,503 INFO [Time-limited test] webapp.WebApps (WebApps.java:start(473)) - Web app cluster started at 18088 2021-03-07 22:50:17,670 INFO [Time-limited test] ipc.CallQueueManager (CallQueueManager.java:(93)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 100, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2021-03-07 22:50:17,700 INFO [Socket Reader #1 for port 18033] ipc.Server (Server.java:run(1267)) - Starting Socket Reader #1 for port 18033 2021-03-07 22:50:18,026 INFO [Listener at localhost/18033] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server 2021-03-07 22:50:18,026 INFO [IPC Server Responder] ipc.Server (Server.java:run(1509)) - IPC Server Responder: starting 2021-03-07 22:50:18,026 INFO [IPC Server listener on 18033] ipc.Server (Server.java:run(1346)) - IPC Server listener on 18033: starting 2021-03-07 22:50:18,029 INFO [Listener at localhost/18033] resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(1341)) - Transitioning to active state 2021-03-07 22:50:18,058 INFO [Listener at localhost/18033] recovery.RMStateStore (RMStateStore.java:transition(565)) - Updating AMRMToken 2021-03-07 22:50:18,059 INFO [Listener at localhost/18033] security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(109)) - Rolling master-key for container-tokens 2021-03-07 22:50:18,059 INFO [Listener at localhost/18033] security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(95)) - Rolling master-key for nm-tokens 2021-03-07 22:50:18,059 INFO [Listener at localhost/18033] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(367)) - Updating the current master key for generating delegation tokens 2021-03-07 22:50:18,059 INFO [Listener at localhost/18033] security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(92)) - storing master key with keyID 1 2021-03-07 22:50:18,059 INFO [Listener at localhost/18033] recovery.RMStateStore (RMStateStore.java:transition(516)) - Storing RMDTMasterKey. 2021-03-07 22:50:18,060 INFO [Thread[Thread-39,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(701)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s) 2021-03-07 22:50:18,060 INFO [Thread[Thread-39,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(367)) - Updating the current master key for generating delegation tokens 2021-03-07 22:50:18,060 INFO [Thread[Thread-39,5,FailOnTimeoutGroup]] security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(92)) - storing master key with keyID 2 2021-03-07 22:50:18,060 INFO [Thread[Thread-39,5,FailOnTimeoutGroup]] recovery.RMStateStore (RMStateStore.java:transition(516)) - Storing RMDTMasterKey. 2021-03-07 22:50:18,064 INFO [Listener at localhost/18033] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.nodelabels.event.NodeLabelsStoreEventType for class org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager$ForwardingEventHandler 2021-03-07 22:50:18,074 INFO [Listener at localhost/18033] store.AbstractFSNodeStore (AbstractFSNodeStore.java:initStore(72)) - Created store directory :file:/tmp/hadoop-yarn-szilardnemeth/node-attribute 2021-03-07 22:50:18,167 INFO [Listener at localhost/18033] store.AbstractFSNodeStore (AbstractFSNodeStore.java:recoverFromStore(187)) - Finished write mirror at:file:/tmp/hadoop-yarn-szilardnemeth/node-attribute/nodeattribute.mirror 2021-03-07 22:50:18,167 INFO [Listener at localhost/18033] store.AbstractFSNodeStore (AbstractFSNodeStore.java:recoverFromStore(188)) - Finished create editlog file at:file:/tmp/hadoop-yarn-szilardnemeth/node-attribute/nodeattribute.editlog 2021-03-07 22:50:18,169 INFO [Listener at localhost/18033] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.nodelabels.NodeAttributesStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.nodelabels.NodeAttributesManagerImpl$ForwardingEventHandler 2021-03-07 22:50:18,170 INFO [Listener at localhost/18033] placement.MultiNodeSortingManager (MultiNodeSortingManager.java:serviceStart(71)) - Starting NodeSortingService=MultiNodeSortingManager 2021-03-07 22:50:18,170 INFO [Listener at localhost/18033] monitor.SchedulingMonitor (SchedulingMonitor.java:serviceStart(69)) - Starting SchedulingMonitor=SchedulingMonitor (ReservationInvariantsChecker) 2021-03-07 22:50:18,194 INFO [Listener at localhost/18033] ipc.CallQueueManager (CallQueueManager.java:(93)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2021-03-07 22:50:18,194 INFO [Socket Reader #1 for port 18031] ipc.Server (Server.java:run(1267)) - Starting Socket Reader #1 for port 18031 2021-03-07 22:50:18,197 INFO [Listener at localhost/18031] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server 2021-03-07 22:50:18,198 INFO [IPC Server Responder] ipc.Server (Server.java:run(1509)) - IPC Server Responder: starting 2021-03-07 22:50:18,198 INFO [IPC Server listener on 18031] ipc.Server (Server.java:run(1346)) - IPC Server listener on 18031: starting 2021-03-07 22:50:18,215 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (0) does NOT match the number of reservationQueues (-1), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:18,216 INFO [org.apache.hadoop.util.JvmPauseMonitor$Monitor@fc54314] util.JvmPauseMonitor (JvmPauseMonitor.java:run(188)) - Starting JVM pause monitor 2021-03-07 22:50:18,233 INFO [Listener at localhost/18031] ipc.CallQueueManager (CallQueueManager.java:(93)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2021-03-07 22:50:18,242 INFO [Socket Reader #1 for port 18030] ipc.Server (Server.java:run(1267)) - Starting Socket Reader #1 for port 18030 2021-03-07 22:50:18,252 INFO [Listener at localhost/18030] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server 2021-03-07 22:50:18,253 INFO [IPC Server Responder] ipc.Server (Server.java:run(1509)) - IPC Server Responder: starting 2021-03-07 22:50:18,253 INFO [IPC Server listener on 18030] ipc.Server (Server.java:run(1346)) - IPC Server listener on 18030: starting 2021-03-07 22:50:18,394 INFO [Listener at localhost/18030] ipc.CallQueueManager (CallQueueManager.java:(93)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2021-03-07 22:50:18,395 INFO [Socket Reader #1 for port 18032] ipc.Server (Server.java:run(1267)) - Starting Socket Reader #1 for port 18032 2021-03-07 22:50:18,399 INFO [Listener at localhost/18032] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server 2021-03-07 22:50:18,400 INFO [IPC Server Responder] ipc.Server (Server.java:run(1509)) - IPC Server Responder: starting 2021-03-07 22:50:18,400 INFO [IPC Server listener on 18032] ipc.Server (Server.java:run(1346)) - IPC Server listener on 18032: starting 2021-03-07 22:50:18,946 INFO [Listener at localhost/18032] webproxy.ProxyCA (ProxyCA.java:createCert(183)) - Created Certificate for OU=YARN-ad5bf69f-dcd0-409a-a536-8619c78259dc 2021-03-07 22:50:18,976 INFO [Listener at localhost/18032] recovery.RMStateStore (RMStateStore.java:transition(647)) - Storing CA Certificate and Private Key 2021-03-07 22:50:18,976 INFO [Listener at localhost/18032] resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(1357)) - Transitioned to active state 2021-03-07 22:50:18,983 INFO [Listener at localhost/18032] synthetic.SynthTraceJobProducer (SynthTraceJobProducer.java:(82)) - SynthTraceJobProducer 2021-03-07 22:50:19,173 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (0) does NOT match the number of reservationQueues (-1), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:19,236 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:19,283 INFO [Listener at localhost/18032] synthetic.SynthTraceJobProducer (SynthTraceJobProducer.java:validateJobDef(184)) - Detected old JobDefinition format. Converting. 2021-03-07 22:50:19,308 INFO [Listener at localhost/18032] synthetic.SynthTraceJobProducer (SynthTraceJobProducer.java:(110)) - Generated 10 deadlines for 10 jobs 2021-03-07 22:50:19,959 INFO [pool-6-thread-3] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node17(cmPort: 19 httpPort: 80) registered with capability: , assigned nodeId node17:19 2021-03-07 22:50:19,959 INFO [pool-6-thread-18] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node19(cmPort: 4 httpPort: 80) registered with capability: , assigned nodeId node19:4 2021-03-07 22:50:19,959 INFO [pool-6-thread-9] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node8(cmPort: 14 httpPort: 80) registered with capability: , assigned nodeId node8:14 2021-03-07 22:50:19,959 INFO [pool-6-thread-6] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node13(cmPort: 6 httpPort: 80) registered with capability: , assigned nodeId node13:6 2021-03-07 22:50:19,959 INFO [pool-6-thread-14] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node4(cmPort: 13 httpPort: 80) registered with capability: , assigned nodeId node4:13 2021-03-07 22:50:19,959 INFO [pool-6-thread-15] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node5(cmPort: 12 httpPort: 80) registered with capability: , assigned nodeId node5:12 2021-03-07 22:50:19,959 INFO [pool-6-thread-2] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node18(cmPort: 3 httpPort: 80) registered with capability: , assigned nodeId node18:3 2021-03-07 22:50:19,959 INFO [pool-6-thread-19] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node0(cmPort: 8 httpPort: 80) registered with capability: , assigned nodeId node0:8 2021-03-07 22:50:19,959 INFO [pool-6-thread-12] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node7(cmPort: 16 httpPort: 80) registered with capability: , assigned nodeId node7:16 2021-03-07 22:50:19,959 INFO [pool-6-thread-17] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node11(cmPort: 1 httpPort: 80) registered with capability: , assigned nodeId node11:1 2021-03-07 22:50:19,959 INFO [pool-6-thread-10] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node14(cmPort: 17 httpPort: 80) registered with capability: , assigned nodeId node14:17 2021-03-07 22:50:19,959 INFO [pool-6-thread-7] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node2(cmPort: 5 httpPort: 80) registered with capability: , assigned nodeId node2:5 2021-03-07 22:50:19,959 INFO [pool-6-thread-5] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node6(cmPort: 7 httpPort: 80) registered with capability: , assigned nodeId node6:7 2021-03-07 22:50:19,959 INFO [pool-6-thread-11] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node16(cmPort: 15 httpPort: 80) registered with capability: , assigned nodeId node16:15 2021-03-07 22:50:19,959 INFO [pool-6-thread-13] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node10(cmPort: 0 httpPort: 80) registered with capability: , assigned nodeId node10:0 2021-03-07 22:50:19,959 INFO [pool-6-thread-4] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node3(cmPort: 10 httpPort: 80) registered with capability: , assigned nodeId node3:10 2021-03-07 22:50:19,959 INFO [pool-6-thread-8] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node1(cmPort: 9 httpPort: 80) registered with capability: , assigned nodeId node1:9 2021-03-07 22:50:19,959 INFO [pool-6-thread-20] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node9(cmPort: 11 httpPort: 80) registered with capability: , assigned nodeId node9:11 2021-03-07 22:50:19,959 INFO [pool-6-thread-1] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node12(cmPort: 2 httpPort: 80) registered with capability: , assigned nodeId node12:2 2021-03-07 22:50:19,959 INFO [pool-6-thread-16] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node15(cmPort: 18 httpPort: 80) registered with capability: , assigned nodeId node15:18 2021-03-07 22:50:19,963 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node1:9 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,963 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node0:8 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,963 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node8:14 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,963 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node2:5 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,963 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node16:15 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,963 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node18:3 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,963 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node15:18 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,964 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node14:17 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,964 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node13:6 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,964 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node4:13 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,964 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node5:12 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,964 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node11:1 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,964 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node12:2 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,964 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node7:16 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,964 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node19:4 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,965 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node10:0 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,965 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node9:11 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,965 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node17:19 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,965 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node3:10 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,965 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node6:7 Node Transitioned from NEW to RUNNING 2021-03-07 22:50:19,980 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node1:9 cluster capacity: 2021-03-07 22:50:19,981 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node0:8 cluster capacity: 2021-03-07 22:50:19,982 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node8:14 cluster capacity: 2021-03-07 22:50:19,983 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node2:5 cluster capacity: 2021-03-07 22:50:19,983 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node16:15 cluster capacity: 2021-03-07 22:50:19,984 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node18:3 cluster capacity: 2021-03-07 22:50:19,986 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node15:18 cluster capacity: 2021-03-07 22:50:19,987 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node14:17 cluster capacity: 2021-03-07 22:50:19,988 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node13:6 cluster capacity: 2021-03-07 22:50:19,989 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node4:13 cluster capacity: 2021-03-07 22:50:19,990 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node5:12 cluster capacity: 2021-03-07 22:50:19,990 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node11:1 cluster capacity: 2021-03-07 22:50:19,992 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node12:2 cluster capacity: 2021-03-07 22:50:19,993 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node7:16 cluster capacity: 2021-03-07 22:50:19,994 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node19:4 cluster capacity: 2021-03-07 22:50:19,994 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node10:0 cluster capacity: 2021-03-07 22:50:19,995 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node9:11 cluster capacity: 2021-03-07 22:50:19,996 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node17:19 cluster capacity: 2021-03-07 22:50:19,996 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node3:10 cluster capacity: 2021-03-07 22:50:19,997 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node6:7 cluster capacity: 2021-03-07 22:50:20,012 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000000 submission:3000 deadline:533131 duration:53000 deadline-submission: 530131 2021-03-07 22:50:20,030 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 4 mapper and 3 reducers 2021-03-07 22:50:20,064 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000001 submission:3000 deadline:-1 duration:55000 deadline-submission: -3001 2021-03-07 22:50:20,066 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 4 mapper and 4 reducers 2021-03-07 22:50:20,066 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000002 submission:35000 deadline:594970 duration:56000 deadline-submission: 559970 2021-03-07 22:50:20,067 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 3 mapper and 4 reducers 2021-03-07 22:50:20,068 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000003 submission:38000 deadline:658076 duration:62000 deadline-submission: 620076 2021-03-07 22:50:20,069 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 5 mapper and 7 reducers 2021-03-07 22:50:20,070 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000004 submission:39000 deadline:-1 duration:57000 deadline-submission: -39001 2021-03-07 22:50:20,071 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 4 mapper and 3 reducers 2021-03-07 22:50:20,071 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000005 submission:39000 deadline:-1 duration:56000 deadline-submission: -39001 2021-03-07 22:50:20,072 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 5 mapper and 4 reducers 2021-03-07 22:50:20,072 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000006 submission:42000 deadline:-1 duration:62000 deadline-submission: -42001 2021-03-07 22:50:20,073 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 5 mapper and 5 reducers 2021-03-07 22:50:20,073 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000007 submission:45000 deadline:-1 duration:63000 deadline-submission: -45001 2021-03-07 22:50:20,073 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 5 mapper and 4 reducers 2021-03-07 22:50:20,073 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000008 submission:48000 deadline:-1 duration:61000 deadline-submission: -48001 2021-03-07 22:50:20,074 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 3 mapper and 4 reducers 2021-03-07 22:50:20,074 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000009 submission:57000 deadline:-1 duration:57000 deadline-submission: -57001 2021-03-07 22:50:20,074 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 4 mapper and 6 reducers 2021-03-07 22:50:20,078 INFO [Listener at localhost/18032] sls.SLSRunner (SLSRunner.java:waitForNodesRunning(430)) - SLSRunner takes 3 ms to launch all nodes. 2021-03-07 22:50:20,093 INFO [pool-7-thread-2] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(91)) - placing the following ReservationRequest: {Arrival: 1615153820030, Deadline: 1615154353161, Reservation Name: reservation_0, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 4, Concurrency: 4, Lease Duration: 12}, {Capability: , # Containers: 3, Concurrency: 3, Lease Duration: 22}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:50:20,099 INFO [pool-7-thread-3] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 1 2021-03-07 22:50:20,166 INFO [pool-7-thread-2] recovery.RMStateStore (RMStateStore.java:transition(591)) - Storing reservation allocation.reservation_1615153794969_0000 2021-03-07 22:50:20,167 INFO [pool-7-thread-2] reservation.InMemoryPlan (InMemoryPlan.java:addReservation(373)) - Successfully added reservation: reservation_1615153794969_0000 to plan. 2021-03-07 22:50:20,167 INFO [pool-7-thread-2] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(98)) - OUTCOME: SUCCESS, Reservation ID: reservation_1615153794969_0000, Contract: {Arrival: 1615153820030, Deadline: 1615154353161, Reservation Name: reservation_0, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 4, Concurrency: 4, Lease Duration: 12}, {Capability: , # Containers: 3, Concurrency: 3, Lease Duration: 22}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:50:20,167 INFO [pool-7-thread-2] resourcemanager.ClientRMService (ClientRMService.java:refreshScheduler(1538)) - Created reservation reservation_1615153794969_0000 synchronously. 2021-03-07 22:50:20,169 INFO [pool-7-thread-3] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615153818030_0001 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:50:20,171 INFO [pool-7-thread-2] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(381)) - USER=foobar OPERATION=Submit Reservation Request TARGET=ClientRMService: reservation_1615153794969_0000 RESULT=SUCCESS 2021-03-07 22:50:20,172 INFO [pool-7-thread-2] appmaster.AMSimulator (AMSimulator.java:run(196)) - RESERVATION SUCCESSFULLY SUBMITTED reservation_1615153794969_0000 2021-03-07 22:50:20,172 INFO [pool-7-thread-2] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 2 2021-03-07 22:50:20,172 INFO [pool-7-thread-2] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615153818030_0002 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:50:20,174 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (1) does NOT match the number of reservationQueues (0), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:20,238 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:20,263 INFO [pool-7-thread-2] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 2 submitted by user foobar 2021-03-07 22:50:20,264 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615153818030_0001 2021-03-07 22:50:20,264 INFO [pool-7-thread-2] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615153818030_0002 QUEUENAME=root.sls_queue_1 2021-03-07 22:50:20,263 INFO [pool-7-thread-3] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 1 submitted by user foobar 2021-03-07 22:50:20,265 INFO [pool-7-thread-3] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615153818030_0001 QUEUENAME=root.sls_queue_1 2021-03-07 22:50:20,273 INFO [pool-7-thread-2] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615153818030_0002 2021-03-07 22:50:20,273 INFO [pool-7-thread-3] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615153818030_0001 2021-03-07 22:50:20,281 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0001 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:50:20,281 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615153818030_0001 2021-03-07 22:50:20,282 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615153818030_0002 2021-03-07 22:50:20,282 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615153818030_0002 2021-03-07 22:50:20,282 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0002 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:50:20,284 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0001 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:50:20,284 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0002 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:50:20,290 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615153818030_0001 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 1 2021-03-07 22:50:20,291 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615153818030_0002 from user: foobar, in queue: root.sls_queue_1.reservation_1615153794969_0000, currently num of applications: 2 2021-03-07 22:50:20,313 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0001 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:50:20,314 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0002 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:50:20,346 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615153818030_0001_000001 2021-03-07 22:50:20,348 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615153818030_0001_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:50:20,348 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615153818030_0002_000001 2021-03-07 22:50:20,348 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615153818030_0002_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:50:20,408 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615153818030_0001_000001 to scheduler from user: foobar 2021-03-07 22:50:20,409 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615153818030_0002_000001 to scheduler from user: foobar 2021-03-07 22:50:20,411 ERROR [RM Event dispatcher] scheduler.SLSFairScheduler (SLSFairScheduler.java:allocate(116)) - Caught exception from allocate java.lang.RuntimeException: test unchecked exception at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:868) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:111) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:20,411 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615153818030_0001_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:20,412 ERROR [RM Event dispatcher] scheduler.SLSFairScheduler (SLSFairScheduler.java:allocate(116)) - Caught exception from allocate java.lang.RuntimeException: test unchecked exception at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:868) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:111) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:20,412 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615153818030_0002_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:21,241 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:22,246 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:23,250 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:24,255 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:25,256 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:26,259 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:27,263 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:28,266 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:29,270 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:30,273 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:31,274 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:32,277 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:33,278 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:34,280 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:35,283 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:36,287 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:37,290 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:38,293 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:39,297 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:40,302 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:41,304 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:42,307 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:43,311 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:44,316 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:45,321 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:46,323 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:47,326 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:48,326 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:49,328 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:50,329 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:51,330 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:52,086 INFO [pool-7-thread-7] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(91)) - placing the following ReservationRequest: {Arrival: 1615153852067, Deadline: 1615154415037, Reservation Name: reservation_2, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 3, Concurrency: 3, Lease Duration: 10}, {Capability: , # Containers: 4, Concurrency: 4, Lease Duration: 21}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:50:52,096 INFO [pool-7-thread-7] recovery.RMStateStore (RMStateStore.java:transition(591)) - Storing reservation allocation.reservation_1615153794969_0002 2021-03-07 22:50:52,096 INFO [pool-7-thread-7] reservation.InMemoryPlan (InMemoryPlan.java:addReservation(373)) - Successfully added reservation: reservation_1615153794969_0002 to plan. 2021-03-07 22:50:52,097 INFO [pool-7-thread-7] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(98)) - OUTCOME: SUCCESS, Reservation ID: reservation_1615153794969_0002, Contract: {Arrival: 1615153852067, Deadline: 1615154415037, Reservation Name: reservation_2, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 3, Concurrency: 3, Lease Duration: 10}, {Capability: , # Containers: 4, Concurrency: 4, Lease Duration: 21}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:50:52,098 INFO [pool-7-thread-7] resourcemanager.ClientRMService (ClientRMService.java:refreshScheduler(1538)) - Created reservation reservation_1615153794969_0002 synchronously. 2021-03-07 22:50:52,098 INFO [pool-7-thread-7] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(381)) - USER=foobar OPERATION=Submit Reservation Request TARGET=ClientRMService: reservation_1615153794969_0002 RESULT=SUCCESS 2021-03-07 22:50:52,098 INFO [pool-7-thread-7] appmaster.AMSimulator (AMSimulator.java:run(196)) - RESERVATION SUCCESSFULLY SUBMITTED reservation_1615153794969_0002 2021-03-07 22:50:52,098 INFO [pool-7-thread-7] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 3 2021-03-07 22:50:52,099 INFO [pool-7-thread-7] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615153818030_0003 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:50:52,102 INFO [pool-7-thread-7] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 3 submitted by user foobar 2021-03-07 22:50:52,102 INFO [pool-7-thread-7] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615153818030_0003 QUEUENAME=root.sls_queue_1 2021-03-07 22:50:52,102 INFO [pool-7-thread-7] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615153818030_0003 2021-03-07 22:50:52,104 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615153818030_0003 2021-03-07 22:50:52,105 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0003 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:50:52,105 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615153818030_0003 2021-03-07 22:50:52,105 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0003 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:50:52,106 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:rejectApplicationWithMessage(1393)) - Application application_1615153818030_0003 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615153794969_0002 2021-03-07 22:50:52,106 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(1293)) - Updating application application_1615153818030_0003 with final state: FAILED 2021-03-07 22:50:52,116 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0003 State change from SUBMITTED to FINAL_SAVING on event = APP_REJECTED 2021-03-07 22:50:52,116 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(279)) - Updating info for app: application_1615153818030_0003 2021-03-07 22:50:52,122 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0003 State change from FINAL_SAVING to FAILED on event = APP_UPDATE_SAVED 2021-03-07 22:50:52,123 WARN [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:removeApplication(636)) - Couldn't find application application_1615153818030_0003 2021-03-07 22:50:52,124 WARN [RM Event dispatcher] resourcemanager.RMAuditLogger (RMAuditLogger.java:logFailure(541)) - USER=foobar OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1615153818030_0003 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615153794969_0002 APPID=application_1615153818030_0003 2021-03-07 22:50:52,128 INFO [RM Event dispatcher] resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(255)) - appId=application_1615153818030_0003,name=N/A,user=foobar,queue=root.sls_queue_1,state=FAILED,trackingUrl=N/A,appMasterHost=N/A,submitTime=1615153852099,startTime=1615153852099,launchTime=0,finishTime=1615153852106,finalStatus=FAILED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds,applicationTags=,applicationNodeLabel=,diagnostics=Application application_1615153818030_0003 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615153794969_0002,totalAllocatedContainers=0 2021-03-07 22:50:52,174 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (2) does NOT match the number of reservationQueues (1), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:52,333 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:53,339 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:54,341 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:55,091 INFO [pool-7-thread-73] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(91)) - placing the following ReservationRequest: {Arrival: 1615153855069, Deadline: 1615154478145, Reservation Name: reservation_3, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 5, Concurrency: 5, Lease Duration: 11}, {Capability: , # Containers: 7, Concurrency: 7, Lease Duration: 27}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:50:55,100 INFO [pool-7-thread-73] recovery.RMStateStore (RMStateStore.java:transition(591)) - Storing reservation allocation.reservation_1615153794969_0003 2021-03-07 22:50:55,101 INFO [pool-7-thread-73] reservation.InMemoryPlan (InMemoryPlan.java:addReservation(373)) - Successfully added reservation: reservation_1615153794969_0003 to plan. 2021-03-07 22:50:55,101 INFO [pool-7-thread-73] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(98)) - OUTCOME: SUCCESS, Reservation ID: reservation_1615153794969_0003, Contract: {Arrival: 1615153855069, Deadline: 1615154478145, Reservation Name: reservation_3, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 5, Concurrency: 5, Lease Duration: 11}, {Capability: , # Containers: 7, Concurrency: 7, Lease Duration: 27}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:50:55,101 INFO [pool-7-thread-73] resourcemanager.ClientRMService (ClientRMService.java:refreshScheduler(1538)) - Created reservation reservation_1615153794969_0003 synchronously. 2021-03-07 22:50:55,105 INFO [pool-7-thread-73] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(381)) - USER=foobar OPERATION=Submit Reservation Request TARGET=ClientRMService: reservation_1615153794969_0003 RESULT=SUCCESS 2021-03-07 22:50:55,105 INFO [pool-7-thread-73] appmaster.AMSimulator (AMSimulator.java:run(196)) - RESERVATION SUCCESSFULLY SUBMITTED reservation_1615153794969_0003 2021-03-07 22:50:55,105 INFO [pool-7-thread-73] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 4 2021-03-07 22:50:55,105 INFO [pool-7-thread-73] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615153818030_0004 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:50:55,106 INFO [pool-7-thread-73] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 4 submitted by user foobar 2021-03-07 22:50:55,107 INFO [pool-7-thread-73] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615153818030_0004 QUEUENAME=root.sls_queue_1 2021-03-07 22:50:55,107 INFO [pool-7-thread-73] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615153818030_0004 2021-03-07 22:50:55,110 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615153818030_0004 2021-03-07 22:50:55,112 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0004 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:50:55,113 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615153818030_0004 2021-03-07 22:50:55,114 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0004 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:50:55,117 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:rejectApplicationWithMessage(1393)) - Application application_1615153818030_0004 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615153794969_0003 2021-03-07 22:50:55,118 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(1293)) - Updating application application_1615153818030_0004 with final state: FAILED 2021-03-07 22:50:55,119 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0004 State change from SUBMITTED to FINAL_SAVING on event = APP_REJECTED 2021-03-07 22:50:55,120 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(279)) - Updating info for app: application_1615153818030_0004 2021-03-07 22:50:55,121 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0004 State change from FINAL_SAVING to FAILED on event = APP_UPDATE_SAVED 2021-03-07 22:50:55,121 WARN [RM Event dispatcher] resourcemanager.RMAuditLogger (RMAuditLogger.java:logFailure(541)) - USER=foobar OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1615153818030_0004 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615153794969_0003 APPID=application_1615153818030_0004 2021-03-07 22:50:55,122 INFO [RM Event dispatcher] resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(255)) - appId=application_1615153818030_0004,name=N/A,user=foobar,queue=root.sls_queue_1,state=FAILED,trackingUrl=N/A,appMasterHost=N/A,submitTime=1615153855105,startTime=1615153855106,launchTime=0,finishTime=1615153855118,finalStatus=FAILED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds,applicationTags=,applicationNodeLabel=,diagnostics=Application application_1615153818030_0004 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615153794969_0003,totalAllocatedContainers=0 2021-03-07 22:50:55,122 WARN [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:removeApplication(636)) - Couldn't find application application_1615153818030_0004 2021-03-07 22:50:55,174 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (3) does NOT match the number of reservationQueues (2), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:55,347 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:56,087 INFO [pool-7-thread-87] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 5 2021-03-07 22:50:56,087 INFO [pool-7-thread-100] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 6 2021-03-07 22:50:56,087 INFO [pool-7-thread-87] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615153818030_0005 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:50:56,087 INFO [pool-7-thread-100] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615153818030_0006 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:50:56,087 INFO [pool-7-thread-87] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 5 submitted by user foobar 2021-03-07 22:50:56,088 INFO [pool-7-thread-100] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 6 submitted by user foobar 2021-03-07 22:50:56,088 INFO [pool-7-thread-100] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615153818030_0006 QUEUENAME=root.sls_queue_1 2021-03-07 22:50:56,088 INFO [pool-7-thread-100] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615153818030_0006 2021-03-07 22:50:56,088 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615153818030_0005 2021-03-07 22:50:56,088 INFO [pool-7-thread-87] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615153818030_0005 QUEUENAME=root.sls_queue_1 2021-03-07 22:50:56,088 INFO [pool-7-thread-87] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615153818030_0005 2021-03-07 22:50:56,088 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615153818030_0005 2021-03-07 22:50:56,088 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0005 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:50:56,089 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615153818030_0006 2021-03-07 22:50:56,089 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615153818030_0006 2021-03-07 22:50:56,089 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0006 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:50:56,089 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0005 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:50:56,089 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0006 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:50:56,090 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615153818030_0005 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 3 2021-03-07 22:50:56,090 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615153818030_0006 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 4 2021-03-07 22:50:56,090 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0005 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:50:56,090 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0006 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:50:56,090 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615153818030_0005_000001 2021-03-07 22:50:56,090 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615153818030_0005_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:50:56,090 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615153818030_0006_000001 2021-03-07 22:50:56,090 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615153818030_0006_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:50:56,090 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615153818030_0005_000001 to scheduler from user: foobar 2021-03-07 22:50:56,091 ERROR [RM Event dispatcher] scheduler.SLSFairScheduler (SLSFairScheduler.java:allocate(116)) - Caught exception from allocate java.lang.RuntimeException: test unchecked exception at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:868) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:111) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:56,091 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615153818030_0006_000001 to scheduler from user: foobar 2021-03-07 22:50:56,091 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615153818030_0005_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:56,092 ERROR [RM Event dispatcher] scheduler.SLSFairScheduler (SLSFairScheduler.java:allocate(116)) - Caught exception from allocate java.lang.RuntimeException: test unchecked exception at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:868) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:111) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:56,093 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615153818030_0006_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:56,349 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:57,351 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:58,354 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:50:59,089 INFO [pool-7-thread-81] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 7 2021-03-07 22:50:59,089 INFO [pool-7-thread-81] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615153818030_0007 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:50:59,090 INFO [pool-7-thread-81] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 7 submitted by user foobar 2021-03-07 22:50:59,090 INFO [pool-7-thread-81] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615153818030_0007 QUEUENAME=root.sls_queue_1 2021-03-07 22:50:59,090 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615153818030_0007 2021-03-07 22:50:59,090 INFO [pool-7-thread-81] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615153818030_0007 2021-03-07 22:50:59,091 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0007 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:50:59,090 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615153818030_0007 2021-03-07 22:50:59,091 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0007 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:50:59,091 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615153818030_0007 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 5 2021-03-07 22:50:59,092 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0007 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:50:59,092 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615153818030_0007_000001 2021-03-07 22:50:59,092 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615153818030_0007_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:50:59,092 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615153818030_0007_000001 to scheduler from user: foobar 2021-03-07 22:50:59,093 ERROR [RM Event dispatcher] scheduler.SLSFairScheduler (SLSFairScheduler.java:allocate(116)) - Caught exception from allocate java.lang.RuntimeException: test unchecked exception at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:868) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:111) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:59,093 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615153818030_0007_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:50:59,355 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:00,356 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:01,360 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:02,087 INFO [pool-7-thread-57] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 8 2021-03-07 22:51:02,087 INFO [pool-7-thread-57] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615153818030_0008 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:51:02,087 INFO [pool-7-thread-57] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 8 submitted by user foobar 2021-03-07 22:51:02,088 INFO [pool-7-thread-57] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615153818030_0008 QUEUENAME=root.sls_queue_1 2021-03-07 22:51:02,088 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615153818030_0008 2021-03-07 22:51:02,088 INFO [pool-7-thread-57] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615153818030_0008 2021-03-07 22:51:02,088 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0008 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:51:02,088 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615153818030_0008 2021-03-07 22:51:02,089 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0008 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:51:02,089 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615153818030_0008 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 6 2021-03-07 22:51:02,089 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0008 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:51:02,089 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615153818030_0008_000001 2021-03-07 22:51:02,089 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615153818030_0008_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:51:02,089 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615153818030_0008_000001 to scheduler from user: foobar 2021-03-07 22:51:02,090 ERROR [RM Event dispatcher] scheduler.SLSFairScheduler (SLSFairScheduler.java:allocate(116)) - Caught exception from allocate java.lang.RuntimeException: test unchecked exception at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:868) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:111) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:51:02,090 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615153818030_0008_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:51:02,361 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:03,366 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:04,371 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:05,088 INFO [pool-7-thread-38] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 9 2021-03-07 22:51:05,089 INFO [pool-7-thread-38] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615153818030_0009 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:51:05,090 INFO [pool-7-thread-38] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 9 submitted by user foobar 2021-03-07 22:51:05,090 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615153818030_0009 2021-03-07 22:51:05,090 INFO [pool-7-thread-38] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615153818030_0009 QUEUENAME=root.sls_queue_1 2021-03-07 22:51:05,090 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615153818030_0009 2021-03-07 22:51:05,090 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0009 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:51:05,090 INFO [pool-7-thread-38] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615153818030_0009 2021-03-07 22:51:05,091 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0009 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:51:05,091 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615153818030_0009 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 7 2021-03-07 22:51:05,091 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0009 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:51:05,091 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615153818030_0009_000001 2021-03-07 22:51:05,091 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615153818030_0009_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:51:05,092 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615153818030_0009_000001 to scheduler from user: foobar 2021-03-07 22:51:05,092 ERROR [RM Event dispatcher] scheduler.SLSFairScheduler (SLSFairScheduler.java:allocate(116)) - Caught exception from allocate java.lang.RuntimeException: test unchecked exception at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:868) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:111) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:51:05,093 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615153818030_0009_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:51:05,374 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:06,379 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:07,380 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:08,382 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:09,384 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:10,388 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:11,388 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:12,393 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:13,394 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:14,087 INFO [pool-7-thread-7] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 10 2021-03-07 22:51:14,088 INFO [pool-7-thread-7] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615153818030_0010 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:51:14,088 INFO [pool-7-thread-7] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 10 submitted by user foobar 2021-03-07 22:51:14,088 INFO [pool-7-thread-7] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615153818030_0010 QUEUENAME=root.sls_queue_1 2021-03-07 22:51:14,089 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615153818030_0010 2021-03-07 22:51:14,089 INFO [pool-7-thread-7] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615153818030_0010 2021-03-07 22:51:14,089 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615153818030_0010 2021-03-07 22:51:14,089 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0010 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:51:14,089 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0010 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:51:14,089 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615153818030_0010 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 8 2021-03-07 22:51:14,090 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615153818030_0010 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:51:14,090 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615153818030_0010_000001 2021-03-07 22:51:14,090 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615153818030_0010_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:51:14,090 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615153818030_0010_000001 to scheduler from user: foobar 2021-03-07 22:51:14,091 ERROR [RM Event dispatcher] scheduler.SLSFairScheduler (SLSFairScheduler.java:allocate(116)) - Caught exception from allocate java.lang.RuntimeException: test unchecked exception at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:868) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:111) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:51:14,091 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615153818030_0010_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:51:14,395 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:15,400 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:16,403 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:17,403 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:18,405 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:19,405 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:20,407 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:21,411 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:22,416 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:23,420 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:24,421 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:25,421 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:26,423 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:27,428 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:28,431 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:29,436 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:30,437 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:31,437 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:32,438 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:33,439 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:34,440 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:35,440 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:36,441 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:37,444 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:38,445 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:39,450 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:40,455 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:41,458 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:51:42,337 ERROR [Thread[Thread-31,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(722)) - ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2021-03-07 22:51:42,352 INFO [main] handler.ContextHandler (ContextHandler.java:doStop(1154)) - Stopped o.e.j.w.WebAppContext@47ae75d4{cluster,/,null,STOPPED}{file:/Users/szilardnemeth/development/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/classes/webapps/cluster} 2021-03-07 22:51:42,363 INFO [main] server.AbstractConnector (AbstractConnector.java:doStop(381)) - Stopped ServerConnector@2121c076{HTTP/1.1, (http/1.1)}{localhost:18088} 2021-03-07 22:51:42,363 INFO [main] server.session (HouseKeeper.java:stopScavenging(149)) - node0 Stopped scavenging 2021-03-07 22:51:42,365 INFO [main] handler.ContextHandler (ContextHandler.java:doStop(1154)) - Stopped o.e.j.s.ServletContextHandler@1e627539{static,/static,file:///Users/szilardnemeth/development/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/classes/webapps/static/,STOPPED} 2021-03-07 22:51:42,365 INFO [main] handler.ContextHandler (ContextHandler.java:doStop(1154)) - Stopped o.e.j.s.ServletContextHandler@3476465f{logs,/logs,file:///Users/szilardnemeth/development/apache/hadoop/hadoop-tools/hadoop-sls/target/log,STOPPED} 2021-03-07 22:51:42,367 INFO [main] ipc.Server (Server.java:stop(3420)) - Stopping server on 18032 2021-03-07 22:51:42,373 INFO [IPC Server listener on 18032] ipc.Server (Server.java:run(1378)) - Stopping IPC Server listener on 18032 2021-03-07 22:51:42,374 INFO [IPC Server Responder] ipc.Server (Server.java:run(1514)) - Stopping IPC Server Responder 2021-03-07 22:51:42,377 INFO [main] ipc.Server (Server.java:stop(3420)) - Stopping server on 18033 2021-03-07 22:51:42,378 INFO [IPC Server listener on 18033] ipc.Server (Server.java:run(1378)) - Stopping IPC Server listener on 18033 2021-03-07 22:51:42,379 INFO [IPC Server Responder] ipc.Server (Server.java:run(1514)) - Stopping IPC Server Responder 2021-03-07 22:51:42,379 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:transitionToStandby(1368)) - Transitioning to standby state 2021-03-07 22:51:42,381 INFO [main] ipc.Server (Server.java:stop(3420)) - Stopping server on 18030 2021-03-07 22:51:42,383 INFO [IPC Server listener on 18030] ipc.Server (Server.java:run(1378)) - Stopping IPC Server listener on 18030 2021-03-07 22:51:42,383 INFO [IPC Server Responder] ipc.Server (Server.java:run(1514)) - Stopping IPC Server Responder 2021-03-07 22:51:42,387 INFO [main] ipc.Server (Server.java:stop(3420)) - Stopping server on 18031 2021-03-07 22:51:42,388 INFO [IPC Server listener on 18031] ipc.Server (Server.java:run(1378)) - Stopping IPC Server listener on 18031 2021-03-07 22:51:42,388 INFO [IPC Server Responder] ipc.Server (Server.java:run(1514)) - Stopping IPC Server Responder 2021-03-07 22:51:42,389 INFO [Ping Checker for NMLivelinessMonitor] util.AbstractLivelinessMonitor (AbstractLivelinessMonitor.java:run(157)) - NMLivelinessMonitor thread interrupted 2021-03-07 22:51:42,389 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher (EventDispatcher.java:run(66)) - Returning, interrupted : java.lang.InterruptedException 2021-03-07 22:51:42,390 INFO [main] scheduler.SchedulerMetrics (SchedulerMetrics.java:tearDown(543)) - Scheduler Metrics tears down 2021-03-07 22:51:42,391 INFO [main] server.AbstractConnector (AbstractConnector.java:doStop(381)) - Stopped ServerConnector@2f1df01c{HTTP/1.1, (http/1.1)}{0.0.0.0:10001} 2021-03-07 22:51:42,392 INFO [FSPreemptionThread] fair.FSPreemptionThread (FSPreemptionThread.java:run(88)) - Preemption thread interrupted! Exiting. 2021-03-07 22:51:42,392 INFO [AllocationFileReloader] fair.AllocationFileLoaderService (AllocationFileLoaderService.java:lambda$serviceInit$0(150)) - Interrupted while waiting to reload alloc configuration 2021-03-07 22:51:42,393 WARN [SchedulerUpdateThread] scheduler.AbstractYarnScheduler (AbstractYarnScheduler.java:run(1595)) - Scheduler UpdateThread interrupted. Exiting. 2021-03-07 22:51:42,393 INFO [main] monitor.SchedulingMonitor (SchedulingMonitor.java:serviceStop(91)) - Stop SchedulingMonitor (ReservationInvariantsChecker) 2021-03-07 22:51:42,394 INFO [main] monitor.SchedulingMonitorManager (SchedulingMonitorManager.java:silentlyStopSchedulingMonitor(144)) - Sucessfully stopped monitor=SchedulingMonitor (ReservationInvariantsChecker) 2021-03-07 22:51:42,394 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:serviceStop(182)) - AsyncDispatcher is draining to stop, ignoring any new events. 2021-03-07 22:51:42,395 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:serviceStop(182)) - AsyncDispatcher is draining to stop, ignoring any new events. 2021-03-07 22:51:42,396 INFO [Ping Checker for AMLivelinessMonitor] util.AbstractLivelinessMonitor (AbstractLivelinessMonitor.java:run(157)) - AMLivelinessMonitor thread interrupted 2021-03-07 22:51:42,396 INFO [Ping Checker for org.apache.hadoop.yarn.server.resourcemanager.rmapp.monitor.RMAppLifetimeMonitor] util.AbstractLivelinessMonitor (AbstractLivelinessMonitor.java:run(157)) - org.apache.hadoop.yarn.server.resourcemanager.rmapp.monitor.RMAppLifetimeMonitor thread interrupted 2021-03-07 22:51:42,396 ERROR [Thread[Thread-39,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(722)) - ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2021-03-07 22:51:42,396 INFO [Ping Checker for AMLivelinessMonitor] util.AbstractLivelinessMonitor (AbstractLivelinessMonitor.java:run(157)) - AMLivelinessMonitor thread interrupted 2021-03-07 22:51:42,396 INFO [Ping Checker for org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer] util.AbstractLivelinessMonitor (AbstractLivelinessMonitor.java:run(157)) - org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer thread interrupted 2021-03-07 22:51:42,397 INFO [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(210)) - Stopping ResourceManager metrics system... 2021-03-07 22:51:42,400 INFO [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(216)) - ResourceManager metrics system stopped. 2021-03-07 22:51:42,400 INFO [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:shutdown(611)) - ResourceManager metrics system shutdown complete. 2021-03-07 22:51:42,400 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:serviceStop(182)) - AsyncDispatcher is draining to stop, ignoring any new events. 2021-03-07 22:51:42,400 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:transitionToStandby(1375)) - Transitioned to standby state org.junit.runners.model.TestTimedOutException: test timed out after 120000 milliseconds at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.yarn.sls.BaseSLSRunnerTest.runSLS(BaseSLSRunnerTest.java:125) at org.apache.hadoop.yarn.sls.TestReservationSystemInvariants.testSimulatorRunning(TestReservationSystemInvariants.java:70) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748)