2021-03-07 22:19:41,236 INFO [Time-limited test] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2828)) - resource-types.xml not found 2021-03-07 22:19:41,244 INFO [Time-limited test] resource.ResourceUtils (ResourceUtils.java:addResourcesFileToConf(475)) - Unable to find 'resource-types.xml'. 2021-03-07 22:19:41,865 WARN [Time-limited test] util.NativeCodeLoader (NativeCodeLoader.java:(60)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2021-03-07 22:19:42,162 INFO [Time-limited test] resourcemanager.RMNMInfo (RMInfo.java:register(55)) - Registered RMInfo MBean 2021-03-07 22:19:42,210 INFO [Time-limited test] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2831)) - found resource core-site.xml at file:/Users/szilardnemeth/development/apache/hadoop/hadoop-common-project/hadoop-common/target/test-classes/core-site.xml 2021-03-07 22:19:42,291 INFO [Time-limited test] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2831)) - found resource yarn-site.xml at file:/Users/szilardnemeth/development/apache/hadoop/hadoop-tools/hadoop-sls/target/test-classes/yarn-site.xml 2021-03-07 22:19:42,298 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher 2021-03-07 22:19:42,499 INFO [Time-limited test] security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:(75)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms 2021-03-07 22:19:42,507 INFO [Time-limited test] security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:(81)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms 2021-03-07 22:19:42,518 INFO [Time-limited test] security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:(94)) - AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms 2021-03-07 22:19:42,606 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler 2021-03-07 22:19:42,613 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager 2021-03-07 22:19:42,613 INFO [Time-limited test] resourcemanager.ResourceManager (ResourceManager.java:createScheduler(462)) - Using Scheduler: org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler 2021-03-07 22:19:42,638 WARN [Time-limited test] conf.Configuration (Configuration.java:getBoolean(1696)) - Invalid value for boolean: ON, choose default value: true for yarn.sls.metrics.switch 2021-03-07 22:19:42,729 INFO [Time-limited test] util.log (Log.java:initialized(169)) - Logging initialized @2915ms to org.eclipse.jetty.util.log.Slf4jLog 2021-03-07 22:19:42,889 INFO [Time-limited test] server.Server (Server.java:doStart(375)) - jetty-9.4.35.v20201120; built: 2020-11-20T21:17:03.964Z; git: bdc54f03a5e0a7e280fab27f55c3c75ee8da89fb; jvm 1.8.0_151-b12 2021-03-07 22:19:42,945 INFO [Time-limited test] server.AbstractConnector (AbstractConnector.java:doStart(331)) - Started ServerConnector@7d1f1e50{HTTP/1.1, (http/1.1)}{0.0.0.0:10001} 2021-03-07 22:19:42,946 INFO [Time-limited test] server.Server (Server.java:doStart(415)) - Started @3133ms 2021-03-07 22:19:42,952 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.event.EventDispatcher 2021-03-07 22:19:42,953 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher 2021-03-07 22:19:42,955 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher 2021-03-07 22:19:42,957 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher 2021-03-07 22:19:43,055 INFO [Time-limited test] impl.MetricsConfig (MetricsConfig.java:loadFirst(120)) - Loaded properties from hadoop-metrics2.properties 2021-03-07 22:19:53,224 INFO [Time-limited test] impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(378)) - Scheduled Metric snapshot period at 10 second(s). 2021-03-07 22:19:53,225 INFO [Time-limited test] impl.MetricsSystemImpl (MetricsSystemImpl.java:start(191)) - ResourceManager metrics system started 2021-03-07 22:19:53,271 INFO [Time-limited test] resourcemanager.ResourceManager (ResourceManager.java:createReservationSystem(485)) - Using ReservationSystem: org.apache.hadoop.yarn.server.resourcemanager.reservation.FairReservationSystem 2021-03-07 22:19:53,274 INFO [Time-limited test] resourcemanager.ResourceManager (ResourceManager.java:serviceInit(816)) - Initialized Reservation system 2021-03-07 22:19:53,290 INFO [Time-limited test] security.YarnAuthorizationProvider (YarnAuthorizationProvider.java:getInstance(59)) - org.apache.hadoop.yarn.security.ConfiguredYarnAuthorizer is instantiated. 2021-03-07 22:19:53,295 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager 2021-03-07 22:19:53,306 INFO [Time-limited test] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.sls.resourcemanager.MockAMLauncher 2021-03-07 22:19:53,611 INFO [Time-limited test] resourcemanager.RMNMInfo (RMNMInfo.java:(66)) - Registered RMNMInfo MBean 2021-03-07 22:19:53,612 INFO [Time-limited test] monitor.RMAppLifetimeMonitor (RMAppLifetimeMonitor.java:serviceInit(67)) - Application lifelime monitor interval set to 3000 ms. 2021-03-07 22:19:53,620 INFO [Time-limited test] placement.MultiNodeSortingManager (MultiNodeSortingManager.java:serviceInit(63)) - Initializing NodeSortingService=MultiNodeSortingManager 2021-03-07 22:19:53,623 INFO [Time-limited test] util.HostsFileReader (HostsFileReader.java:refresh(239)) - Refreshing hosts (include/exclude) list 2021-03-07 22:19:53,624 INFO [Time-limited test] scheduler.AbstractYarnScheduler (AbstractYarnScheduler.java:getMinimumAllocation(1532)) - Minimum allocation = 2021-03-07 22:19:53,624 INFO [Time-limited test] scheduler.AbstractYarnScheduler (AbstractYarnScheduler.java:getMaximumAllocation(1544)) - Maximum allocation = 2021-03-07 22:19:53,663 INFO [Time-limited test] placement.PlacementFactory (PlacementFactory.java:getPlacementRule(69)) - Creating PlacementRule implementation: class org.apache.hadoop.yarn.server.resourcemanager.placement.SpecifiedPlacementRule 2021-03-07 22:19:53,663 INFO [Time-limited test] placement.PlacementFactory (PlacementFactory.java:getPlacementRule(69)) - Creating PlacementRule implementation: class org.apache.hadoop.yarn.server.resourcemanager.placement.UserPlacementRule 2021-03-07 22:19:53,775 INFO [Time-limited test] fair.AllocationFileLoaderService (AllocationFileLoaderService.java:reloadAllocations(236)) - Loading allocation file file:/Users/szilardnemeth/development/apache/hadoop/hadoop-tools/hadoop-sls/target/test-classes/fair-scheduler.xml 2021-03-07 22:19:53,858 INFO [Time-limited test] placement.PlacementFactory (PlacementFactory.java:getPlacementRule(69)) - Creating PlacementRule implementation: class org.apache.hadoop.yarn.server.resourcemanager.placement.SpecifiedPlacementRule 2021-03-07 22:19:53,858 INFO [Time-limited test] placement.PlacementFactory (PlacementFactory.java:getPlacementRule(69)) - Creating PlacementRule implementation: class org.apache.hadoop.yarn.server.resourcemanager.placement.UserPlacementRule 2021-03-07 22:19:53,878 INFO [Time-limited test] monitor.SchedulingMonitor (SchedulingMonitor.java:serviceInit(61)) - Initializing SchedulingMonitor=SchedulingMonitor (ReservationInvariantsChecker) 2021-03-07 22:19:53,879 INFO [Time-limited test] invariants.InvariantsChecker (InvariantsChecker.java:init(57)) - Invariant checker ReservationInvariantsChecker enabled. Monitoring every 1000ms, throwOnViolation=true 2021-03-07 22:19:53,883 INFO [Time-limited test] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2828)) - dynamic-resources.xml not found 2021-03-07 22:19:53,884 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:initialize(146)) - Initializing Reservation system 2021-03-07 22:19:53,885 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:getAdmissionPolicy(491)) - Using AdmissionPolicy: org.apache.hadoop.yarn.server.resourcemanager.reservation.CapacityOverTimePolicy for queue: root.sls_queue_1 2021-03-07 22:19:53,893 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:getAgent(467)) - Using Agent: org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.AlignedPlannerWithGreedy for queue: root.sls_queue_1 2021-03-07 22:19:53,905 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:getReplanner(444)) - Using Replanner: org.apache.hadoop.yarn.server.resourcemanager.reservation.planning.SimpleCapacityReplanner for queue: root.sls_queue_1 2021-03-07 22:19:53,907 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:initializePlan(435)) - Initialized plan In-memory Plan: Parent Queue: root.sls_queue_1 Total Capacity: Step: 1000 based on reservable queue root.sls_queue_1 2021-03-07 22:19:53,911 INFO [Time-limited test] reservation.AbstractReservationSystem (AbstractReservationSystem.java:createPlanFollower(261)) - Using PlanFollowerPolicy: org.apache.hadoop.yarn.server.resourcemanager.reservation.FairSchedulerPlanFollower 2021-03-07 22:19:53,911 INFO [Time-limited test] reservation.FairSchedulerPlanFollower (FairSchedulerPlanFollower.java:init(47)) - Initializing Plan Follower Policy:org.apache.hadoop.yarn.server.resourcemanager.reservation.FairSchedulerPlanFollower 2021-03-07 22:19:53,912 INFO [Time-limited test] resourcemanager.AMSProcessingChain (AMSProcessingChain.java:init(63)) - Initializing AMS Processing chain. Root Processor=[org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor]. 2021-03-07 22:19:53,912 INFO [Time-limited test] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:addPlacementConstraintHandler(133)) - disabled placement handler will be used, all scheduling requests will be rejected. 2021-03-07 22:19:53,914 INFO [Time-limited test] resourcemanager.AMSProcessingChain (AMSProcessingChain.java:addProcessor(76)) - Adding [org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint.processor.DisabledPlacementProcessor] tp top of AMS Processing chain. 2021-03-07 22:19:53,920 INFO [Time-limited test] resourcemanager.ResourceManager (ResourceManager.java:createSystemMetricsPublisher(599)) - TimelineServicePublisher is not configured 2021-03-07 22:20:14,278 INFO [Time-limited test] http.HttpRequestLog (HttpRequestLog.java:getRequestLog(82)) - Http request log for http.requests.resourcemanager is not defined 2021-03-07 22:20:14,282 INFO [Time-limited test] http.HttpServer2 (HttpServer2.java:addGlobalFilter(1059)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2021-03-07 22:20:14,286 INFO [Time-limited test] http.HttpServer2 (HttpServer2.java:addFilter(1032)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster 2021-03-07 22:20:14,286 INFO [Time-limited test] http.HttpServer2 (HttpServer2.java:addFilter(1042)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs 2021-03-07 22:20:14,286 INFO [Time-limited test] http.HttpServer2 (HttpServer2.java:addFilter(1042)) - Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static 2021-03-07 22:20:14,969 INFO [Time-limited test] webapp.WebApps (WebApps.java:build(428)) - Registered webapp guice modules 2021-03-07 22:20:14,971 INFO [Time-limited test] http.HttpServer2 (HttpServer2.java:bindListener(1280)) - Jetty bound to port 18088 2021-03-07 22:20:14,971 INFO [Time-limited test] server.Server (Server.java:doStart(375)) - jetty-9.4.35.v20201120; built: 2020-11-20T21:17:03.964Z; git: bdc54f03a5e0a7e280fab27f55c3c75ee8da89fb; jvm 1.8.0_151-b12 2021-03-07 22:20:14,981 INFO [Time-limited test] server.session (DefaultSessionIdManager.java:doStart(334)) - DefaultSessionIdManager workerName=node0 2021-03-07 22:20:14,981 INFO [Time-limited test] server.session (DefaultSessionIdManager.java:doStart(339)) - No SessionScavenger set, using defaults 2021-03-07 22:20:14,984 INFO [Time-limited test] server.session (HouseKeeper.java:startScavenging(132)) - node0 Scavenging every 600000ms 2021-03-07 22:20:15,034 INFO [Time-limited test] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(367)) - Updating the current master key for generating delegation tokens 2021-03-07 22:20:15,040 INFO [Thread[Thread-31,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(701)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s) 2021-03-07 22:20:15,041 INFO [Thread[Thread-31,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(367)) - Updating the current master key for generating delegation tokens 2021-03-07 22:20:15,094 INFO [Time-limited test] handler.ContextHandler (ContextHandler.java:doStart(916)) - Started o.e.j.s.ServletContextHandler@3a61acc5{logs,/logs,file:///Users/szilardnemeth/development/apache/hadoop/hadoop-tools/hadoop-sls/target/log,AVAILABLE} 2021-03-07 22:20:15,094 INFO [Time-limited test] handler.ContextHandler (ContextHandler.java:doStart(916)) - Started o.e.j.s.ServletContextHandler@753eb3d0{static,/static,file:///Users/szilardnemeth/development/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/classes/webapps/static/,AVAILABLE} Mar 07, 2021 10:20:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class Mar 07, 2021 10:20:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class Mar 07, 2021 10:20:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class Mar 07, 2021 10:20:15 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM' Mar 07, 2021 10:20:15 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" Mar 07, 2021 10:20:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" Mar 07, 2021 10:20:16 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2021-03-07 22:20:16,681 INFO [Time-limited test] handler.ContextHandler (ContextHandler.java:doStart(916)) - Started o.e.j.w.WebAppContext@4b5a0988{cluster,/,file:///Users/szilardnemeth/development/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/classes/webapps/cluster/,AVAILABLE}{file:/Users/szilardnemeth/development/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/classes/webapps/cluster} 2021-03-07 22:20:16,683 INFO [Time-limited test] server.AbstractConnector (AbstractConnector.java:doStart(331)) - Started ServerConnector@1a80f5fa{HTTP/1.1, (http/1.1)}{localhost:18088} 2021-03-07 22:20:16,684 INFO [Time-limited test] server.Server (Server.java:doStart(415)) - Started @36871ms 2021-03-07 22:20:16,684 INFO [Time-limited test] webapp.WebApps (WebApps.java:start(473)) - Web app cluster started at 18088 2021-03-07 22:20:16,786 INFO [Time-limited test] ipc.CallQueueManager (CallQueueManager.java:(93)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 100, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2021-03-07 22:20:16,814 INFO [Socket Reader #1 for port 18033] ipc.Server (Server.java:run(1267)) - Starting Socket Reader #1 for port 18033 2021-03-07 22:20:17,141 INFO [Listener at localhost/18033] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server 2021-03-07 22:20:17,142 INFO [IPC Server Responder] ipc.Server (Server.java:run(1509)) - IPC Server Responder: starting 2021-03-07 22:20:17,142 INFO [IPC Server listener on 18033] ipc.Server (Server.java:run(1346)) - IPC Server listener on 18033: starting 2021-03-07 22:20:17,143 INFO [Listener at localhost/18033] resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(1341)) - Transitioning to active state 2021-03-07 22:20:17,176 INFO [Listener at localhost/18033] recovery.RMStateStore (RMStateStore.java:transition(565)) - Updating AMRMToken 2021-03-07 22:20:17,176 INFO [Listener at localhost/18033] security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(109)) - Rolling master-key for container-tokens 2021-03-07 22:20:17,177 INFO [Listener at localhost/18033] security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(95)) - Rolling master-key for nm-tokens 2021-03-07 22:20:17,177 INFO [Listener at localhost/18033] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(367)) - Updating the current master key for generating delegation tokens 2021-03-07 22:20:17,177 INFO [Listener at localhost/18033] security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(92)) - storing master key with keyID 1 2021-03-07 22:20:17,177 INFO [Listener at localhost/18033] recovery.RMStateStore (RMStateStore.java:transition(516)) - Storing RMDTMasterKey. 2021-03-07 22:20:17,177 INFO [Thread[Thread-39,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(701)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s) 2021-03-07 22:20:17,177 INFO [Thread[Thread-39,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(367)) - Updating the current master key for generating delegation tokens 2021-03-07 22:20:17,178 INFO [Thread[Thread-39,5,FailOnTimeoutGroup]] security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(92)) - storing master key with keyID 2 2021-03-07 22:20:17,178 INFO [Thread[Thread-39,5,FailOnTimeoutGroup]] recovery.RMStateStore (RMStateStore.java:transition(516)) - Storing RMDTMasterKey. 2021-03-07 22:20:17,190 INFO [Listener at localhost/18033] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.nodelabels.event.NodeLabelsStoreEventType for class org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager$ForwardingEventHandler 2021-03-07 22:20:17,199 INFO [Listener at localhost/18033] store.AbstractFSNodeStore (AbstractFSNodeStore.java:initStore(72)) - Created store directory :file:/tmp/hadoop-yarn-szilardnemeth/node-attribute 2021-03-07 22:20:17,287 INFO [Listener at localhost/18033] store.AbstractFSNodeStore (AbstractFSNodeStore.java:recoverFromStore(187)) - Finished write mirror at:file:/tmp/hadoop-yarn-szilardnemeth/node-attribute/nodeattribute.mirror 2021-03-07 22:20:17,288 INFO [Listener at localhost/18033] store.AbstractFSNodeStore (AbstractFSNodeStore.java:recoverFromStore(188)) - Finished create editlog file at:file:/tmp/hadoop-yarn-szilardnemeth/node-attribute/nodeattribute.editlog 2021-03-07 22:20:17,290 INFO [Listener at localhost/18033] event.AsyncDispatcher (AsyncDispatcher.java:register(248)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.nodelabels.NodeAttributesStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.nodelabels.NodeAttributesManagerImpl$ForwardingEventHandler 2021-03-07 22:20:17,291 INFO [Listener at localhost/18033] placement.MultiNodeSortingManager (MultiNodeSortingManager.java:serviceStart(71)) - Starting NodeSortingService=MultiNodeSortingManager 2021-03-07 22:20:17,291 INFO [Listener at localhost/18033] monitor.SchedulingMonitor (SchedulingMonitor.java:serviceStart(69)) - Starting SchedulingMonitor=SchedulingMonitor (ReservationInvariantsChecker) 2021-03-07 22:20:17,338 INFO [Listener at localhost/18033] ipc.CallQueueManager (CallQueueManager.java:(93)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2021-03-07 22:20:17,339 INFO [Socket Reader #1 for port 18031] ipc.Server (Server.java:run(1267)) - Starting Socket Reader #1 for port 18031 2021-03-07 22:20:17,352 INFO [Listener at localhost/18031] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server 2021-03-07 22:20:17,352 INFO [IPC Server Responder] ipc.Server (Server.java:run(1509)) - IPC Server Responder: starting 2021-03-07 22:20:17,352 INFO [IPC Server listener on 18031] ipc.Server (Server.java:run(1346)) - IPC Server listener on 18031: starting 2021-03-07 22:20:17,371 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (0) does NOT match the number of reservationQueues (-1), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:20:17,375 INFO [org.apache.hadoop.util.JvmPauseMonitor$Monitor@536a6d6c] util.JvmPauseMonitor (JvmPauseMonitor.java:run(188)) - Starting JVM pause monitor 2021-03-07 22:20:17,415 INFO [Listener at localhost/18031] ipc.CallQueueManager (CallQueueManager.java:(93)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2021-03-07 22:20:17,426 INFO [Socket Reader #1 for port 18030] ipc.Server (Server.java:run(1267)) - Starting Socket Reader #1 for port 18030 2021-03-07 22:20:17,437 INFO [Listener at localhost/18030] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server 2021-03-07 22:20:17,437 INFO [IPC Server Responder] ipc.Server (Server.java:run(1509)) - IPC Server Responder: starting 2021-03-07 22:20:17,438 INFO [IPC Server listener on 18030] ipc.Server (Server.java:run(1346)) - IPC Server listener on 18030: starting 2021-03-07 22:20:17,709 INFO [Listener at localhost/18030] ipc.CallQueueManager (CallQueueManager.java:(93)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2021-03-07 22:20:17,710 INFO [Socket Reader #1 for port 18032] ipc.Server (Server.java:run(1267)) - Starting Socket Reader #1 for port 18032 2021-03-07 22:20:17,723 INFO [Listener at localhost/18032] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server 2021-03-07 22:20:17,724 INFO [IPC Server Responder] ipc.Server (Server.java:run(1509)) - IPC Server Responder: starting 2021-03-07 22:20:17,724 INFO [IPC Server listener on 18032] ipc.Server (Server.java:run(1346)) - IPC Server listener on 18032: starting 2021-03-07 22:20:18,297 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (0) does NOT match the number of reservationQueues (-1), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:20:18,387 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:18,523 INFO [Listener at localhost/18032] webproxy.ProxyCA (ProxyCA.java:createCert(183)) - Created Certificate for OU=YARN-485c2eaa-a8f9-4ecd-a08d-8ccae363d8ee 2021-03-07 22:20:18,561 INFO [Listener at localhost/18032] recovery.RMStateStore (RMStateStore.java:transition(647)) - Storing CA Certificate and Private Key 2021-03-07 22:20:18,561 INFO [Listener at localhost/18032] resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(1357)) - Transitioned to active state 2021-03-07 22:20:18,572 INFO [Listener at localhost/18032] synthetic.SynthTraceJobProducer (SynthTraceJobProducer.java:(82)) - SynthTraceJobProducer 2021-03-07 22:20:18,869 INFO [Listener at localhost/18032] synthetic.SynthTraceJobProducer (SynthTraceJobProducer.java:validateJobDef(184)) - Detected old JobDefinition format. Converting. 2021-03-07 22:20:18,900 INFO [Listener at localhost/18032] synthetic.SynthTraceJobProducer (SynthTraceJobProducer.java:(110)) - Generated 10 deadlines for 10 jobs 2021-03-07 22:20:19,389 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:19,585 INFO [pool-6-thread-12] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node7(cmPort: 10 httpPort: 80) registered with capability: , assigned nodeId node7:10 2021-03-07 22:20:19,585 INFO [pool-6-thread-5] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node6(cmPort: 1 httpPort: 80) registered with capability: , assigned nodeId node6:1 2021-03-07 22:20:19,585 INFO [pool-6-thread-15] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node5(cmPort: 14 httpPort: 80) registered with capability: , assigned nodeId node5:14 2021-03-07 22:20:19,585 INFO [pool-6-thread-20] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node9(cmPort: 19 httpPort: 80) registered with capability: , assigned nodeId node9:19 2021-03-07 22:20:19,586 INFO [pool-6-thread-7] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node2(cmPort: 4 httpPort: 80) registered with capability: , assigned nodeId node2:4 2021-03-07 22:20:19,586 INFO [pool-6-thread-14] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node4(cmPort: 12 httpPort: 80) registered with capability: , assigned nodeId node4:12 2021-03-07 22:20:19,586 INFO [pool-6-thread-1] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node12(cmPort: 0 httpPort: 80) registered with capability: , assigned nodeId node12:0 2021-03-07 22:20:19,585 INFO [pool-6-thread-17] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node11(cmPort: 16 httpPort: 80) registered with capability: , assigned nodeId node11:16 2021-03-07 22:20:19,587 INFO [pool-6-thread-6] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node13(cmPort: 3 httpPort: 80) registered with capability: , assigned nodeId node13:3 2021-03-07 22:20:19,585 INFO [pool-6-thread-13] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node10(cmPort: 11 httpPort: 80) registered with capability: , assigned nodeId node10:11 2021-03-07 22:20:19,585 INFO [pool-6-thread-3] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node17(cmPort: 6 httpPort: 80) registered with capability: , assigned nodeId node17:6 2021-03-07 22:20:19,587 INFO [pool-6-thread-18] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node19(cmPort: 17 httpPort: 80) registered with capability: , assigned nodeId node19:17 2021-03-07 22:20:19,587 INFO [pool-6-thread-4] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node3(cmPort: 2 httpPort: 80) registered with capability: , assigned nodeId node3:2 2021-03-07 22:20:19,586 INFO [pool-6-thread-16] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node15(cmPort: 15 httpPort: 80) registered with capability: , assigned nodeId node15:15 2021-03-07 22:20:19,586 INFO [pool-6-thread-11] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node16(cmPort: 9 httpPort: 80) registered with capability: , assigned nodeId node16:9 2021-03-07 22:20:19,585 INFO [pool-6-thread-10] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node14(cmPort: 8 httpPort: 80) registered with capability: , assigned nodeId node14:8 2021-03-07 22:20:19,585 INFO [pool-6-thread-2] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node18(cmPort: 7 httpPort: 80) registered with capability: , assigned nodeId node18:7 2021-03-07 22:20:19,585 INFO [pool-6-thread-9] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node8(cmPort: 13 httpPort: 80) registered with capability: , assigned nodeId node8:13 2021-03-07 22:20:19,585 INFO [pool-6-thread-8] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node1(cmPort: 5 httpPort: 80) registered with capability: , assigned nodeId node1:5 2021-03-07 22:20:19,585 INFO [pool-6-thread-19] resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(617)) - NodeManager from node node0(cmPort: 18 httpPort: 80) registered with capability: , assigned nodeId node0:18 2021-03-07 22:20:19,590 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node5:14 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,590 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node19:17 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,591 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node11:16 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,591 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node16:9 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,591 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node2:4 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,591 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node6:1 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,591 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node18:7 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,591 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node13:3 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,592 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node4:12 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,592 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node14:8 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,592 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node8:13 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,592 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node17:6 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,592 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node10:11 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,592 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node9:19 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,592 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node3:2 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,592 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node1:5 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,592 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node15:15 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,593 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node12:0 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,593 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node7:10 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,593 INFO [RM Event dispatcher] rmnode.RMNodeImpl (RMNodeImpl.java:handle(774)) - node0:18 Node Transitioned from NEW to RUNNING 2021-03-07 22:20:19,611 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node5:14 cluster capacity: 2021-03-07 22:20:19,613 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node19:17 cluster capacity: 2021-03-07 22:20:19,614 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node11:16 cluster capacity: 2021-03-07 22:20:19,615 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node16:9 cluster capacity: 2021-03-07 22:20:19,616 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node2:4 cluster capacity: 2021-03-07 22:20:19,617 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node6:1 cluster capacity: 2021-03-07 22:20:19,618 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node18:7 cluster capacity: 2021-03-07 22:20:19,619 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node13:3 cluster capacity: 2021-03-07 22:20:19,620 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node4:12 cluster capacity: 2021-03-07 22:20:19,621 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node14:8 cluster capacity: 2021-03-07 22:20:19,622 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node8:13 cluster capacity: 2021-03-07 22:20:19,623 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node17:6 cluster capacity: 2021-03-07 22:20:19,624 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node10:11 cluster capacity: 2021-03-07 22:20:19,625 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node9:19 cluster capacity: 2021-03-07 22:20:19,626 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node3:2 cluster capacity: 2021-03-07 22:20:19,626 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node1:5 cluster capacity: 2021-03-07 22:20:19,627 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node15:15 cluster capacity: 2021-03-07 22:20:19,628 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node12:0 cluster capacity: 2021-03-07 22:20:19,628 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node7:10 cluster capacity: 2021-03-07 22:20:19,629 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addNode(771)) - Added node node0:18 cluster capacity: 2021-03-07 22:20:19,651 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000000 submission:3000 deadline:533131 duration:53000 deadline-submission: 530131 2021-03-07 22:20:19,675 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 4 mapper and 3 reducers 2021-03-07 22:20:19,731 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000001 submission:3000 deadline:-1 duration:55000 deadline-submission: -3001 2021-03-07 22:20:19,733 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 4 mapper and 4 reducers 2021-03-07 22:20:19,734 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000002 submission:35000 deadline:594970 duration:56000 deadline-submission: 559970 2021-03-07 22:20:19,734 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 3 mapper and 4 reducers 2021-03-07 22:20:19,737 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000003 submission:38000 deadline:658076 duration:62000 deadline-submission: 620076 2021-03-07 22:20:19,738 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 5 mapper and 7 reducers 2021-03-07 22:20:19,740 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000004 submission:39000 deadline:-1 duration:57000 deadline-submission: -39001 2021-03-07 22:20:19,740 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 4 mapper and 3 reducers 2021-03-07 22:20:19,741 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000005 submission:39000 deadline:-1 duration:56000 deadline-submission: -39001 2021-03-07 22:20:19,741 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 5 mapper and 4 reducers 2021-03-07 22:20:19,742 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000006 submission:42000 deadline:-1 duration:62000 deadline-submission: -42001 2021-03-07 22:20:19,743 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 5 mapper and 5 reducers 2021-03-07 22:20:19,743 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000007 submission:45000 deadline:-1 duration:63000 deadline-submission: -45001 2021-03-07 22:20:19,744 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 5 mapper and 4 reducers 2021-03-07 22:20:19,745 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000008 submission:48000 deadline:-1 duration:61000 deadline-submission: -48001 2021-03-07 22:20:19,746 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 3 mapper and 4 reducers 2021-03-07 22:20:19,746 INFO [Listener at localhost/18032] synthetic.SynthJob (SynthJob.java:(178)) - JOB TIMING`: job: class_1_000009 submission:57000 deadline:-1 duration:57000 deadline-submission: -57001 2021-03-07 22:20:19,747 INFO [Listener at localhost/18032] appmaster.MRAMSimulator (MRAMSimulator.java:init(148)) - Added new job with 4 mapper and 6 reducers 2021-03-07 22:20:19,753 INFO [Listener at localhost/18032] sls.SLSRunner (SLSRunner.java:waitForNodesRunning(430)) - SLSRunner takes 6 ms to launch all nodes. 2021-03-07 22:20:19,778 INFO [pool-7-thread-2] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(91)) - placing the following ReservationRequest: {Arrival: 1615152019675, Deadline: 1615152552806, Reservation Name: reservation_0, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 4, Concurrency: 4, Lease Duration: 12}, {Capability: , # Containers: 3, Concurrency: 3, Lease Duration: 22}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:20:19,784 INFO [pool-7-thread-3] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 1 2021-03-07 22:20:19,857 INFO [pool-7-thread-2] recovery.RMStateStore (RMStateStore.java:transition(591)) - Storing reservation allocation.reservation_1615151993923_0000 2021-03-07 22:20:19,859 INFO [pool-7-thread-2] reservation.InMemoryPlan (InMemoryPlan.java:addReservation(373)) - Successfully added reservation: reservation_1615151993923_0000 to plan. 2021-03-07 22:20:19,859 INFO [pool-7-thread-2] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(98)) - OUTCOME: SUCCESS, Reservation ID: reservation_1615151993923_0000, Contract: {Arrival: 1615152019675, Deadline: 1615152552806, Reservation Name: reservation_0, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 4, Concurrency: 4, Lease Duration: 12}, {Capability: , # Containers: 3, Concurrency: 3, Lease Duration: 22}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:20:19,859 INFO [pool-7-thread-2] resourcemanager.ClientRMService (ClientRMService.java:refreshScheduler(1538)) - Created reservation reservation_1615151993923_0000 synchronously. 2021-03-07 22:20:19,865 INFO [pool-7-thread-2] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(381)) - USER=foobar OPERATION=Submit Reservation Request TARGET=ClientRMService: reservation_1615151993923_0000 RESULT=SUCCESS 2021-03-07 22:20:19,865 INFO [pool-7-thread-2] appmaster.AMSimulator (AMSimulator.java:run(196)) - RESERVATION SUCCESSFULLY SUBMITTED reservation_1615151993923_0000 2021-03-07 22:20:19,865 INFO [pool-7-thread-2] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 2 2021-03-07 22:20:19,868 INFO [pool-7-thread-3] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615152017145_0001 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:20:19,868 INFO [pool-7-thread-2] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615152017145_0002 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:20:19,952 INFO [pool-7-thread-2] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 2 submitted by user foobar 2021-03-07 22:20:19,952 INFO [pool-7-thread-2] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615152017145_0002 QUEUENAME=root.sls_queue_1 2021-03-07 22:20:19,952 INFO [pool-7-thread-3] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 1 submitted by user foobar 2021-03-07 22:20:19,953 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615152017145_0002 2021-03-07 22:20:19,953 INFO [pool-7-thread-3] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615152017145_0001 QUEUENAME=root.sls_queue_1 2021-03-07 22:20:19,959 INFO [pool-7-thread-3] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615152017145_0001 2021-03-07 22:20:19,959 INFO [pool-7-thread-2] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615152017145_0002 2021-03-07 22:20:19,966 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615152017145_0002 2021-03-07 22:20:19,966 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0002 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:20:19,967 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615152017145_0001 2021-03-07 22:20:19,967 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0001 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:20:19,967 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615152017145_0001 2021-03-07 22:20:19,969 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0002 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:20:19,969 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0001 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:20:19,969 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:rejectApplicationWithMessage(1393)) - Application application_1615152017145_0002 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615151993923_0000 2021-03-07 22:20:19,969 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(1293)) - Updating application application_1615152017145_0002 with final state: FAILED 2021-03-07 22:20:19,972 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0002 State change from SUBMITTED to FINAL_SAVING on event = APP_REJECTED 2021-03-07 22:20:19,972 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(279)) - Updating info for app: application_1615152017145_0002 2021-03-07 22:20:19,975 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615152017145_0001 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 1 2021-03-07 22:20:19,977 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0002 State change from FINAL_SAVING to FAILED on event = APP_UPDATE_SAVED 2021-03-07 22:20:19,977 WARN [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:removeApplication(636)) - Couldn't find application application_1615152017145_0002 2021-03-07 22:20:19,999 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0001 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:20:20,000 WARN [RM Event dispatcher] resourcemanager.RMAuditLogger (RMAuditLogger.java:logFailure(541)) - USER=foobar OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1615152017145_0002 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615151993923_0000 APPID=application_1615152017145_0002 2021-03-07 22:20:20,004 INFO [RM Event dispatcher] resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(255)) - appId=application_1615152017145_0002,name=N/A,user=foobar,queue=root.sls_queue_1,state=FAILED,trackingUrl=N/A,appMasterHost=N/A,submitTime=1615152019866,startTime=1615152019949,launchTime=0,finishTime=1615152019969,finalStatus=FAILED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds,applicationTags=,applicationNodeLabel=,diagnostics=Application application_1615152017145_0002 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615151993923_0000,totalAllocatedContainers=0 2021-03-07 22:20:20,050 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615152017145_0001_000001 2021-03-07 22:20:20,053 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615152017145_0001_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:20:20,112 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615152017145_0001_000001 to scheduler from user: foobar 2021-03-07 22:20:20,117 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615152017145_0001_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:20:20,299 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (1) does NOT match the number of reservationQueues (0), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:20:20,390 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:21,391 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:22,392 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:23,394 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:24,395 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:25,399 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:26,404 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:27,299 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (1) does NOT match the number of reservationQueues (0), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:20:27,405 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:28,406 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:29,407 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:30,408 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:31,409 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:32,413 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:33,414 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:34,415 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:35,415 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:36,417 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:37,419 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:38,420 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:39,421 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:40,422 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:41,425 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:42,426 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:43,427 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:44,428 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:45,433 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:46,438 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:47,444 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:48,447 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:49,447 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:50,448 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:51,451 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:51,768 INFO [pool-7-thread-1] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(91)) - placing the following ReservationRequest: {Arrival: 1615152051735, Deadline: 1615152614705, Reservation Name: reservation_2, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 3, Concurrency: 3, Lease Duration: 10}, {Capability: , # Containers: 4, Concurrency: 4, Lease Duration: 21}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:20:51,782 INFO [pool-7-thread-1] recovery.RMStateStore (RMStateStore.java:transition(591)) - Storing reservation allocation.reservation_1615151993923_0002 2021-03-07 22:20:51,783 INFO [pool-7-thread-1] reservation.InMemoryPlan (InMemoryPlan.java:addReservation(373)) - Successfully added reservation: reservation_1615151993923_0002 to plan. 2021-03-07 22:20:51,785 INFO [pool-7-thread-1] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(98)) - OUTCOME: SUCCESS, Reservation ID: reservation_1615151993923_0002, Contract: {Arrival: 1615152051735, Deadline: 1615152614705, Reservation Name: reservation_2, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 3, Concurrency: 3, Lease Duration: 10}, {Capability: , # Containers: 4, Concurrency: 4, Lease Duration: 21}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:20:51,785 INFO [pool-7-thread-1] resourcemanager.ClientRMService (ClientRMService.java:refreshScheduler(1538)) - Created reservation reservation_1615151993923_0002 synchronously. 2021-03-07 22:20:51,785 INFO [pool-7-thread-1] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(381)) - USER=foobar OPERATION=Submit Reservation Request TARGET=ClientRMService: reservation_1615151993923_0002 RESULT=SUCCESS 2021-03-07 22:20:51,785 INFO [pool-7-thread-1] appmaster.AMSimulator (AMSimulator.java:run(196)) - RESERVATION SUCCESSFULLY SUBMITTED reservation_1615151993923_0002 2021-03-07 22:20:51,785 INFO [pool-7-thread-1] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 3 2021-03-07 22:20:51,786 INFO [pool-7-thread-1] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615152017145_0003 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:20:51,786 INFO [pool-7-thread-1] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 3 submitted by user foobar 2021-03-07 22:20:51,786 INFO [pool-7-thread-1] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615152017145_0003 QUEUENAME=root.sls_queue_1 2021-03-07 22:20:51,786 INFO [pool-7-thread-1] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615152017145_0003 2021-03-07 22:20:51,788 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615152017145_0003 2021-03-07 22:20:51,789 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0003 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:20:51,789 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615152017145_0003 2021-03-07 22:20:51,790 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0003 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:20:51,790 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:rejectApplicationWithMessage(1393)) - Application application_1615152017145_0003 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615151993923_0002 2021-03-07 22:20:51,790 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(1293)) - Updating application application_1615152017145_0003 with final state: FAILED 2021-03-07 22:20:51,790 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(279)) - Updating info for app: application_1615152017145_0003 2021-03-07 22:20:51,790 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0003 State change from SUBMITTED to FINAL_SAVING on event = APP_REJECTED 2021-03-07 22:20:51,791 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0003 State change from FINAL_SAVING to FAILED on event = APP_UPDATE_SAVED 2021-03-07 22:20:51,791 WARN [RM Event dispatcher] resourcemanager.RMAuditLogger (RMAuditLogger.java:logFailure(541)) - USER=foobar OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1615152017145_0003 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615151993923_0002 APPID=application_1615152017145_0003 2021-03-07 22:20:51,791 WARN [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:removeApplication(636)) - Couldn't find application application_1615152017145_0003 2021-03-07 22:20:51,792 INFO [RM Event dispatcher] resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(255)) - appId=application_1615152017145_0003,name=N/A,user=foobar,queue=root.sls_queue_1,state=FAILED,trackingUrl=N/A,appMasterHost=N/A,submitTime=1615152051786,startTime=1615152051786,launchTime=0,finishTime=1615152051790,finalStatus=FAILED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds,applicationTags=,applicationNodeLabel=,diagnostics=Application application_1615152017145_0003 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615151993923_0002,totalAllocatedContainers=0 2021-03-07 22:20:52,298 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (2) does NOT match the number of reservationQueues (1), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:20:52,456 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:53,458 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:54,460 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:54,768 INFO [pool-7-thread-67] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(91)) - placing the following ReservationRequest: {Arrival: 1615152054739, Deadline: 1615152677815, Reservation Name: reservation_3, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 5, Concurrency: 5, Lease Duration: 11}, {Capability: , # Containers: 7, Concurrency: 7, Lease Duration: 27}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:20:54,775 INFO [pool-7-thread-67] recovery.RMStateStore (RMStateStore.java:transition(591)) - Storing reservation allocation.reservation_1615151993923_0003 2021-03-07 22:20:54,775 INFO [pool-7-thread-67] reservation.InMemoryPlan (InMemoryPlan.java:addReservation(373)) - Successfully added reservation: reservation_1615151993923_0003 to plan. 2021-03-07 22:20:54,775 INFO [pool-7-thread-67] planning.AlignedPlannerWithGreedy (AlignedPlannerWithGreedy.java:createReservation(98)) - OUTCOME: SUCCESS, Reservation ID: reservation_1615151993923_0003, Contract: {Arrival: 1615152054739, Deadline: 1615152677815, Reservation Name: reservation_3, Recurrence expression: 0, Priority: -1, Resources: {Reservation Resources: [{Capability: , # Containers: 5, Concurrency: 5, Lease Duration: 11}, {Capability: , # Containers: 7, Concurrency: 7, Lease Duration: 27}], Reservation Type: R_ORDER_NO_GAP}} 2021-03-07 22:20:54,775 INFO [pool-7-thread-67] resourcemanager.ClientRMService (ClientRMService.java:refreshScheduler(1538)) - Created reservation reservation_1615151993923_0003 synchronously. 2021-03-07 22:20:54,776 INFO [pool-7-thread-67] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(381)) - USER=foobar OPERATION=Submit Reservation Request TARGET=ClientRMService: reservation_1615151993923_0003 RESULT=SUCCESS 2021-03-07 22:20:54,776 INFO [pool-7-thread-67] appmaster.AMSimulator (AMSimulator.java:run(196)) - RESERVATION SUCCESSFULLY SUBMITTED reservation_1615151993923_0003 2021-03-07 22:20:54,776 INFO [pool-7-thread-67] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 4 2021-03-07 22:20:54,776 INFO [pool-7-thread-67] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615152017145_0004 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:20:54,777 INFO [pool-7-thread-67] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 4 submitted by user foobar 2021-03-07 22:20:54,777 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615152017145_0004 2021-03-07 22:20:54,777 INFO [pool-7-thread-67] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615152017145_0004 QUEUENAME=root.sls_queue_1 2021-03-07 22:20:54,778 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0004 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:20:54,778 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615152017145_0004 2021-03-07 22:20:54,778 INFO [pool-7-thread-67] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615152017145_0004 2021-03-07 22:20:54,778 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0004 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:20:54,778 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:rejectApplicationWithMessage(1393)) - Application application_1615152017145_0004 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615151993923_0003 2021-03-07 22:20:54,778 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(1293)) - Updating application application_1615152017145_0004 with final state: FAILED 2021-03-07 22:20:54,779 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(279)) - Updating info for app: application_1615152017145_0004 2021-03-07 22:20:54,779 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0004 State change from SUBMITTED to FINAL_SAVING on event = APP_REJECTED 2021-03-07 22:20:54,779 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0004 State change from FINAL_SAVING to FAILED on event = APP_UPDATE_SAVED 2021-03-07 22:20:54,779 WARN [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:removeApplication(636)) - Couldn't find application application_1615152017145_0004 2021-03-07 22:20:54,779 WARN [RM Event dispatcher] resourcemanager.RMAuditLogger (RMAuditLogger.java:logFailure(541)) - USER=foobar OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1615152017145_0004 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615151993923_0003 APPID=application_1615152017145_0004 2021-03-07 22:20:54,779 INFO [RM Event dispatcher] resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(255)) - appId=application_1615152017145_0004,name=N/A,user=foobar,queue=root.sls_queue_1,state=FAILED,trackingUrl=N/A,appMasterHost=N/A,submitTime=1615152054776,startTime=1615152054776,launchTime=0,finishTime=1615152054778,finalStatus=FAILED,memorySeconds=0,vcoreSeconds=0,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=YARN,resourceSeconds=0 MB-seconds\, 0 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds,applicationTags=,applicationNodeLabel=,diagnostics=Application application_1615152017145_0004 submitted to a reservation which is not yet currently active: root.sls_queue_1.reservation_1615151993923_0003,totalAllocatedContainers=0 2021-03-07 22:20:55,300 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (3) does NOT match the number of reservationQueues (2), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:20:55,462 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:55,769 INFO [pool-7-thread-92] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 6 2021-03-07 22:20:55,769 INFO [pool-7-thread-90] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 5 2021-03-07 22:20:55,770 INFO [pool-7-thread-90] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615152017145_0005 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:20:55,770 INFO [pool-7-thread-92] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615152017145_0006 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:20:55,771 INFO [pool-7-thread-90] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 5 submitted by user foobar 2021-03-07 22:20:55,771 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615152017145_0005 2021-03-07 22:20:55,771 INFO [pool-7-thread-92] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 6 submitted by user foobar 2021-03-07 22:20:55,772 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615152017145_0005 2021-03-07 22:20:55,771 INFO [pool-7-thread-90] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615152017145_0005 QUEUENAME=root.sls_queue_1 2021-03-07 22:20:55,772 INFO [pool-7-thread-92] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615152017145_0006 QUEUENAME=root.sls_queue_1 2021-03-07 22:20:55,772 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0005 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:20:55,772 INFO [pool-7-thread-92] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615152017145_0006 2021-03-07 22:20:55,772 INFO [pool-7-thread-90] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615152017145_0005 2021-03-07 22:20:55,773 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615152017145_0006 2021-03-07 22:20:55,773 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615152017145_0006 2021-03-07 22:20:55,773 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0006 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:20:55,773 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0005 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:20:55,773 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0006 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:20:55,774 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615152017145_0005 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 2 2021-03-07 22:20:55,774 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615152017145_0006 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 3 2021-03-07 22:20:55,775 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0005 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:20:55,775 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0006 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:20:55,776 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615152017145_0005_000001 2021-03-07 22:20:55,776 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615152017145_0005_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:20:55,776 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615152017145_0006_000001 2021-03-07 22:20:55,776 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615152017145_0006_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:20:55,776 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615152017145_0005_000001 to scheduler from user: foobar 2021-03-07 22:20:55,778 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615152017145_0006_000001 to scheduler from user: foobar 2021-03-07 22:20:55,778 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615152017145_0005_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:20:55,779 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615152017145_0006_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:20:56,464 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:57,299 ERROR [SchedulingMonitor (ReservationInvariantsChecker)] monitor.SchedulingMonitor (SchedulingMonitor.java:run(117)) - Exception raised while executing preemption checker, skip this run..., exception= org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantViolationException: Number of reservations (3) does NOT match the number of reservationQueues (0), while it should. at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.InvariantsChecker.logOrThrow(InvariantsChecker.java:74) at org.apache.hadoop.yarn.server.resourcemanager.monitor.invariants.ReservationInvariantsChecker.editSchedule(ReservationInvariantsChecker.java:51) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor.invokePolicy(SchedulingMonitor.java:100) at org.apache.hadoop.yarn.server.resourcemanager.monitor.SchedulingMonitor$PolicyInvoker.run(SchedulingMonitor.java:112) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:20:57,470 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:58,471 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:20:58,770 INFO [pool-7-thread-71] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 7 2021-03-07 22:20:58,771 INFO [pool-7-thread-71] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615152017145_0007 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:20:58,771 INFO [pool-7-thread-71] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 7 submitted by user foobar 2021-03-07 22:20:58,771 INFO [pool-7-thread-71] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615152017145_0007 QUEUENAME=root.sls_queue_1 2021-03-07 22:20:58,772 INFO [pool-7-thread-71] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615152017145_0007 2021-03-07 22:20:58,772 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615152017145_0007 2021-03-07 22:20:58,773 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615152017145_0007 2021-03-07 22:20:58,773 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0007 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:20:58,773 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0007 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:20:58,773 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615152017145_0007 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 4 2021-03-07 22:20:58,773 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0007 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:20:58,774 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615152017145_0007_000001 2021-03-07 22:20:58,774 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615152017145_0007_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:20:58,774 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615152017145_0007_000001 to scheduler from user: foobar 2021-03-07 22:20:58,775 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615152017145_0007_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:20:59,471 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:00,472 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:01,476 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:01,770 INFO [pool-7-thread-50] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 8 2021-03-07 22:21:01,771 INFO [pool-7-thread-50] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615152017145_0008 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:21:01,773 INFO [pool-7-thread-50] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 8 submitted by user foobar 2021-03-07 22:21:01,773 INFO [pool-7-thread-50] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615152017145_0008 QUEUENAME=root.sls_queue_1 2021-03-07 22:21:01,773 INFO [pool-7-thread-50] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615152017145_0008 2021-03-07 22:21:01,777 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615152017145_0008 2021-03-07 22:21:01,777 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0008 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:21:01,777 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615152017145_0008 2021-03-07 22:21:01,778 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0008 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:21:01,778 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615152017145_0008 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 5 2021-03-07 22:21:01,778 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0008 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:21:01,779 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615152017145_0008_000001 2021-03-07 22:21:01,779 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615152017145_0008_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:21:01,779 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615152017145_0008_000001 to scheduler from user: foobar 2021-03-07 22:21:01,781 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615152017145_0008_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:21:02,479 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:03,484 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:04,488 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:04,768 INFO [pool-7-thread-20] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 9 2021-03-07 22:21:04,768 INFO [pool-7-thread-20] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615152017145_0009 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:21:04,769 INFO [pool-7-thread-20] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 9 submitted by user foobar 2021-03-07 22:21:04,769 INFO [pool-7-thread-20] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615152017145_0009 QUEUENAME=root.sls_queue_1 2021-03-07 22:21:04,770 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615152017145_0009 2021-03-07 22:21:04,770 INFO [pool-7-thread-20] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615152017145_0009 2021-03-07 22:21:04,770 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0009 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:21:04,770 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615152017145_0009 2021-03-07 22:21:04,770 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0009 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:21:04,770 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615152017145_0009 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 6 2021-03-07 22:21:04,771 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0009 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:21:04,771 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615152017145_0009_000001 2021-03-07 22:21:04,771 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615152017145_0009_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:21:04,771 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615152017145_0009_000001 to scheduler from user: foobar 2021-03-07 22:21:04,772 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615152017145_0009_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:21:05,493 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:06,495 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:07,497 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:08,501 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:09,505 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:10,508 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:11,508 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:12,512 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:13,515 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:13,767 INFO [pool-7-thread-82] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(380)) - Allocated new applicationId: 10 2021-03-07 22:21:13,768 INFO [pool-7-thread-82] resourcemanager.RMAppManager (RMAppManager.java:copyPlacementQueueToSubmissionContext(998)) - Placed application with ID application_1615152017145_0010 in queue: root.sls_queue_1, original submission queue was: sls_queue_1 2021-03-07 22:21:13,768 INFO [pool-7-thread-82] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(699)) - Application with id 10 submitted by user foobar 2021-03-07 22:21:13,768 INFO [pool-7-thread-82] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(278)) - USER=foobar OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1615152017145_0010 QUEUENAME=root.sls_queue_1 2021-03-07 22:21:13,769 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:transition(1274)) - Storing application with id application_1615152017145_0010 2021-03-07 22:21:13,769 INFO [pool-7-thread-82] appmaster.AMSimulator (AMSimulator.java:submitApp(358)) - Submit a new application application_1615152017145_0010 2021-03-07 22:21:13,769 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0010 State change from NEW to NEW_SAVING on event = START 2021-03-07 22:21:13,769 INFO [RM StateStore dispatcher] recovery.RMStateStore (RMStateStore.java:transition(241)) - Storing info for app: application_1615152017145_0010 2021-03-07 22:21:13,769 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0010 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2021-03-07 22:21:13,769 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplication(561)) - Accepted application application_1615152017145_0010 from user: foobar, in queue: root.sls_queue_1.sls_queue_1-default, currently num of applications: 7 2021-03-07 22:21:13,769 INFO [RM Event dispatcher] rmapp.RMAppImpl (RMAppImpl.java:handle(906)) - application_1615152017145_0010 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2021-03-07 22:21:13,770 INFO [RM Event dispatcher] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(481)) - Registering app attempt : appattempt_1615152017145_0010_000001 2021-03-07 22:21:13,770 INFO [RM Event dispatcher] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(929)) - appattempt_1615152017145_0010_000001 State change from NEW to SUBMITTED on event = START 2021-03-07 22:21:13,770 INFO [SchedulerEventDispatcher:Event Processor] fair.FairScheduler (FairScheduler.java:addApplicationAttempt(615)) - Added Application Attempt appattempt_1615152017145_0010_000001 to scheduler from user: foobar 2021-03-07 22:21:13,771 ERROR [RM Event dispatcher] resourcemanager.ResourceManager (ResourceManager.java:handle(1102)) - Error in handling event type ATTEMPT_ADDED for applicationAttempt appattempt_1615152017145_0010_000001 java.lang.NullPointerException at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.updateQueueWithAllocateRequest(SLSFairScheduler.java:267) at org.apache.hadoop.yarn.sls.scheduler.SLSFairScheduler.allocate(SLSFairScheduler.java:123) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1162) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$ScheduleTransition.transition(RMAppAttemptImpl.java:1086) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:917) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1100) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1081) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:222) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:138) at java.lang.Thread.run(Thread.java:748) 2021-03-07 22:21:14,517 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:15,521 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:16,522 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:17,527 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:18,531 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:19,535 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:20,538 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:21,540 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:22,546 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:23,550 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:24,555 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:25,557 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:26,563 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:27,564 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:28,568 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:29,569 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:30,570 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:31,572 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:32,573 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:33,574 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:34,576 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:35,581 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:36,586 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:37,589 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:38,592 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:39,595 INFO [pool-5-thread-1] reservation.AbstractSchedulerPlanFollower (AbstractSchedulerPlanFollower.java:synchronizePlan(212)) - Finished iteration of plan follower edit policy for plan: root.sls_queue_1 2021-03-07 22:21:40,303 ERROR [Thread[Thread-31,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(722)) - ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2021-03-07 22:21:40,311 INFO [main] handler.ContextHandler (ContextHandler.java:doStop(1154)) - Stopped o.e.j.w.WebAppContext@4b5a0988{cluster,/,null,STOPPED}{file:/Users/szilardnemeth/development/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/classes/webapps/cluster} 2021-03-07 22:21:40,321 INFO [main] server.AbstractConnector (AbstractConnector.java:doStop(381)) - Stopped ServerConnector@1a80f5fa{HTTP/1.1, (http/1.1)}{localhost:18088} 2021-03-07 22:21:40,321 INFO [main] server.session (HouseKeeper.java:stopScavenging(149)) - node0 Stopped scavenging 2021-03-07 22:21:40,323 INFO [main] handler.ContextHandler (ContextHandler.java:doStop(1154)) - Stopped o.e.j.s.ServletContextHandler@753eb3d0{static,/static,file:///Users/szilardnemeth/development/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/target/classes/webapps/static/,STOPPED} 2021-03-07 22:21:40,323 INFO [main] handler.ContextHandler (ContextHandler.java:doStop(1154)) - Stopped o.e.j.s.ServletContextHandler@3a61acc5{logs,/logs,file:///Users/szilardnemeth/development/apache/hadoop/hadoop-tools/hadoop-sls/target/log,STOPPED} 2021-03-07 22:21:40,325 INFO [main] ipc.Server (Server.java:stop(3420)) - Stopping server on 18032 2021-03-07 22:21:40,330 INFO [IPC Server listener on 18032] ipc.Server (Server.java:run(1378)) - Stopping IPC Server listener on 18032 2021-03-07 22:21:40,331 INFO [IPC Server Responder] ipc.Server (Server.java:run(1514)) - Stopping IPC Server Responder 2021-03-07 22:21:40,336 INFO [main] ipc.Server (Server.java:stop(3420)) - Stopping server on 18033 2021-03-07 22:21:40,336 INFO [IPC Server listener on 18033] ipc.Server (Server.java:run(1378)) - Stopping IPC Server listener on 18033 2021-03-07 22:21:40,336 INFO [IPC Server Responder] ipc.Server (Server.java:run(1514)) - Stopping IPC Server Responder 2021-03-07 22:21:40,337 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:transitionToStandby(1368)) - Transitioning to standby state 2021-03-07 22:21:40,341 INFO [main] ipc.Server (Server.java:stop(3420)) - Stopping server on 18030 2021-03-07 22:21:40,344 INFO [IPC Server listener on 18030] ipc.Server (Server.java:run(1378)) - Stopping IPC Server listener on 18030 2021-03-07 22:21:40,344 INFO [IPC Server Responder] ipc.Server (Server.java:run(1514)) - Stopping IPC Server Responder 2021-03-07 22:21:40,347 INFO [main] ipc.Server (Server.java:stop(3420)) - Stopping server on 18031 2021-03-07 22:21:40,348 INFO [IPC Server listener on 18031] ipc.Server (Server.java:run(1378)) - Stopping IPC Server listener on 18031 2021-03-07 22:21:40,349 INFO [IPC Server Responder] ipc.Server (Server.java:run(1514)) - Stopping IPC Server Responder 2021-03-07 22:21:40,350 INFO [Ping Checker for NMLivelinessMonitor] util.AbstractLivelinessMonitor (AbstractLivelinessMonitor.java:run(157)) - NMLivelinessMonitor thread interrupted 2021-03-07 22:21:40,350 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher (EventDispatcher.java:run(66)) - Returning, interrupted : java.lang.InterruptedException 2021-03-07 22:21:40,350 INFO [main] scheduler.SchedulerMetrics (SchedulerMetrics.java:tearDown(543)) - Scheduler Metrics tears down 2021-03-07 22:21:40,354 INFO [main] server.AbstractConnector (AbstractConnector.java:doStop(381)) - Stopped ServerConnector@7d1f1e50{HTTP/1.1, (http/1.1)}{0.0.0.0:10001} 2021-03-07 22:21:40,356 INFO [FSPreemptionThread] fair.FSPreemptionThread (FSPreemptionThread.java:run(88)) - Preemption thread interrupted! Exiting. 2021-03-07 22:21:40,356 INFO [AllocationFileReloader] fair.AllocationFileLoaderService (AllocationFileLoaderService.java:lambda$serviceInit$0(150)) - Interrupted while waiting to reload alloc configuration 2021-03-07 22:21:40,356 WARN [SchedulerUpdateThread] scheduler.AbstractYarnScheduler (AbstractYarnScheduler.java:run(1595)) - Scheduler UpdateThread interrupted. Exiting. 2021-03-07 22:21:40,357 INFO [main] monitor.SchedulingMonitor (SchedulingMonitor.java:serviceStop(91)) - Stop SchedulingMonitor (ReservationInvariantsChecker) 2021-03-07 22:21:40,357 INFO [main] monitor.SchedulingMonitorManager (SchedulingMonitorManager.java:silentlyStopSchedulingMonitor(144)) - Sucessfully stopped monitor=SchedulingMonitor (ReservationInvariantsChecker) 2021-03-07 22:21:40,358 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:serviceStop(182)) - AsyncDispatcher is draining to stop, ignoring any new events. 2021-03-07 22:21:40,360 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:serviceStop(182)) - AsyncDispatcher is draining to stop, ignoring any new events. 2021-03-07 22:21:40,360 INFO [Ping Checker for org.apache.hadoop.yarn.server.resourcemanager.rmapp.monitor.RMAppLifetimeMonitor] util.AbstractLivelinessMonitor (AbstractLivelinessMonitor.java:run(157)) - org.apache.hadoop.yarn.server.resourcemanager.rmapp.monitor.RMAppLifetimeMonitor thread interrupted 2021-03-07 22:21:40,361 ERROR [Thread[Thread-39,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(722)) - ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2021-03-07 22:21:40,361 INFO [Ping Checker for AMLivelinessMonitor] util.AbstractLivelinessMonitor (AbstractLivelinessMonitor.java:run(157)) - AMLivelinessMonitor thread interrupted 2021-03-07 22:21:40,361 INFO [Ping Checker for AMLivelinessMonitor] util.AbstractLivelinessMonitor (AbstractLivelinessMonitor.java:run(157)) - AMLivelinessMonitor thread interrupted 2021-03-07 22:21:40,361 INFO [Ping Checker for org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer] util.AbstractLivelinessMonitor (AbstractLivelinessMonitor.java:run(157)) - org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer thread interrupted 2021-03-07 22:21:40,361 INFO [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(210)) - Stopping ResourceManager metrics system... 2021-03-07 22:21:40,364 INFO [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(216)) - ResourceManager metrics system stopped. 2021-03-07 22:21:40,365 INFO [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:shutdown(611)) - ResourceManager metrics system shutdown complete. 2021-03-07 22:21:40,365 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:serviceStop(182)) - AsyncDispatcher is draining to stop, ignoring any new events. 2021-03-07 22:21:40,365 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:transitionToStandby(1375)) - Transitioned to standby state org.junit.runners.model.TestTimedOutException: test timed out after 120000 milliseconds at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.yarn.sls.BaseSLSRunnerTest.runSLS(BaseSLSRunnerTest.java:125) at org.apache.hadoop.yarn.sls.TestReservationSystemInvariants.testSimulatorRunning(TestReservationSystemInvariants.java:70) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748)