2019-03-28 15:51:16,516 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting ResourceManager STARTUP_MSG: host = yarn-ats-1/172.26.81.91 STARTUP_MSG: args = [] STARTUP_MSG: version = 3.2.0 STARTUP_MSG: classpath = /HADOOP/hadoop-3.2.0/etc/hadoop/:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/accessors-smart-1.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/asm-5.0.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/avro-1.7.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-beanutils-1.9.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-cli-1.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-codec-1.11.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-collections-3.2.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-io-2.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-lang3-3.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-net-3.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-text-1.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/curator-client-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/curator-framework-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/curator-recipes-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/dnsjava-2.1.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/gson-2.2.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/guava-11.0.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/hadoop-annotations-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/hadoop-auth-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/httpclient-4.5.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/httpcore-4.4.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-annotations-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-core-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-databind-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jersey-core-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jersey-json-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jersey-server-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jersey-servlet-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jettison-1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-http-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-io-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-security-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-server-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-servlet-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-util-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-webapp-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-xml-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jsch-0.1.54.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/json-smart-2.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jsp-api-2.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jsr305-3.0.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-client-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-common-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-core-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-server-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-util-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerby-config-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerby-util-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/log4j-1.2.17.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/netty-3.10.5.Final.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/paranamer-2.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/re2j-1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/snappy-java-1.0.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/stax2-api-3.1.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/token-provider-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/xz-1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/zookeeper-3.4.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/metrics-core-3.2.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/hadoop-common-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/hadoop-common-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/hadoop-nfs-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/hadoop-kms-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-util-ajax-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/netty-all-4.0.52.Final.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/okio-1.6.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/hadoop-auth-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-codec-1.11.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/json-smart-2.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/asm-5.0.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/zookeeper-3.4.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/audience-annotations-0.5.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/curator-framework-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/curator-client-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-io-2.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-server-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-http-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-util-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-io-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-webapp-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-xml-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-servlet-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-security-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/hadoop-annotations-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-net-3.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jettison-1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-beanutils-1.9.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-lang3-3.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-text-1.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/avro-1.7.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/paranamer-2.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-compress-1.4.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/xz-1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/re2j-1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/gson-2.2.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jsch-0.1.54.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/curator-recipes-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-databind-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-annotations-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-core-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/dnsjava-2.1.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-nfs-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-client-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-client-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-rbf-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-rbf-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/lib/junit-4.11.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/fst-2.50.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/guice-4.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/jackson-jaxrs-base-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/java-util-1.9.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/javax.inject-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/jersey-client-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/json-io-2.5.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/objenesis-1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/snakeyaml-1.16.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-api-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-client-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-common-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-registry-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-common-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-router-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-services-api-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-services-core-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-submarine-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-common-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-coprocessor-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-client-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/commons-csv-1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/commons-lang-2.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/hbase-annotations-1.2.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/hbase-client-1.2.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/hbase-common-1.2.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/hbase-protocol-1.2.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/htrace-core-3.1.0-incubating.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/jcodings-1.0.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/joni-2.1.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/metrics-core-2.2.0.jar STARTUP_MSG: build = https://github.com/apache/hadoop.git -r e97acb3bd8f3befd27418996fa5d4b50bf2e17bf; compiled by 'sunilg' on 2019-01-08T06:08Z STARTUP_MSG: java = 1.8.0_201 ************************************************************/ 2019-03-28 15:51:16,527 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: registered UNIX signal handlers for [TERM, HUP, INT] 2019-03-28 15:51:16,771 INFO org.apache.hadoop.conf.Configuration: found resource core-site.xml at file:/HADOOP/hadoop-3.2.0/etc/hadoop/core-site.xml 2019-03-28 15:51:16,902 INFO org.apache.hadoop.conf.Configuration: resource-types.xml not found 2019-03-28 15:51:16,902 INFO org.apache.hadoop.yarn.util.resource.ResourceUtils: Unable to find 'resource-types.xml'. 2019-03-28 15:51:16,959 INFO org.apache.hadoop.conf.Configuration: found resource yarn-site.xml at file:/HADOOP/hadoop-3.2.0/etc/hadoop/yarn-site.xml 2019-03-28 15:51:17,070 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher 2019-03-28 15:51:17,134 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms 2019-03-28 15:51:17,142 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms 2019-03-28 15:51:17,148 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms 2019-03-28 15:51:17,209 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreFactory: Using RMStateStore implementation - class org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore 2019-03-28 15:51:17,212 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler 2019-03-28 15:51:17,212 INFO org.apache.hadoop.conf.Configuration.deprecation: yarn.resourcemanager.zk-timeout-ms is deprecated. Instead, use hadoop.zk.timeout-ms 2019-03-28 15:51:17,270 WARN org.apache.curator.CuratorZookeeperClient: session timeout [10000] is less than connection timeout [15000] 2019-03-28 15:51:17,301 INFO org.apache.curator.framework.imps.CuratorFrameworkImpl: Starting 2019-03-28 15:51:17,310 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03, built on 06/29/2018 00:39 GMT 2019-03-28 15:51:17,310 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=yarn-ats-1 2019-03-28 15:51:17,310 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.8.0_201 2019-03-28 15:51:17,310 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2019-03-28 15:51:17,310 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64/jre 2019-03-28 15:51:17,310 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=/HADOOP/hadoop-3.2.0/etc/hadoop/:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/accessors-smart-1.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/asm-5.0.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/avro-1.7.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-beanutils-1.9.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-cli-1.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-codec-1.11.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-collections-3.2.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-io-2.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-lang3-3.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-net-3.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/commons-text-1.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/curator-client-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/curator-framework-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/curator-recipes-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/dnsjava-2.1.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/gson-2.2.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/guava-11.0.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/hadoop-annotations-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/hadoop-auth-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/httpclient-4.5.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/httpcore-4.4.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-annotations-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-core-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-databind-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jersey-core-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jersey-json-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jersey-server-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jersey-servlet-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jettison-1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-http-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-io-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-security-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-server-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-servlet-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-util-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-webapp-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jetty-xml-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jsch-0.1.54.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/json-smart-2.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jsp-api-2.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jsr305-3.0.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-client-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-common-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-core-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-server-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerb-util-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerby-config-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerby-util-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/log4j-1.2.17.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/netty-3.10.5.Final.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/paranamer-2.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/re2j-1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/snappy-java-1.0.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/stax2-api-3.1.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/token-provider-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/xz-1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/zookeeper-3.4.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/lib/metrics-core-3.2.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/hadoop-common-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/hadoop-common-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/hadoop-nfs-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/common/hadoop-kms-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-util-ajax-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/netty-all-4.0.52.Final.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/okio-1.6.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/hadoop-auth-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-codec-1.11.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/json-smart-2.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/asm-5.0.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/zookeeper-3.4.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/audience-annotations-0.5.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/curator-framework-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/curator-client-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-io-2.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-server-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-http-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-util-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-io-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-webapp-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-xml-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-servlet-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jetty-security-9.3.24.v20180605.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/hadoop-annotations-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-net-3.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jettison-1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-beanutils-1.9.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-lang3-3.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-text-1.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/avro-1.7.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/paranamer-2.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/commons-compress-1.4.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/xz-1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/re2j-1.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/gson-2.2.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jsch-0.1.54.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/curator-recipes-2.12.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-databind-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-annotations-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/jackson-core-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/lib/dnsjava-2.1.7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-nfs-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-client-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-client-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-rbf-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-rbf-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/lib/junit-4.11.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.2.0-tests.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/fst-2.50.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/guice-4.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/jackson-jaxrs-base-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.9.5.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/java-util-1.9.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/javax.inject-1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/jersey-client-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/json-io-2.5.1.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/objenesis-1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/snakeyaml-1.16.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-api-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-client-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-common-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-registry-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-common-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-router-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-services-api-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-services-core-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-submarine-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-common-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-coprocessor-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-client-3.2.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/commons-csv-1.0.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/commons-lang-2.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/hbase-annotations-1.2.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/hbase-client-1.2.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/hbase-common-1.2.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/hbase-protocol-1.2.6.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/htrace-core-3.1.0-incubating.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/jcodings-1.0.13.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/joni-2.1.2.jar:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/timelineservice/lib/metrics-core-2.2.0.jar 2019-03-28 15:51:17,311 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=/HADOOP/hadoop-3.2.0/lib/native 2019-03-28 15:51:17,311 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 2019-03-28 15:51:17,311 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler= 2019-03-28 15:51:17,311 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Linux 2019-03-28 15:51:17,311 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=amd64 2019-03-28 15:51:17,311 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=3.10.0-514.el7.x86_64 2019-03-28 15:51:17,311 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=yarn 2019-03-28 15:51:17,311 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/home/yarn 2019-03-28 15:51:17,311 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/home/yarn 2019-03-28 15:51:17,312 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=yarn-ats-1:2181,yarn-ats-2:2181,yarn-ats-3:2181 sessionTimeout=10000 watcher=org.apache.curator.ConnectionState@48f278eb 2019-03-28 15:51:17,334 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server yarn-ats-2/172.26.81.92:2181. Will not attempt to authenticate using SASL (unknown error) 2019-03-28 15:51:17,334 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager 2019-03-28 15:51:17,335 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler 2019-03-28 15:51:17,343 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to yarn-ats-2/172.26.81.92:2181, initiating session 2019-03-28 15:51:17,356 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server yarn-ats-2/172.26.81.92:2181, sessionid = 0x200008f1b5700d6, negotiated timeout = 10000 2019-03-28 15:51:17,367 INFO org.apache.curator.framework.state.ConnectionStateManager: State change: CONNECTED 2019-03-28 15:51:17,374 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.event.EventDispatcher 2019-03-28 15:51:17,375 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher 2019-03-28 15:51:17,376 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher 2019-03-28 15:51:17,377 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher 2019-03-28 15:51:17,460 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: Loaded properties from hadoop-metrics2.properties 2019-03-28 15:51:17,563 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2019-03-28 15:51:17,563 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics system started 2019-03-28 15:51:17,579 INFO org.apache.hadoop.yarn.security.YarnAuthorizationProvider: org.apache.hadoop.yarn.security.ConfiguredYarnAuthorizer is instantiated. 2019-03-28 15:51:17,583 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager 2019-03-28 15:51:17,590 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher 2019-03-28 15:51:17,592 INFO org.apache.hadoop.yarn.server.resourcemanager.RMNMInfo: Registered RMNMInfo MBean 2019-03-28 15:51:17,592 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Using SystemServiceManager: org.apache.hadoop.yarn.service.client.SystemServiceManagerImpl 2019-03-28 15:51:17,594 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.monitor.RMAppLifetimeMonitor: Application lifelime monitor interval set to 3000 ms. 2019-03-28 15:51:17,599 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement.MultiNodeSortingManager: Initializing NodeSortingService=MultiNodeSortingManager 2019-03-28 15:51:17,601 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude) list 2019-03-28 15:51:17,607 INFO org.apache.hadoop.conf.Configuration: found resource capacity-scheduler.xml at file:/HADOOP/hadoop-3.2.0/etc/hadoop/capacity-scheduler.xml 2019-03-28 15:51:17,621 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Minimum allocation = 2019-03-28 15:51:17,621 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Maximum allocation = 2019-03-28 15:51:17,671 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: Accessible node labels for root queue will be ignored, it will be automatically set to "*". 2019-03-28 15:51:17,677 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root is undefined 2019-03-28 15:51:17,677 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root is undefined 2019-03-28 15:51:17,688 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: root, capacity=1.0, absoluteCapacity=1.0, maxCapacity=1.0, absoluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APP:yarn,ambari-qa,hbase ADMINISTER_QUEUE:yarn , labels=*, , reservationsContinueLooking=true, orderingPolicy=utilization, priority=0 2019-03-28 15:51:17,688 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Initialized parent-queue root name=root, fullname=root 2019-03-28 15:51:17,705 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root.default is undefined 2019-03-28 15:51:17,705 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root.default is undefined 2019-03-28 15:51:17,708 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Initializing default capacity = 0.5 [= (float) configuredCapacity / 100 ] absoluteCapacity = 0.5 [= parentAbsoluteCapacity * capacity ] maxCapacity = 1.0 [= configuredMaxCapacity ] absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] effectiveMinResource= , effectiveMaxResource= userLimit = 100 [= configuredUserLimit ] userLimitFactor = 1.0 [= configuredUserLimitFactor ] maxApplications = 5000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 5000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.2 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP:yarn,yarn-ats ADMINISTER_QUEUE:yarn [= configuredAcls ] nodeLocalityDelay = 40 rackLocalityAdditionalDelay = -1 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 priority = 0 maxLifetime = -1 seconds defaultLifetime = -1 seconds 2019-03-28 15:51:17,708 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized queue: default: capacity=0.5, absoluteCapacity=0.5, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2019-03-28 15:51:17,712 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root.batch is undefined 2019-03-28 15:51:17,712 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root.batch is undefined 2019-03-28 15:51:17,714 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Initializing batch capacity = 0.5 [= (float) configuredCapacity / 100 ] absoluteCapacity = 0.5 [= parentAbsoluteCapacity * capacity ] maxCapacity = 0.5 [= configuredMaxCapacity ] absoluteMaxCapacity = 0.5 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] effectiveMinResource= , effectiveMaxResource= userLimit = 100 [= configuredUserLimit ] userLimitFactor = 1.0 [= configuredUserLimitFactor ] maxApplications = 5000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 5000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.2 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP:*ADMINISTER_QUEUE:* [= configuredAcls ] nodeLocalityDelay = 40 rackLocalityAdditionalDelay = -1 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 priority = 0 maxLifetime = -1 seconds defaultLifetime = -1 seconds 2019-03-28 15:51:17,714 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized queue: batch: capacity=0.5, absoluteCapacity=0.5, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2019-03-28 15:51:17,714 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized queue: root: numChildQueue= 2, capacity=1.0, absoluteCapacity=1.0, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2019-03-28 15:51:17,716 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized root queue root: numChildQueue= 2, capacity=1.0, absoluteCapacity=1.0, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2019-03-28 15:51:17,716 INFO org.apache.hadoop.yarn.server.resourcemanager.placement.UserGroupMappingPlacementRule: Initialized queue mappings, override: false 2019-03-28 15:51:17,717 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement.MultiNodeSortingManager: MultiNode scheduling is 'false', and configured policies are 2019-03-28 15:51:17,717 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<>, maximumAllocation=<>, asynchronousScheduling=false, asyncScheduleInterval=5ms,multiNodePlacementEnabled=false 2019-03-28 15:51:17,720 INFO org.apache.hadoop.conf.Configuration: dynamic-resources.xml not found 2019-03-28 15:51:17,722 INFO org.apache.hadoop.yarn.server.resourcemanager.AMSProcessingChain: Initializing AMS Processing chain. Root Processor=[org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor]. 2019-03-28 15:51:17,722 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: disabled placement handler will be used, all scheduling requests will be rejected. 2019-03-28 15:51:17,723 INFO org.apache.hadoop.yarn.server.resourcemanager.AMSProcessingChain: Adding [org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint.processor.DisabledPlacementProcessor] tp top of AMS Processing chain. 2019-03-28 15:51:17,731 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: system metrics publisher with the timeline service V2 is configured 2019-03-28 15:51:17,738 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: Using TimelineWriter: org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl 2019-03-28 15:51:17,744 INFO org.apache.hadoop.yarn.server.timelineservice.storage.common.HBaseTimelineStorageUtils: Using hbase configuration at file:/HBASE/hbase-1.2.6/conf/hbase-site.xml 2019-03-28 15:51:17,843 INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x7a220c9a connecting to ZooKeeper ensemble=yarn-ats-1:2181,yarn-ats-2:2181,yarn-ats-3:2181 2019-03-28 15:51:17,843 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=yarn-ats-1:2181,yarn-ats-2:2181,yarn-ats-3:2181 sessionTimeout=180000 watcher=hconnection-0x7a220c9a0x0, quorum=yarn-ats-1:2181,yarn-ats-2:2181,yarn-ats-3:2181, baseZNode=/hbase 2019-03-28 15:51:17,844 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server yarn-ats-1/172.26.81.91:2181. Will not attempt to authenticate using SASL (unknown error) 2019-03-28 15:51:17,845 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to yarn-ats-1/172.26.81.91:2181, initiating session 2019-03-28 15:51:17,858 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server yarn-ats-1/172.26.81.91:2181, sessionid = 0x100008f6ce200ca, negotiated timeout = 40000 2019-03-28 15:51:18,677 INFO org.apache.hadoop.yarn.server.timelineservice.storage.common.HBaseTimelineStorageUtils: Using hbase configuration at file:/HBASE/hbase-1.2.6/conf/hbase-site.xml 2019-03-28 15:51:18,684 INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x35038141 connecting to ZooKeeper ensemble=yarn-ats-1:2181,yarn-ats-2:2181,yarn-ats-3:2181 2019-03-28 15:51:18,684 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=yarn-ats-1:2181,yarn-ats-2:2181,yarn-ats-3:2181 sessionTimeout=180000 watcher=hconnection-0x350381410x0, quorum=yarn-ats-1:2181,yarn-ats-2:2181,yarn-ats-3:2181, baseZNode=/hbase 2019-03-28 15:51:18,697 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server yarn-ats-3/172.26.81.95:2181. Will not attempt to authenticate using SASL (unknown error) 2019-03-28 15:51:18,699 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to yarn-ats-3/172.26.81.95:2181, initiating session 2019-03-28 15:51:18,707 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server yarn-ats-3/172.26.81.95:2181, sessionid = 0x300008f1b7800dc, negotiated timeout = 40000 2019-03-28 15:51:18,711 INFO org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl: Initialized HBaseTimelineWriterImpl UGI to yarn (auth:SIMPLE) 2019-03-28 15:51:18,715 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher$SystemMetricsEventType for class org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler 2019-03-28 15:51:18,715 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher$SystemMetricsEventType for class org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler 2019-03-28 15:51:18,715 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher$SystemMetricsEventType for class org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler 2019-03-28 15:51:18,715 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher$SystemMetricsEventType for class org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler 2019-03-28 15:51:18,716 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher$SystemMetricsEventType for class org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler 2019-03-28 15:51:18,716 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher$SystemMetricsEventType for class org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler 2019-03-28 15:51:18,716 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher$SystemMetricsEventType for class org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler 2019-03-28 15:51:18,716 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher$SystemMetricsEventType for class org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler 2019-03-28 15:51:18,716 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher$SystemMetricsEventType for class org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler 2019-03-28 15:51:18,716 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher$SystemMetricsEventType for class org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler 2019-03-28 15:51:18,774 INFO org.eclipse.jetty.util.log: Logging initialized @2796ms 2019-03-28 15:51:18,836 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Using webapps at: file:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/webapps/ui2 2019-03-28 15:51:18,880 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2019-03-28 15:51:18,883 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.resourcemanager is not defined 2019-03-28 15:51:18,888 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2019-03-28 15:51:18,892 INFO org.apache.hadoop.http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster 2019-03-28 15:51:18,892 INFO org.apache.hadoop.http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static 2019-03-28 15:51:18,893 INFO org.apache.hadoop.http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs 2019-03-28 15:51:18,893 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster 2019-03-28 15:51:18,893 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2019-03-28 15:51:18,893 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2019-03-28 15:51:18,895 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /cluster/* 2019-03-28 15:51:18,896 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* 2019-03-28 15:51:18,896 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /app/* 2019-03-28 15:51:19,329 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules 2019-03-28 15:51:19,335 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8088 2019-03-28 15:51:19,336 INFO org.eclipse.jetty.server.Server: jetty-9.3.24.v20180605, build timestamp: 2018-06-05T17:11:56Z, git hash: 84205aa28f11a4f31f2a3b86d1bba2cc8ab69827 2019-03-28 15:51:19,386 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2019-03-28 15:51:19,393 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-03-28 15:51:19,395 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s) 2019-03-28 15:51:19,395 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-03-28 15:51:19,419 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@6134ac4a{/logs,file:///HADOOP/hadoop-3.2.0/logs/,AVAILABLE} 2019-03-28 15:51:19,420 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@3773862a{/static,jar:file:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-common-3.2.0.jar!/webapps/static,AVAILABLE} 2019-03-28 15:51:20,614 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@7c781c42{/,file:///tmp/jetty-yarn-ats-1-8088-cluster-_-any-1911467818268560630.dir/webapp/,AVAILABLE}{/cluster} 2019-03-28 15:51:20,687 INFO org.eclipse.jetty.webapp.StandardDescriptorProcessor: NO JSP Support for /ui2, did not find org.eclipse.jetty.jsp.JettyJspServlet 2019-03-28 15:51:20,693 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@257ef9ed{/ui2,file:///HADOOP/hadoop-3.2.0/share/hadoop/yarn/webapps/ui2/,AVAILABLE} 2019-03-28 15:51:20,699 INFO org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@625a9c5d{HTTP/1.1,[http/1.1]}{yarn-ats-1:8088} 2019-03-28 15:51:20,699 INFO org.eclipse.jetty.server.Server: Started @4722ms 2019-03-28 15:51:20,699 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app cluster started at 8088 2019-03-28 15:51:20,746 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 100, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-03-28 15:51:20,755 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8141 2019-03-28 15:51:20,922 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server 2019-03-28 15:51:20,922 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-03-28 15:51:20,923 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8141: starting 2019-03-28 15:51:20,928 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioning to active state 2019-03-28 15:51:20,986 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Recovery started 2019-03-28 15:51:20,994 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Loaded RM state version info 1.5 2019-03-28 15:51:21,499 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: recovering RMDelegationTokenSecretManager. 2019-03-28 15:51:21,504 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager: Recovering 86 applications 2019-03-28 15:51:21,590 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,594 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0001 was added 2019-03-28 15:51:21,669 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,670 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0002 was added 2019-03-28 15:51:21,672 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 3 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,672 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0003 was added 2019-03-28 15:51:21,678 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1551967319073_0001 failed 2 times due to AM Container for appattempt_1551967319073_0001_000002 exited with exitCode: 1 Failing this attempt.Diagnostics: [2019-03-07 14:09:04.807]Exception from container-launch. Container id: container_1551967319073_0001_02_000001 Exit code: 1 [2019-03-07 14:09:04.846]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. [2019-03-07 14:09:04.847]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. For more detailed output, check the application tracking page: http://yarn-ats-1:8088/cluster/app/application_1551967319073_0001 Then click on links to logs of each attempt. . Failing the application. APPID=application_1551967319073_0001 2019-03-28 15:51:21,682 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0001,name=word count,user=ambari-qa,queue=default,state=FAILED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0001/,appMasterHost=N/A,submitTime=1551967736482,startTime=1551967736548,finishTime=1551967744883,finalStatus=FAILED,memorySeconds=15578,vcoreSeconds=6,preemptedMemorySeconds=15578,preemptedVcoreSeconds=6,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=15578 MB-seconds\, 6 vcore-seconds,preemptedResourceSeconds=15578 MB-seconds\, 6 vcore-seconds 2019-03-28 15:51:21,683 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1551967319073_0002 failed 2 times due to AM Container for appattempt_1551967319073_0002_000002 exited with exitCode: 1 Failing this attempt.Diagnostics: [2019-03-07 14:22:52.539]Exception from container-launch. Container id: container_1551967319073_0002_02_000001 Exit code: 1 [2019-03-07 14:22:52.591]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. [2019-03-07 14:22:52.593]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. For more detailed output, check the application tracking page: http://yarn-ats-1:8088/cluster/app/application_1551967319073_0002 Then click on links to logs of each attempt. . Failing the application. APPID=application_1551967319073_0002 2019-03-28 15:51:21,684 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0002,name=word count,user=ambari-qa,queue=default,state=FAILED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0002/,appMasterHost=N/A,submitTime=1551968564177,startTime=1551968564178,finishTime=1551968572666,finalStatus=FAILED,memorySeconds=15015,vcoreSeconds=6,preemptedMemorySeconds=15015,preemptedVcoreSeconds=6,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=15015 MB-seconds\, 6 vcore-seconds,preemptedResourceSeconds=15015 MB-seconds\, 6 vcore-seconds 2019-03-28 15:51:21,684 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 4 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,685 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0003 2019-03-28 15:51:21,686 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0004 was added 2019-03-28 15:51:21,687 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0003,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0003/,appMasterHost=N/A,submitTime=1551968687599,startTime=1551968687600,finishTime=1551968704265,finalStatus=SUCCEEDED,memorySeconds=46602,vcoreSeconds=24,preemptedMemorySeconds=46602,preemptedVcoreSeconds=24,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=46602 MB-seconds\, 24 vcore-seconds,preemptedResourceSeconds=46602 MB-seconds\, 24 vcore-seconds 2019-03-28 15:51:21,688 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0004 2019-03-28 15:51:21,689 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0004,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0004/,appMasterHost=N/A,submitTime=1551969305459,startTime=1551969305460,finishTime=1551969320923,finalStatus=SUCCEEDED,memorySeconds=42869,vcoreSeconds=22,preemptedMemorySeconds=42869,preemptedVcoreSeconds=22,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=42869 MB-seconds\, 22 vcore-seconds,preemptedResourceSeconds=42869 MB-seconds\, 22 vcore-seconds 2019-03-28 15:51:21,689 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 5 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,692 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0005 was added 2019-03-28 15:51:21,696 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0005 2019-03-28 15:51:21,698 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 6 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,699 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0005,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0005/,appMasterHost=N/A,submitTime=1551969462773,startTime=1551969462774,finishTime=1551969479157,finalStatus=SUCCEEDED,memorySeconds=45943,vcoreSeconds=23,preemptedMemorySeconds=45943,preemptedVcoreSeconds=23,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=45943 MB-seconds\, 23 vcore-seconds,preemptedResourceSeconds=45943 MB-seconds\, 23 vcore-seconds 2019-03-28 15:51:21,700 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0006 was added 2019-03-28 15:51:21,704 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0006 2019-03-28 15:51:21,709 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0006,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0006/,appMasterHost=N/A,submitTime=1551969772281,startTime=1551969772282,finishTime=1551969789085,finalStatus=SUCCEEDED,memorySeconds=46480,vcoreSeconds=23,preemptedMemorySeconds=46480,preemptedVcoreSeconds=23,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=46480 MB-seconds\, 23 vcore-seconds,preemptedResourceSeconds=46480 MB-seconds\, 23 vcore-seconds 2019-03-28 15:51:21,710 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 7 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,710 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0007 was added 2019-03-28 15:51:21,715 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1551967319073_0007 failed 2 times due to AM Container for appattempt_1551967319073_0007_000002 exited with exitCode: 1 Failing this attempt.Diagnostics: [2019-03-09 09:05:26.686]Exception from container-launch. Container id: container_1551967319073_0007_02_000001 Exit code: 1 [2019-03-09 09:05:26.692]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster Please check whether your etc/hadoop/mapred-site.xml contains the below configuration: yarn.app.mapreduce.am.env HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory} mapreduce.map.env HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory} mapreduce.reduce.env HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory} [2019-03-09 09:05:26.694]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster Please check whether your etc/hadoop/mapred-site.xml contains the below configuration: yarn.app.mapreduce.am.env HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory} mapreduce.map.env HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory} mapreduce.reduce.env HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory} For more detailed output, check the application tracking page: http://yarn-ats-1:8088/cluster/app/application_1551967319073_0007 Then click on links to logs of each attempt. . Failing the application. APPID=application_1551967319073_0007 2019-03-28 15:51:21,716 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 8 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,716 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0007,name=word count,user=ambari-qa,queue=default,state=FAILED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0007/,appMasterHost=N/A,submitTime=1552122324375,startTime=1552122324378,finishTime=1552122326759,finalStatus=FAILED,memorySeconds=3386,vcoreSeconds=0,preemptedMemorySeconds=3386,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=3386 MB-seconds\, 0 vcore-seconds,preemptedResourceSeconds=3386 MB-seconds\, 0 vcore-seconds 2019-03-28 15:51:21,717 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0008 was added 2019-03-28 15:51:21,719 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0008 2019-03-28 15:51:21,720 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 9 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,721 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0009 was added 2019-03-28 15:51:21,724 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 10 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,724 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0010 was added 2019-03-28 15:51:21,725 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0008,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0008/,appMasterHost=N/A,submitTime=1552130855201,startTime=1552130855204,finishTime=1552130872677,finalStatus=SUCCEEDED,memorySeconds=48814,vcoreSeconds=25,preemptedMemorySeconds=48814,preemptedVcoreSeconds=25,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=48814 MB-seconds\, 25 vcore-seconds,preemptedResourceSeconds=48814 MB-seconds\, 25 vcore-seconds 2019-03-28 15:51:21,725 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0009 2019-03-28 15:51:21,726 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0009,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0009/,appMasterHost=N/A,submitTime=1552130919656,startTime=1552130919659,finishTime=1552130937289,finalStatus=SUCCEEDED,memorySeconds=49671,vcoreSeconds=26,preemptedMemorySeconds=49671,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=49671 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=49671 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,728 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 11 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,729 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0010 2019-03-28 15:51:21,730 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0010,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0010/,appMasterHost=N/A,submitTime=1552131141740,startTime=1552131141743,finishTime=1552131158744,finalStatus=SUCCEEDED,memorySeconds=46849,vcoreSeconds=23,preemptedMemorySeconds=46849,preemptedVcoreSeconds=23,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=46849 MB-seconds\, 23 vcore-seconds,preemptedResourceSeconds=46849 MB-seconds\, 23 vcore-seconds 2019-03-28 15:51:21,730 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0011 was added 2019-03-28 15:51:21,733 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 12 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,733 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0012 was added 2019-03-28 15:51:21,735 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 13 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,736 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0013 was added 2019-03-28 15:51:21,738 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0011 2019-03-28 15:51:21,740 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 14 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,741 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0014 was added 2019-03-28 15:51:21,743 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 15 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,744 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1551967319073_0015 was added 2019-03-28 15:51:21,747 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,747 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552297011473_0001 was added 2019-03-28 15:51:21,750 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,750 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552297011473_0002 was added 2019-03-28 15:51:21,751 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0011,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0011/,appMasterHost=N/A,submitTime=1552131175684,startTime=1552131175686,finishTime=1552131193973,finalStatus=SUCCEEDED,memorySeconds=50312,vcoreSeconds=25,preemptedMemorySeconds=50312,preemptedVcoreSeconds=25,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50312 MB-seconds\, 25 vcore-seconds,preemptedResourceSeconds=50312 MB-seconds\, 25 vcore-seconds 2019-03-28 15:51:21,752 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0012 2019-03-28 15:51:21,753 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0012,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0012/,appMasterHost=N/A,submitTime=1552131496854,startTime=1552131496857,finishTime=1552131513784,finalStatus=SUCCEEDED,memorySeconds=48054,vcoreSeconds=24,preemptedMemorySeconds=48054,preemptedVcoreSeconds=24,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=48054 MB-seconds\, 24 vcore-seconds,preemptedResourceSeconds=48054 MB-seconds\, 24 vcore-seconds 2019-03-28 15:51:21,752 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,753 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0013 2019-03-28 15:51:21,754 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552482065227_0001 was added 2019-03-28 15:51:21,754 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0013,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0013/,appMasterHost=N/A,submitTime=1552132130089,startTime=1552132130093,finishTime=1552132147005,finalStatus=SUCCEEDED,memorySeconds=47440,vcoreSeconds=24,preemptedMemorySeconds=47440,preemptedVcoreSeconds=24,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=47440 MB-seconds\, 24 vcore-seconds,preemptedResourceSeconds=47440 MB-seconds\, 24 vcore-seconds 2019-03-28 15:51:21,755 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0014 2019-03-28 15:51:21,755 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0014,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0014/,appMasterHost=N/A,submitTime=1552132185292,startTime=1552132185294,finishTime=1552132202721,finalStatus=SUCCEEDED,memorySeconds=49472,vcoreSeconds=26,preemptedMemorySeconds=49472,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=49472 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=49472 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,756 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1551967319073_0015 2019-03-28 15:51:21,756 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1551967319073_0015,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1551967319073_0015/,appMasterHost=N/A,submitTime=1552288393350,startTime=1552288393353,finishTime=1552288521979,finalStatus=SUCCEEDED,memorySeconds=278517,vcoreSeconds=138,preemptedMemorySeconds=278517,preemptedVcoreSeconds=138,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=278517 MB-seconds\, 138 vcore-seconds,preemptedResourceSeconds=278517 MB-seconds\, 138 vcore-seconds 2019-03-28 15:51:21,756 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552297011473_0001 2019-03-28 15:51:21,757 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552297011473_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552297011473_0001/,appMasterHost=N/A,submitTime=1552297060008,startTime=1552297060013,finishTime=1552297081092,finalStatus=SUCCEEDED,memorySeconds=55402,vcoreSeconds=28,preemptedMemorySeconds=55402,preemptedVcoreSeconds=28,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=55402 MB-seconds\, 28 vcore-seconds,preemptedResourceSeconds=55402 MB-seconds\, 28 vcore-seconds 2019-03-28 15:51:21,757 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552297011473_0002 2019-03-28 15:51:21,758 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552297011473_0002,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552297011473_0002/,appMasterHost=N/A,submitTime=1552382915134,startTime=1552382915137,finishTime=1552382933788,finalStatus=SUCCEEDED,memorySeconds=50211,vcoreSeconds=26,preemptedMemorySeconds=50211,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50211 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=50211 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,767 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,768 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552482065227_0001 2019-03-28 15:51:21,769 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552482065227_0002 was added 2019-03-28 15:51:21,769 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552482065227_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552482065227_0001/,appMasterHost=N/A,submitTime=1552487827153,startTime=1552487827155,finishTime=1552487848229,finalStatus=SUCCEEDED,memorySeconds=55478,vcoreSeconds=28,preemptedMemorySeconds=55478,preemptedVcoreSeconds=28,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=55478 MB-seconds\, 28 vcore-seconds,preemptedResourceSeconds=55478 MB-seconds\, 28 vcore-seconds 2019-03-28 15:51:21,774 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552482065227_0002 2019-03-28 15:51:21,774 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 3 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,775 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552482065227_0002,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552482065227_0002/,appMasterHost=N/A,submitTime=1552488442705,startTime=1552488442707,finishTime=1552488462286,finalStatus=SUCCEEDED,memorySeconds=54691,vcoreSeconds=29,preemptedMemorySeconds=54691,preemptedVcoreSeconds=29,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=54691 MB-seconds\, 29 vcore-seconds,preemptedResourceSeconds=54691 MB-seconds\, 29 vcore-seconds 2019-03-28 15:51:21,775 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552482065227_0003 was added 2019-03-28 15:51:21,778 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552482065227_0003 2019-03-28 15:51:21,780 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 4 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,780 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552482065227_0004 was added 2019-03-28 15:51:21,780 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552482065227_0003,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552482065227_0003/,appMasterHost=N/A,submitTime=1552490465069,startTime=1552490465072,finishTime=1552490482949,finalStatus=SUCCEEDED,memorySeconds=49188,vcoreSeconds=25,preemptedMemorySeconds=49188,preemptedVcoreSeconds=25,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=49188 MB-seconds\, 25 vcore-seconds,preemptedResourceSeconds=49188 MB-seconds\, 25 vcore-seconds 2019-03-28 15:51:21,782 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 5 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,782 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552482065227_0005 was added 2019-03-28 15:51:21,784 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552482065227_0004 2019-03-28 15:51:21,785 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552482065227_0004,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552482065227_0004/,appMasterHost=N/A,submitTime=1552577804857,startTime=1552577804861,finishTime=1552577824114,finalStatus=SUCCEEDED,memorySeconds=53163,vcoreSeconds=27,preemptedMemorySeconds=53163,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=53163 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=53163 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,785 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 6 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,786 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552482065227_0005 2019-03-28 15:51:21,787 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552482065227_0006 was added 2019-03-28 15:51:21,788 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552482065227_0005,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552482065227_0005/,appMasterHost=N/A,submitTime=1552578407831,startTime=1552578407834,finishTime=1552578426246,finalStatus=SUCCEEDED,memorySeconds=51484,vcoreSeconds=26,preemptedMemorySeconds=51484,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=51484 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=51484 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,791 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552482065227_0006 2019-03-28 15:51:21,791 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552482065227_0006,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552482065227_0006/,appMasterHost=N/A,submitTime=1552578663598,startTime=1552578663601,finishTime=1552578682202,finalStatus=SUCCEEDED,memorySeconds=51283,vcoreSeconds=26,preemptedMemorySeconds=51283,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=51283 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=51283 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,792 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,793 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552583090658_0001 was added 2019-03-28 15:51:21,796 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,796 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552583090658_0001 2019-03-28 15:51:21,798 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552583090658_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552583090658_0001/,appMasterHost=N/A,submitTime=1552585237828,startTime=1552585237831,finishTime=1552585258253,finalStatus=SUCCEEDED,memorySeconds=56251,vcoreSeconds=29,preemptedMemorySeconds=56251,preemptedVcoreSeconds=29,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=56251 MB-seconds\, 29 vcore-seconds,preemptedResourceSeconds=56251 MB-seconds\, 29 vcore-seconds 2019-03-28 15:51:21,798 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552587626851_0001 was added 2019-03-28 15:51:21,800 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552587626851_0001 2019-03-28 15:51:21,802 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,802 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552587626851_0002 was added 2019-03-28 15:51:21,803 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552587626851_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552587626851_0001/,appMasterHost=N/A,submitTime=1552587738952,startTime=1552587738954,finishTime=1552587758576,finalStatus=SUCCEEDED,memorySeconds=53621,vcoreSeconds=27,preemptedMemorySeconds=53621,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=53621 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=53621 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,807 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552587626851_0002 2019-03-28 15:51:21,808 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552587626851_0002,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552587626851_0002/,appMasterHost=N/A,submitTime=1552587968868,startTime=1552587968870,finishTime=1552587989370,finalStatus=SUCCEEDED,memorySeconds=57536,vcoreSeconds=28,preemptedMemorySeconds=57536,preemptedVcoreSeconds=28,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=57536 MB-seconds\, 28 vcore-seconds,preemptedResourceSeconds=57536 MB-seconds\, 28 vcore-seconds 2019-03-28 15:51:21,808 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,809 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552588101050_0001 was added 2019-03-28 15:51:21,812 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552588101050_0001 2019-03-28 15:51:21,812 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,813 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552588101050_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552588101050_0001/,appMasterHost=N/A,submitTime=1552588137153,startTime=1552588137156,finishTime=1552588157147,finalStatus=SUCCEEDED,memorySeconds=55567,vcoreSeconds=28,preemptedMemorySeconds=55567,preemptedVcoreSeconds=28,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=55567 MB-seconds\, 28 vcore-seconds,preemptedResourceSeconds=55567 MB-seconds\, 28 vcore-seconds 2019-03-28 15:51:21,813 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552588293694_0001 was added 2019-03-28 15:51:21,815 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552588293694_0001 2019-03-28 15:51:21,817 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,817 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552588293694_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552588293694_0001/,appMasterHost=N/A,submitTime=1552588331026,startTime=1552588331029,finishTime=1552588350008,finalStatus=SUCCEEDED,memorySeconds=51579,vcoreSeconds=27,preemptedMemorySeconds=51579,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=51579 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=51579 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,817 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552588560543_0001 was added 2019-03-28 15:51:21,820 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,820 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552588560543_0002 was added 2019-03-28 15:51:21,823 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 3 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,823 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552588560543_0003 was added 2019-03-28 15:51:21,824 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552588560543_0001 2019-03-28 15:51:21,825 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552588560543_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552588560543_0001/,appMasterHost=N/A,submitTime=1552588628163,startTime=1552588628166,finishTime=1552588648443,finalStatus=SUCCEEDED,memorySeconds=55214,vcoreSeconds=29,preemptedMemorySeconds=55214,preemptedVcoreSeconds=29,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=55214 MB-seconds\, 29 vcore-seconds,preemptedResourceSeconds=55214 MB-seconds\, 29 vcore-seconds 2019-03-28 15:51:21,826 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,826 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552903328134_0001 was added 2019-03-28 15:51:21,826 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552588560543_0002 2019-03-28 15:51:21,829 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552588560543_0002,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552588560543_0002/,appMasterHost=N/A,submitTime=1552655687269,startTime=1552655687272,finishTime=1552655705883,finalStatus=SUCCEEDED,memorySeconds=52016,vcoreSeconds=27,preemptedMemorySeconds=52016,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=52016 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=52016 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,829 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552588560543_0003 2019-03-28 15:51:21,829 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,830 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552903328134_0002 was added 2019-03-28 15:51:21,830 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552588560543_0003,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552588560543_0003/,appMasterHost=N/A,submitTime=1552898345034,startTime=1552898345037,finishTime=1552898364426,finalStatus=SUCCEEDED,memorySeconds=54161,vcoreSeconds=28,preemptedMemorySeconds=54161,preemptedVcoreSeconds=28,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=54161 MB-seconds\, 28 vcore-seconds,preemptedResourceSeconds=54161 MB-seconds\, 28 vcore-seconds 2019-03-28 15:51:21,830 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552903328134_0001 2019-03-28 15:51:21,831 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552903328134_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552903328134_0001/,appMasterHost=N/A,submitTime=1552904572084,startTime=1552904572088,finishTime=1552904590496,finalStatus=SUCCEEDED,memorySeconds=50570,vcoreSeconds=26,preemptedMemorySeconds=50570,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50570 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=50570 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,832 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552903328134_0002 2019-03-28 15:51:21,832 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,833 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552914363468_0001 was added 2019-03-28 15:51:21,833 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552903328134_0002,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552903328134_0002/,appMasterHost=N/A,submitTime=1552906899136,startTime=1552906899139,finishTime=1552906917475,finalStatus=SUCCEEDED,memorySeconds=50314,vcoreSeconds=26,preemptedMemorySeconds=50314,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50314 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=50314 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,836 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552914363468_0001 2019-03-28 15:51:21,836 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,836 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552914363468_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552914363468_0001/,appMasterHost=N/A,submitTime=1552914400081,startTime=1552914400084,finishTime=1552914418941,finalStatus=SUCCEEDED,memorySeconds=51669,vcoreSeconds=27,preemptedMemorySeconds=51669,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=51669 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=51669 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,838 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552914528579_0001 was added 2019-03-28 15:51:21,840 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552914528579_0001 2019-03-28 15:51:21,841 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552914528579_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552914528579_0001/,appMasterHost=N/A,submitTime=1552914544719,startTime=1552914544722,finishTime=1552914572306,finalStatus=SUCCEEDED,memorySeconds=52554,vcoreSeconds=27,preemptedMemorySeconds=52554,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=52554 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=52554 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,841 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,841 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552914589043_0001 was added 2019-03-28 15:51:21,844 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552914589043_0001 2019-03-28 15:51:21,845 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552914589043_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552914589043_0001/,appMasterHost=N/A,submitTime=1552914603812,startTime=1552914603815,finishTime=1552914632818,finalStatus=SUCCEEDED,memorySeconds=53634,vcoreSeconds=27,preemptedMemorySeconds=53634,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=53634 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=53634 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,845 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,845 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552914589043_0002 was added 2019-03-28 15:51:21,847 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552914589043_0002 2019-03-28 15:51:21,848 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552914589043_0002,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552914589043_0002/,appMasterHost=N/A,submitTime=1552983254106,startTime=1552983254109,finishTime=1552983271971,finalStatus=SUCCEEDED,memorySeconds=50654,vcoreSeconds=26,preemptedMemorySeconds=50654,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50654 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=50654 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,848 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 3 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,848 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552914589043_0003 was added 2019-03-28 15:51:21,850 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552914589043_0003 2019-03-28 15:51:21,851 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 4 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,851 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552914589043_0003,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552914589043_0003/,appMasterHost=N/A,submitTime=1552983345460,startTime=1552983345461,finishTime=1552983363028,finalStatus=SUCCEEDED,memorySeconds=49960,vcoreSeconds=25,preemptedMemorySeconds=49960,preemptedVcoreSeconds=25,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=49960 MB-seconds\, 25 vcore-seconds,preemptedResourceSeconds=49960 MB-seconds\, 25 vcore-seconds 2019-03-28 15:51:21,851 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552914589043_0004 was added 2019-03-28 15:51:21,855 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552914589043_0004 2019-03-28 15:51:21,855 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552914589043_0004,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552914589043_0004/,appMasterHost=N/A,submitTime=1552984793195,startTime=1552984793198,finishTime=1552984812135,finalStatus=SUCCEEDED,memorySeconds=50566,vcoreSeconds=25,preemptedMemorySeconds=50566,preemptedVcoreSeconds=25,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50566 MB-seconds\, 25 vcore-seconds,preemptedResourceSeconds=50566 MB-seconds\, 25 vcore-seconds 2019-03-28 15:51:21,856 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 5 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,856 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552914589043_0005 was added 2019-03-28 15:51:21,859 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552914589043_0005 2019-03-28 15:51:21,860 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 6 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,860 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552914589043_0006 was added 2019-03-28 15:51:21,861 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552914589043_0005,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552914589043_0005/,appMasterHost=N/A,submitTime=1552988578819,startTime=1552988578823,finishTime=1552988597995,finalStatus=SUCCEEDED,memorySeconds=53515,vcoreSeconds=27,preemptedMemorySeconds=53515,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=53515 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=53515 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,863 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552914589043_0006 2019-03-28 15:51:21,863 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552914589043_0006,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552914589043_0006/,appMasterHost=N/A,submitTime=1552988891567,startTime=1552988891570,finishTime=1552988909740,finalStatus=SUCCEEDED,memorySeconds=47784,vcoreSeconds=24,preemptedMemorySeconds=47784,preemptedVcoreSeconds=24,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=47784 MB-seconds\, 24 vcore-seconds,preemptedResourceSeconds=47784 MB-seconds\, 24 vcore-seconds 2019-03-28 15:51:21,863 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 7 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,864 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552914589043_0007 was added 2019-03-28 15:51:21,866 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552914589043_0007 2019-03-28 15:51:21,868 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 4 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,868 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552914589043_0007,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552914589043_0007/,appMasterHost=N/A,submitTime=1552988924939,startTime=1552988924940,finishTime=1552988942716,finalStatus=SUCCEEDED,memorySeconds=50082,vcoreSeconds=26,preemptedMemorySeconds=50082,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50082 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=50082 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,868 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552989750177_0004 was added 2019-03-28 15:51:21,871 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552989750177_0004 2019-03-28 15:51:21,871 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 5 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,871 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552989750177_0004,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552989750177_0004/,appMasterHost=N/A,submitTime=1552992142060,startTime=1552992142065,finishTime=1552992161960,finalStatus=SUCCEEDED,memorySeconds=50642,vcoreSeconds=25,preemptedMemorySeconds=50642,preemptedVcoreSeconds=25,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50642 MB-seconds\, 25 vcore-seconds,preemptedResourceSeconds=50642 MB-seconds\, 25 vcore-seconds 2019-03-28 15:51:21,872 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552989750177_0005 was added 2019-03-28 15:51:21,874 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552989750177_0005 2019-03-28 15:51:21,876 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 6 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,876 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552989750177_0005,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552989750177_0005/,appMasterHost=N/A,submitTime=1552992220501,startTime=1552992220503,finishTime=1552992238300,finalStatus=SUCCEEDED,memorySeconds=50797,vcoreSeconds=26,preemptedMemorySeconds=50797,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50797 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=50797 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,876 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552989750177_0006 was added 2019-03-28 15:51:21,878 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552989750177_0006 2019-03-28 15:51:21,878 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 7 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,878 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552989750177_0006,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552989750177_0006/,appMasterHost=N/A,submitTime=1552992288955,startTime=1552992288956,finishTime=1552992307384,finalStatus=SUCCEEDED,memorySeconds=50006,vcoreSeconds=26,preemptedMemorySeconds=50006,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50006 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=50006 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,878 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552989750177_0007 was added 2019-03-28 15:51:21,879 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552989750177_0007 2019-03-28 15:51:21,880 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552989750177_0007,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552989750177_0007/,appMasterHost=N/A,submitTime=1552992452421,startTime=1552992452424,finishTime=1552992471319,finalStatus=SUCCEEDED,memorySeconds=51012,vcoreSeconds=26,preemptedMemorySeconds=51012,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=51012 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=51012 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,880 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 8 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,880 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552989750177_0008 was added 2019-03-28 15:51:21,881 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552989750177_0008 2019-03-28 15:51:21,882 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 9 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,882 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552989750177_0009 was added 2019-03-28 15:51:21,882 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552989750177_0008,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552989750177_0008/,appMasterHost=N/A,submitTime=1552992458604,startTime=1552992458605,finishTime=1552992496767,finalStatus=SUCCEEDED,memorySeconds=49471,vcoreSeconds=24,preemptedMemorySeconds=49471,preemptedVcoreSeconds=24,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=49471 MB-seconds\, 24 vcore-seconds,preemptedResourceSeconds=49471 MB-seconds\, 24 vcore-seconds 2019-03-28 15:51:21,883 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552989750177_0009 2019-03-28 15:51:21,883 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 10 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,884 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552989750177_0010 was added 2019-03-28 15:51:21,884 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552989750177_0009,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552989750177_0009/,appMasterHost=N/A,submitTime=1552992460356,startTime=1552992460357,finishTime=1552992521798,finalStatus=SUCCEEDED,memorySeconds=50238,vcoreSeconds=26,preemptedMemorySeconds=50238,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50238 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=50238 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,885 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552989750177_0010 2019-03-28 15:51:21,885 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 11 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,885 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552989750177_0010,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552989750177_0010/,appMasterHost=N/A,submitTime=1552992472373,startTime=1552992472374,finishTime=1552992546940,finalStatus=SUCCEEDED,memorySeconds=49663,vcoreSeconds=26,preemptedMemorySeconds=49663,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=49663 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=49663 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,885 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1552989750177_0011 was added 2019-03-28 15:51:21,886 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1552989750177_0011 2019-03-28 15:51:21,887 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,887 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1552989750177_0011,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1552989750177_0011/,appMasterHost=N/A,submitTime=1553254058376,startTime=1553254058379,finishTime=1553254078759,finalStatus=SUCCEEDED,memorySeconds=57948,vcoreSeconds=29,preemptedMemorySeconds=57948,preemptedVcoreSeconds=29,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=57948 MB-seconds\, 29 vcore-seconds,preemptedResourceSeconds=57948 MB-seconds\, 29 vcore-seconds 2019-03-28 15:51:21,887 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553254474355_0001 was added 2019-03-28 15:51:21,888 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553254474355_0001 2019-03-28 15:51:21,888 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,888 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553254474355_0001,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553254474355_0001/,appMasterHost=N/A,submitTime=1553254491698,startTime=1553254491704,finishTime=1553254518355,finalStatus=SUCCEEDED,memorySeconds=56319,vcoreSeconds=29,preemptedMemorySeconds=56319,preemptedVcoreSeconds=29,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=56319 MB-seconds\, 29 vcore-seconds,preemptedResourceSeconds=56319 MB-seconds\, 29 vcore-seconds 2019-03-28 15:51:21,888 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553258815132_0001 was added 2019-03-28 15:51:21,890 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553258815132_0001 2019-03-28 15:51:21,890 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,890 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553258815132_0002 was added 2019-03-28 15:51:21,890 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553258815132_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553258815132_0001/,appMasterHost=N/A,submitTime=1553258825915,startTime=1553258825918,finishTime=1553258849705,finalStatus=FAILED,memorySeconds=20353,vcoreSeconds=9,preemptedMemorySeconds=20353,preemptedVcoreSeconds=9,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=20353 MB-seconds\, 9 vcore-seconds,preemptedResourceSeconds=20353 MB-seconds\, 9 vcore-seconds 2019-03-28 15:51:21,892 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553258815132_0002 2019-03-28 15:51:21,892 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 3 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,892 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553258815132_0003 was added 2019-03-28 15:51:21,892 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553258815132_0002,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553258815132_0002/,appMasterHost=N/A,submitTime=1553258922718,startTime=1553258922721,finishTime=1553258940135,finalStatus=SUCCEEDED,memorySeconds=47834,vcoreSeconds=24,preemptedMemorySeconds=47834,preemptedVcoreSeconds=24,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=47834 MB-seconds\, 24 vcore-seconds,preemptedResourceSeconds=47834 MB-seconds\, 24 vcore-seconds 2019-03-28 15:51:21,895 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553258815132_0003 2019-03-28 15:51:21,895 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 4 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,895 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553258815132_0004 was added 2019-03-28 15:51:21,896 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553258815132_0003,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553258815132_0003/,appMasterHost=N/A,submitTime=1553259261368,startTime=1553259261371,finishTime=1553259279462,finalStatus=SUCCEEDED,memorySeconds=48822,vcoreSeconds=26,preemptedMemorySeconds=48822,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=48822 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=48822 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,897 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553258815132_0004 2019-03-28 15:51:21,897 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 5 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,898 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553258815132_0005 was added 2019-03-28 15:51:21,898 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553258815132_0004,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553258815132_0004/,appMasterHost=N/A,submitTime=1553673917456,startTime=1553673917460,finishTime=1553673935954,finalStatus=FAILED,memorySeconds=42045,vcoreSeconds=21,preemptedMemorySeconds=42045,preemptedVcoreSeconds=21,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=42045 MB-seconds\, 21 vcore-seconds,preemptedResourceSeconds=42045 MB-seconds\, 21 vcore-seconds 2019-03-28 15:51:21,899 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553258815132_0005 2019-03-28 15:51:21,899 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 6 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,899 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553258815132_0005,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553258815132_0005/,appMasterHost=N/A,submitTime=1553674461878,startTime=1553674461882,finishTime=1553674482230,finalStatus=SUCCEEDED,memorySeconds=57636,vcoreSeconds=29,preemptedMemorySeconds=57636,preemptedVcoreSeconds=29,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=57636 MB-seconds\, 29 vcore-seconds,preemptedResourceSeconds=57636 MB-seconds\, 29 vcore-seconds 2019-03-28 15:51:21,899 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553258815132_0006 was added 2019-03-28 15:51:21,901 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1553258815132_0006 failed 2 times due to AM Container for appattempt_1553258815132_0006_000002 exited with exitCode: 1 Failing this attempt.Diagnostics: [2019-03-27 08:15:35.364]Exception from container-launch. Container id: container_e14_1553258815132_0006_02_000001 Exit code: 1 [2019-03-27 08:15:35.406]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : Unrecognized option: -Xm800m Error: Could not create the Java Virtual Machine. Error: A fatal exception has occurred. Program will exit. [2019-03-27 08:15:35.408]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : Unrecognized option: -Xm800m Error: Could not create the Java Virtual Machine. Error: A fatal exception has occurred. Program will exit. For more detailed output, check the application tracking page: http://yarn-ats-1:8088/cluster/app/application_1553258815132_0006 Then click on links to logs of each attempt. . Failing the application. APPID=application_1553258815132_0006 2019-03-28 15:51:21,901 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,901 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553682613272_0001 was added 2019-03-28 15:51:21,901 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553258815132_0006,name=word count,user=hbase,queue=default,state=FAILED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553258815132_0006/,appMasterHost=N/A,submitTime=1553674533603,startTime=1553674533608,finishTime=1553674535428,finalStatus=FAILED,memorySeconds=2557,vcoreSeconds=0,preemptedMemorySeconds=2557,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=2557 MB-seconds\, 0 vcore-seconds,preemptedResourceSeconds=2557 MB-seconds\, 0 vcore-seconds 2019-03-28 15:51:21,903 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1553682613272_0001 failed 2 times due to AM Container for appattempt_1553682613272_0001_000002 exited with exitCode: 1 Failing this attempt.Diagnostics: [2019-03-27 10:30:34.022]Exception from container-launch. Container id: container_e15_1553682613272_0001_02_000001 Exit code: 1 [2019-03-27 10:30:34.028]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : Unrecognized option: -Xm800m Error: Could not create the Java Virtual Machine. Error: A fatal exception has occurred. Program will exit. [2019-03-27 10:30:34.029]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : Unrecognized option: -Xm800m Error: Could not create the Java Virtual Machine. Error: A fatal exception has occurred. Program will exit. For more detailed output, check the application tracking page: http://yarn-ats-1:8088/cluster/app/application_1553682613272_0001 Then click on links to logs of each attempt. . Failing the application. APPID=application_1553682613272_0001 2019-03-28 15:51:21,903 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,903 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553682613272_0002 was added 2019-03-28 15:51:21,903 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553682613272_0001,name=word count,user=hbase,queue=default,state=FAILED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553682613272_0001/,appMasterHost=N/A,submitTime=1553682630879,startTime=1553682630882,finishTime=1553682634048,finalStatus=FAILED,memorySeconds=2780,vcoreSeconds=0,preemptedMemorySeconds=2780,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=2780 MB-seconds\, 0 vcore-seconds,preemptedResourceSeconds=2780 MB-seconds\, 0 vcore-seconds 2019-03-28 15:51:21,904 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553682613272_0002 2019-03-28 15:51:21,904 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,904 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553684549616_0001 was added 2019-03-28 15:51:21,905 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553682613272_0002,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553682613272_0002/,appMasterHost=N/A,submitTime=1553684030576,startTime=1553684030579,finishTime=1553684048438,finalStatus=SUCCEEDED,memorySeconds=50158,vcoreSeconds=25,preemptedMemorySeconds=50158,preemptedVcoreSeconds=25,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50158 MB-seconds\, 25 vcore-seconds,preemptedResourceSeconds=50158 MB-seconds\, 25 vcore-seconds 2019-03-28 15:51:21,906 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553684549616_0001 2019-03-28 15:51:21,906 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,906 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553684549616_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553684549616_0001/,appMasterHost=N/A,submitTime=1553684565567,startTime=1553684565570,finishTime=1553684589940,finalStatus=SUCCEEDED,memorySeconds=50960,vcoreSeconds=26,preemptedMemorySeconds=50960,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50960 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=50960 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,906 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553684950097_0001 was added 2019-03-28 15:51:21,908 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553684950097_0001 2019-03-28 15:51:21,908 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553684950097_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553684950097_0001/,appMasterHost=N/A,submitTime=1553684971403,startTime=1553684971406,finishTime=1553684992591,finalStatus=SUCCEEDED,memorySeconds=51478,vcoreSeconds=26,preemptedMemorySeconds=51478,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=51478 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=51478 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,908 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,909 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553685341603_0001 was added 2019-03-28 15:51:21,910 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553685341603_0001 2019-03-28 15:51:21,911 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553685341603_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553685341603_0001/,appMasterHost=N/A,submitTime=1553685355174,startTime=1553685355177,finishTime=1553685384250,finalStatus=SUCCEEDED,memorySeconds=49176,vcoreSeconds=24,preemptedMemorySeconds=49176,preemptedVcoreSeconds=24,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=49176 MB-seconds\, 24 vcore-seconds,preemptedResourceSeconds=49176 MB-seconds\, 24 vcore-seconds 2019-03-28 15:51:21,911 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,911 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553685341603_0002 was added 2019-03-28 15:51:21,912 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553685341603_0002 2019-03-28 15:51:21,913 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553685341603_0002,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553685341603_0002/,appMasterHost=N/A,submitTime=1553692684548,startTime=1553692684552,finishTime=1553692703619,finalStatus=SUCCEEDED,memorySeconds=50388,vcoreSeconds=25,preemptedMemorySeconds=50388,preemptedVcoreSeconds=25,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=50388 MB-seconds\, 25 vcore-seconds,preemptedResourceSeconds=50388 MB-seconds\, 25 vcore-seconds 2019-03-28 15:51:21,913 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 3 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,913 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553685341603_0003 was added 2019-03-28 15:51:21,915 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553685341603_0003 2019-03-28 15:51:21,915 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 4 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,915 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553685341603_0004 was added 2019-03-28 15:51:21,916 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553685341603_0003,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553685341603_0003/,appMasterHost=N/A,submitTime=1553693606253,startTime=1553693606256,finishTime=1553693626073,finalStatus=SUCCEEDED,memorySeconds=53485,vcoreSeconds=27,preemptedMemorySeconds=53485,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=53485 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=53485 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,916 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553685341603_0004 2019-03-28 15:51:21,917 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553685341603_0004,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553685341603_0004/,appMasterHost=N/A,submitTime=1553694162903,startTime=1553694162904,finishTime=1553694182129,finalStatus=SUCCEEDED,memorySeconds=49348,vcoreSeconds=25,preemptedMemorySeconds=49348,preemptedVcoreSeconds=25,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=49348 MB-seconds\, 25 vcore-seconds,preemptedResourceSeconds=49348 MB-seconds\, 25 vcore-seconds 2019-03-28 15:51:21,917 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 5 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,917 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553685341603_0005 was added 2019-03-28 15:51:21,918 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553685341603_0005 2019-03-28 15:51:21,919 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 6 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,919 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553685341603_0005,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553685341603_0005/,appMasterHost=N/A,submitTime=1553694622318,startTime=1553694622322,finishTime=1553694640834,finalStatus=SUCCEEDED,memorySeconds=51185,vcoreSeconds=26,preemptedMemorySeconds=51185,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=51185 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=51185 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,919 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553685341603_0006 was added 2019-03-28 15:51:21,920 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553685341603_0006 2019-03-28 15:51:21,920 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 7 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,920 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553685341603_0006,name=QuasiMonteCarlo,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553685341603_0006/,appMasterHost=N/A,submitTime=1553695001390,startTime=1553695001394,finishTime=1553695040049,finalStatus=SUCCEEDED,memorySeconds=111878,vcoreSeconds=66,preemptedMemorySeconds=111878,preemptedVcoreSeconds=66,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=111878 MB-seconds\, 66 vcore-seconds,preemptedResourceSeconds=111878 MB-seconds\, 66 vcore-seconds 2019-03-28 15:51:21,920 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553685341603_0007 was added 2019-03-28 15:51:21,922 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 8 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,922 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553685341603_0008 was added 2019-03-28 15:51:21,923 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553685341603_0007 2019-03-28 15:51:21,923 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553685341603_0007,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553685341603_0007/,appMasterHost=N/A,submitTime=1553700149596,startTime=1553700149599,finishTime=1553700170392,finalStatus=SUCCEEDED,memorySeconds=58595,vcoreSeconds=30,preemptedMemorySeconds=58595,preemptedVcoreSeconds=30,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=58595 MB-seconds\, 30 vcore-seconds,preemptedResourceSeconds=58595 MB-seconds\, 30 vcore-seconds 2019-03-28 15:51:21,924 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553685341603_0008 2019-03-28 15:51:21,924 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553685341603_0008,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553685341603_0008/,appMasterHost=N/A,submitTime=1553700572690,startTime=1553700572693,finishTime=1553700593997,finalStatus=SUCCEEDED,memorySeconds=59371,vcoreSeconds=30,preemptedMemorySeconds=59371,preemptedVcoreSeconds=30,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=59371 MB-seconds\, 30 vcore-seconds,preemptedResourceSeconds=59371 MB-seconds\, 30 vcore-seconds 2019-03-28 15:51:21,924 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 9 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,924 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553685341603_0009 was added 2019-03-28 15:51:21,925 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 10 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,925 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553685341603_0010 was added 2019-03-28 15:51:21,926 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553685341603_0009 2019-03-28 15:51:21,926 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553685341603_0009,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553685341603_0009/,appMasterHost=N/A,submitTime=1553700797790,startTime=1553700797793,finishTime=1553700816375,finalStatus=SUCCEEDED,memorySeconds=49818,vcoreSeconds=26,preemptedMemorySeconds=49818,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=49818 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=49818 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,927 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553685341603_0010 2019-03-28 15:51:21,927 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,927 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553709696169_0001 was added 2019-03-28 15:51:21,927 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553685341603_0010,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553685341603_0010/,appMasterHost=N/A,submitTime=1553708403110,startTime=1553708403114,finishTime=1553708423799,finalStatus=SUCCEEDED,memorySeconds=55299,vcoreSeconds=29,preemptedMemorySeconds=55299,preemptedVcoreSeconds=29,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=55299 MB-seconds\, 29 vcore-seconds,preemptedResourceSeconds=55299 MB-seconds\, 29 vcore-seconds 2019-03-28 15:51:21,928 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,928 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553709696169_0002 was added 2019-03-28 15:51:21,928 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553709696169_0001 2019-03-28 15:51:21,928 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553709696169_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553709696169_0001/,appMasterHost=N/A,submitTime=1553709716349,startTime=1553709716352,finishTime=1553709740648,finalStatus=SUCCEEDED,memorySeconds=54205,vcoreSeconds=27,preemptedMemorySeconds=54205,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=54205 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=54205 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,929 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 3 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,929 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553709696169_0002 2019-03-28 15:51:21,929 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553709696169_0003 was added 2019-03-28 15:51:21,929 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553709696169_0002,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553709696169_0002/,appMasterHost=N/A,submitTime=1553769367742,startTime=1553769367745,finishTime=1553769388049,finalStatus=SUCCEEDED,memorySeconds=53871,vcoreSeconds=27,preemptedMemorySeconds=53871,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=53871 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=53871 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,930 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,931 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553709696169_0003 2019-03-28 15:51:21,931 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553771740351_0001 was added 2019-03-28 15:51:21,932 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553709696169_0003,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553709696169_0003/,appMasterHost=N/A,submitTime=1553770096363,startTime=1553770096367,finishTime=1553770115343,finalStatus=SUCCEEDED,memorySeconds=49797,vcoreSeconds=26,preemptedMemorySeconds=49797,preemptedVcoreSeconds=26,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=49797 MB-seconds\, 26 vcore-seconds,preemptedResourceSeconds=49797 MB-seconds\, 26 vcore-seconds 2019-03-28 15:51:21,933 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,933 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553774101095_0001 was added 2019-03-28 15:51:21,934 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,934 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553774938065_0001 was added 2019-03-28 15:51:21,935 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553771740351_0001 2019-03-28 15:51:21,935 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553771740351_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553771740351_0001/,appMasterHost=N/A,submitTime=1553771866096,startTime=1553771866098,finishTime=1553771886840,finalStatus=SUCCEEDED,memorySeconds=55464,vcoreSeconds=29,preemptedMemorySeconds=55464,preemptedVcoreSeconds=29,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=55464 MB-seconds\, 29 vcore-seconds,preemptedResourceSeconds=55464 MB-seconds\, 29 vcore-seconds 2019-03-28 15:51:21,935 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553774101095_0001 2019-03-28 15:51:21,935 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553774101095_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553774101095_0001/,appMasterHost=N/A,submitTime=1553774197044,startTime=1553774197047,finishTime=1553774217678,finalStatus=SUCCEEDED,memorySeconds=52914,vcoreSeconds=27,preemptedMemorySeconds=52914,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=52914 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=52914 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,935 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553774938065_0001 2019-03-28 15:51:21,935 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,935 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553774938065_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553774938065_0001/,appMasterHost=N/A,submitTime=1553774954388,startTime=1553774954393,finishTime=1553774982307,finalStatus=SUCCEEDED,memorySeconds=54510,vcoreSeconds=28,preemptedMemorySeconds=54510,preemptedVcoreSeconds=28,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=54510 MB-seconds\, 28 vcore-seconds,preemptedResourceSeconds=54510 MB-seconds\, 28 vcore-seconds 2019-03-28 15:51:21,936 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553776197666_0001 was added 2019-03-28 15:51:21,937 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 2 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,937 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553776197666_0002 was added 2019-03-28 15:51:21,938 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553776197666_0001 2019-03-28 15:51:21,938 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 3 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,938 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553776197666_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553776197666_0001/,appMasterHost=N/A,submitTime=1553776245186,startTime=1553776245192,finishTime=1553776265615,finalStatus=SUCCEEDED,memorySeconds=54324,vcoreSeconds=27,preemptedMemorySeconds=54324,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=54324 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=54324 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,938 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553776197666_0002 2019-03-28 15:51:21,938 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553776197666_0003 was added 2019-03-28 15:51:21,938 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553776197666_0002,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553776197666_0002/,appMasterHost=N/A,submitTime=1553781147880,startTime=1553781147883,finishTime=1553781167643,finalStatus=SUCCEEDED,memorySeconds=52735,vcoreSeconds=27,preemptedMemorySeconds=52735,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=52735 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=52735 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,939 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,940 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553783702250_0001 was added 2019-03-28 15:51:21,940 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553776197666_0003 2019-03-28 15:51:21,941 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553776197666_0003,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553776197666_0003/,appMasterHost=N/A,submitTime=1553781512266,startTime=1553781512269,finishTime=1553781532312,finalStatus=SUCCEEDED,memorySeconds=52821,vcoreSeconds=27,preemptedMemorySeconds=52821,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=52821 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=52821 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,941 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,941 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553783702250_0001 2019-03-28 15:51:21,941 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553783934195_0001 was added 2019-03-28 15:51:21,941 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553783702250_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553783702250_0001/,appMasterHost=N/A,submitTime=1553783784720,startTime=1553783784723,finishTime=1553783804579,finalStatus=SUCCEEDED,memorySeconds=52715,vcoreSeconds=27,preemptedMemorySeconds=52715,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=52715 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=52715 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,942 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553783934195_0001 2019-03-28 15:51:21,942 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553783934195_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553783934195_0001/,appMasterHost=N/A,submitTime=1553783997988,startTime=1553783997994,finishTime=1553784019055,finalStatus=SUCCEEDED,memorySeconds=52783,vcoreSeconds=27,preemptedMemorySeconds=52783,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=52783 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=52783 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,942 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,942 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553785092729_0001 was added 2019-03-28 15:51:21,943 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553785092729_0001 2019-03-28 15:51:21,943 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,943 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553785092729_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553785092729_0001/,appMasterHost=N/A,submitTime=1553785099882,startTime=1553785099885,finishTime=1553785137716,finalStatus=SUCCEEDED,memorySeconds=54166,vcoreSeconds=28,preemptedMemorySeconds=54166,preemptedVcoreSeconds=28,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=54166 MB-seconds\, 28 vcore-seconds,preemptedResourceSeconds=54166 MB-seconds\, 28 vcore-seconds 2019-03-28 15:51:21,944 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553785274554_0001 was added 2019-03-28 15:51:21,944 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553785274554_0001 2019-03-28 15:51:21,945 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,945 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553785274554_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553785274554_0001/,appMasterHost=N/A,submitTime=1553785363354,startTime=1553785363357,finishTime=1553785384798,finalStatus=SUCCEEDED,memorySeconds=57758,vcoreSeconds=29,preemptedMemorySeconds=57758,preemptedVcoreSeconds=29,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=57758 MB-seconds\, 29 vcore-seconds,preemptedResourceSeconds=57758 MB-seconds\, 29 vcore-seconds 2019-03-28 15:51:21,945 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553785533197_0001 was added 2019-03-28 15:51:21,946 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553785533197_0001 2019-03-28 15:51:21,946 WARN org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The specific max attempts: 0 for application: 1 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead. 2019-03-28 15:51:21,946 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553785533197_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553785533197_0001/,appMasterHost=N/A,submitTime=1553785542868,startTime=1553785542871,finishTime=1553785564618,finalStatus=SUCCEEDED,memorySeconds=53806,vcoreSeconds=28,preemptedMemorySeconds=53806,preemptedVcoreSeconds=28,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=53806 MB-seconds\, 28 vcore-seconds,preemptedResourceSeconds=53806 MB-seconds\, 28 vcore-seconds 2019-03-28 15:51:21,946 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553787689108_0001 was added 2019-03-28 15:51:21,947 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager: Successfully recovered 86 out of 86 applications 2019-03-28 15:51:21,947 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553787689108_0001 2019-03-28 15:51:21,947 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Recovery ended 2019-03-28 15:51:21,947 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553787689108_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553787689108_0001/,appMasterHost=N/A,submitTime=1553787698814,startTime=1553787698817,finishTime=1553787733478,finalStatus=SUCCEEDED,memorySeconds=53817,vcoreSeconds=27,preemptedMemorySeconds=53817,preemptedVcoreSeconds=27,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=53817 MB-seconds\, 27 vcore-seconds,preemptedResourceSeconds=53817 MB-seconds\, 27 vcore-seconds 2019-03-28 15:51:21,947 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens 2019-03-28 15:51:21,950 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens 2019-03-28 15:51:21,951 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-03-28 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 77 2019-03-28 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-03-28 15:51:21,957 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s) 2019-03-28 15:51:21,957 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-03-28 15:51:21,957 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 78 2019-03-28 15:51:21,957 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-03-28 15:51:21,968 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.nodelabels.event.NodeLabelsStoreEventType for class org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager$ForwardingEventHandler 2019-03-28 15:51:21,980 INFO org.apache.hadoop.yarn.nodelabels.store.AbstractFSNodeStore: Created store directory :file:/tmp/hadoop-yarn-yarn/node-attribute 2019-03-28 15:51:22,028 INFO org.apache.hadoop.yarn.nodelabels.store.AbstractFSNodeStore: Finished write mirror at:file:/tmp/hadoop-yarn-yarn/node-attribute/nodeattribute.mirror 2019-03-28 15:51:22,028 INFO org.apache.hadoop.yarn.nodelabels.store.AbstractFSNodeStore: Finished create editlog file at:file:/tmp/hadoop-yarn-yarn/node-attribute/nodeattribute.editlog 2019-03-28 15:51:22,029 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.nodelabels.NodeAttributesStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.nodelabels.NodeAttributesManagerImpl$ForwardingEventHandler 2019-03-28 15:51:22,030 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement.MultiNodeSortingManager: Starting NodeSortingService=MultiNodeSortingManager 2019-03-28 15:51:22,055 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-03-28 15:51:22,057 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8025 2019-03-28 15:51:22,062 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server 2019-03-28 15:51:22,065 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8025: starting 2019-03-28 15:51:22,065 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-03-28 15:51:22,138 INFO org.apache.hadoop.util.JvmPauseMonitor: Starting JVM pause monitor 2019-03-28 15:51:22,176 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-03-28 15:51:22,185 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8030 2019-03-28 15:51:22,196 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server 2019-03-28 15:51:22,197 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-03-28 15:51:22,197 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8030: starting 2019-03-28 15:51:22,345 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-03-28 15:51:22,346 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8050 2019-03-28 15:51:22,350 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server 2019-03-28 15:51:22,350 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-03-28 15:51:22,350 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8050: starting 2019-03-28 15:51:22,368 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioned to active state 2019-03-28 15:51:22,791 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0001 was removed 2019-03-28 15:51:22,812 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0010 was removed 2019-03-28 15:51:22,834 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0009 was removed 2019-03-28 15:51:22,855 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0008 was removed 2019-03-28 15:51:22,874 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0007 was removed 2019-03-28 15:51:22,896 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0006 was removed 2019-03-28 15:51:22,921 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0005 was removed 2019-03-28 15:51:22,947 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0004 was removed 2019-03-28 15:51:22,967 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0003 was removed 2019-03-28 15:51:23,236 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552482065227_0004 was removed 2019-03-28 15:51:23,257 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0015 was removed 2019-03-28 15:51:23,279 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0014 was removed 2019-03-28 15:51:23,300 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0013 was removed 2019-03-28 15:51:23,321 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0002 was removed 2019-03-28 15:51:23,419 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552482065227_0005 was removed 2019-03-28 15:51:23,439 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552482065227_0006 was removed 2019-03-28 15:51:23,456 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552989750177_0009 was removed 2019-03-28 15:51:23,473 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552989750177_0010 was removed 2019-03-28 15:51:23,545 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552583090658_0001 was removed 2019-03-28 15:51:23,583 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552588293694_0001 was removed 2019-03-28 15:51:23,602 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552297011473_0002 was removed 2019-03-28 15:51:23,641 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552297011473_0001 was removed 2019-03-28 15:51:23,672 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552482065227_0003 was removed 2019-03-28 15:51:23,711 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552588560543_0003 was removed 2019-03-28 15:51:23,751 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0011 was removed 2019-03-28 15:51:23,764 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553258815132_0003 was removed 2019-03-28 15:51:23,780 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553258815132_0002 was removed 2019-03-28 15:51:23,799 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552588101050_0001 was removed 2019-03-28 15:51:23,837 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552588560543_0002 was removed 2019-03-28 15:51:23,872 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552482065227_0002 was removed 2019-03-28 15:51:23,914 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552482065227_0001 was removed 2019-03-28 15:51:24,053 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552914589043_0007 was removed 2019-03-28 15:51:24,069 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552588560543_0001 was removed 2019-03-28 15:51:24,086 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552587626851_0002 was removed 2019-03-28 15:51:24,116 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1551967319073_0012 was removed 2019-03-28 15:51:24,170 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552914589043_0006 was removed 2019-03-28 15:51:24,200 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552989750177_0008 was removed 2019-03-28 15:51:24,213 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553685341603_0001 was removed 2019-03-28 15:51:24,250 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553685341603_0002 was removed 2019-03-28 15:51:24,288 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553771740351_0001 was removed 2019-03-28 15:51:24,345 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552914589043_0005 was removed 2019-03-28 15:51:24,363 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552587626851_0001 was removed 2019-03-28 15:51:24,419 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552914589043_0004 was removed 2019-03-28 15:51:24,454 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552989750177_0005 was removed 2019-03-28 15:51:24,487 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552989750177_0006 was removed 2019-03-28 15:51:24,513 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552989750177_0007 was removed 2019-03-28 15:51:24,547 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552914528579_0001 was removed 2019-03-28 15:51:24,560 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553776197666_0001 was removed 2019-03-28 15:51:24,577 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553258815132_0001 was removed 2019-03-28 15:51:24,641 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552903328134_0001 was removed 2019-03-28 15:51:24,654 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552903328134_0002 was removed 2019-03-28 15:51:24,670 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553685341603_0007 was removed 2019-03-28 15:51:24,681 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553685341603_0008 was removed 2019-03-28 15:51:24,714 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553787689108_0001 was removed 2019-03-28 15:51:24,748 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553774101095_0001 was removed 2019-03-28 15:51:24,797 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553685341603_0010 was removed 2019-03-28 15:51:24,808 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553684950097_0001 was removed 2019-03-28 15:51:24,837 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552989750177_0004 was removed 2019-03-28 15:51:24,926 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553783934195_0001 was removed 2019-03-28 15:51:24,939 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553685341603_0009 was removed 2019-03-28 15:51:24,952 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553709696169_0003 was removed 2019-03-28 15:51:24,970 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552914589043_0003 was removed 2019-03-28 15:51:25,009 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553684549616_0001 was removed 2019-03-28 15:51:25,035 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552914589043_0001 was removed 2019-03-28 15:51:25,071 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552914363468_0001 was removed 2019-03-28 15:51:25,084 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553258815132_0006 was removed 2019-03-28 15:51:25,100 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553785092729_0001 was removed 2019-03-28 15:51:25,127 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553685341603_0006 was removed 2019-03-28 15:51:25,200 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553682613272_0002 was removed 2019-03-28 15:51:25,239 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553709696169_0002 was removed 2019-03-28 15:51:25,250 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552989750177_0011 was removed 2019-03-28 15:51:25,292 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1552914589043_0002 was removed 2019-03-28 15:51:25,307 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553685341603_0005 was removed 2019-03-28 15:51:25,328 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553783702250_0001 was removed 2019-03-28 15:51:25,377 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553254474355_0001 was removed 2019-03-28 15:51:25,389 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553709696169_0001 was removed 2019-03-28 15:51:25,426 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553785533197_0001 was removed 2019-03-28 15:51:25,464 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553258815132_0005 was removed 2019-03-28 15:51:25,476 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553258815132_0004 was removed 2019-03-28 15:51:25,527 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553682613272_0001 was removed 2019-03-28 15:51:25,539 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553685341603_0003 was removed 2019-03-28 15:51:25,587 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553774938065_0001 was removed 2019-03-28 15:51:25,618 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553685341603_0004 was removed 2019-03-28 15:51:25,655 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553776197666_0002 was removed 2019-03-28 15:51:25,673 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553776197666_0003 was removed 2019-03-28 15:51:25,702 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553785274554_0001 was removed 2019-03-28 15:51:41,112 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: NodeManager from node yarn-ats-1(cmPort: 45454 httpPort: 8042) registered with capability: , assigned nodeId yarn-ats-1:45454 2019-03-28 15:51:41,123 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: yarn-ats-1:45454 Node Transitioned from NEW to RUNNING 2019-03-28 15:51:41,156 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added node yarn-ats-1:45454 clusterResource: 2019-03-28 15:51:41,233 INFO org.apache.hadoop.yarn.server.resourcemanager.RMActiveServiceContext: Scheduler recovery is done. Start allocating new containers. 2019-03-28 15:51:51,976 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 1 2019-03-28 15:51:53,449 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0001' is submitted without priority hence considering default queue/cluster priority: 0 2019-03-28 15:51:53,449 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0001 2019-03-28 15:51:53,451 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0001 was added 2019-03-28 15:51:53,451 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 1 submitted by user hbase 2019-03-28 15:51:53,451 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0001 2019-03-28 15:51:53,453 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0001 2019-03-28 15:51:53,463 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0001 State change from NEW to NEW_SAVING on event = START 2019-03-28 15:51:53,463 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0001 2019-03-28 15:51:53,517 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0001 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-03-28 15:51:53,522 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0001 user: hbase leaf-queue of parent: root #applications: 1 2019-03-28 15:51:53,523 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0001 from user: hbase, in queue: default 2019-03-28 15:51:53,525 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0001 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-03-28 15:51:53,578 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0001_000001 2019-03-28 15:51:53,580 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0001_000001 State change from NEW to SUBMITTED on event = START 2019-03-28 15:51:53,679 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2019-03-28 15:51:53,682 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0001 from user: hbase activated in queue: default 2019-03-28 15:51:53,682 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0001 user: hbase, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-03-28 15:51:53,682 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0001_000001 to scheduler from user hbase in queue default 2019-03-28 15:51:53,698 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0001_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-03-28 15:51:54,340 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0001_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-03-28 15:51:54,347 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000001 Container Transitioned from NEW to ALLOCATED 2019-03-28 15:51:54,348 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0001_01_000001 of capacity on host yarn-ats-1:45454, which has 1 containers, used and available after allocation 2019-03-28 15:51:54,348 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0001 CONTAINERID=container_e30_1553788280931_0001_01_000001 RESOURCE= 2019-03-28 15:51:54,384 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-1:45454 for container : container_e30_1553788280931_0001_01_000001 2019-03-28 15:51:54,395 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-03-28 15:51:54,397 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0001_000001 2019-03-28 15:51:54,397 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0001 AttemptId: appattempt_1553788280931_0001_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0001_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-1:45454, NodeHttpAddress: yarn-ats-1:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.91:45454 }, ExecutionType: GUARANTEED, ] 2019-03-28 15:51:54,398 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.22222222 absoluteUsedCapacity=0.22222222 used= cluster= 2019-03-28 15:51:54,398 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-03-28 15:51:54,403 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-03-28 15:51:54,414 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-03-28 15:51:54,422 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0001_000001 2019-03-28 15:51:54,510 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0001_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-1:45454, NodeHttpAddress: yarn-ats-1:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.91:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0001_000001 2019-03-28 15:51:54,510 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0001_000001 2019-03-28 15:51:54,520 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0001_000001 2019-03-28 15:51:55,173 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0001_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-1:45454, NodeHttpAddress: yarn-ats-1:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.91:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0001_000001 2019-03-28 15:51:55,174 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0001_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-03-28 15:51:55,174 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0001, attemptId: appattempt_1553788280931_0001_000001launchTime: 1553788315173 2019-03-28 15:51:55,353 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-03-28 15:51:56,359 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0001 with new address: yarn-ats-1:41535 timestamp: 1553788280931, 0 2019-03-28 15:52:01,506 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0001_000001 (auth:SIMPLE) 2019-03-28 15:52:01,542 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0001_000001 2019-03-28 15:52:01,542 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase IP=172.26.81.91 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0001 APPATTEMPTID=appattempt_1553788280931_0001_000001 2019-03-28 15:52:01,543 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0001_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-03-28 15:52:01,543 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0001 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-03-28 15:52:03,416 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0001_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-03-28 15:52:03,418 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000002 Container Transitioned from NEW to ALLOCATED 2019-03-28 15:52:03,418 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0001_01_000002 of capacity on host yarn-ats-1:45454, which has 2 containers, used and available after allocation 2019-03-28 15:52:03,418 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0001 CONTAINERID=container_e30_1553788280931_0001_01_000002 RESOURCE= 2019-03-28 15:52:03,419 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.33333334 absoluteUsedCapacity=0.33333334 used= cluster= 2019-03-28 15:52:03,419 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-03-28 15:52:03,837 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-1:45454 for container : container_e30_1553788280931_0001_01_000002 2019-03-28 15:52:03,839 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-03-28 15:52:04,428 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-03-28 15:52:04,870 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0001 2019-03-28 15:52:09,214 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000002 Container Transitioned from RUNNING to COMPLETED 2019-03-28 15:52:09,223 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0001 CONTAINERID=container_e30_1553788280931_0001_01_000002 RESOURCE= 2019-03-28 15:52:10,219 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0001_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-03-28 15:52:10,221 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000003 Container Transitioned from NEW to ALLOCATED 2019-03-28 15:52:10,221 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0001_01_000003 of capacity on host yarn-ats-1:45454, which has 2 containers, used and available after allocation 2019-03-28 15:52:10,221 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0001 CONTAINERID=container_e30_1553788280931_0001_01_000003 RESOURCE= 2019-03-28 15:52:10,222 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.44444445 absoluteUsedCapacity=0.44444445 used= cluster= 2019-03-28 15:52:10,222 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-03-28 15:52:10,945 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-03-28 15:52:11,232 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-03-28 15:52:11,960 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0001 2019-03-28 15:52:14,520 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000003 Container Transitioned from RUNNING to COMPLETED 2019-03-28 15:52:14,520 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0001 CONTAINERID=container_e30_1553788280931_0001_01_000003 RESOURCE= 2019-03-28 15:52:14,531 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0001_000001 with final state: FINISHING, and exit status: -1000 2019-03-28 15:52:14,533 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0001_000001 State change from RUNNING to FINAL_SAVING on event = UNREGISTERED 2019-03-28 15:52:14,533 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0001 with final state: FINISHING 2019-03-28 15:52:14,534 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0001 State change from RUNNING to FINAL_SAVING on event = ATTEMPT_UNREGISTERED 2019-03-28 15:52:14,544 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0001 2019-03-28 15:52:14,544 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0001_000001 State change from FINAL_SAVING to FINISHING on event = ATTEMPT_UPDATE_SAVED 2019-03-28 15:52:14,551 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0001 State change from FINAL_SAVING to FINISHING on event = APP_UPDATE_SAVED 2019-03-28 15:52:15,531 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: application_1553788280931_0001 unregistered successfully. 2019-03-28 15:52:21,158 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0001_01_000001 Container Transitioned from RUNNING to COMPLETED 2019-03-28 15:52:21,158 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0001 CONTAINERID=container_e30_1553788280931_0001_01_000001 RESOURCE= 2019-03-28 15:52:21,160 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0001_000001 2019-03-28 15:52:21,163 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0001_000001 2019-03-28 15:52:21,167 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0001_000001 State change from FINISHING to FINISHED on event = CONTAINER_FINISHED 2019-03-28 15:52:21,170 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0001 State change from FINISHING to FINISHED on event = ATTEMPT_FINISHED 2019-03-28 15:52:21,170 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hbase OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0001 2019-03-28 15:52:21,170 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0001,name=word count,user=hbase,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553788280931_0001/,appMasterHost=yarn-ats-1,submitTime=1553788313447,startTime=1553788313450,finishTime=1553788334533,finalStatus=SUCCEEDED,memorySeconds=69667,vcoreSeconds=35,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=69667 MB-seconds\, 35 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-03-28 15:52:21,170 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0001_000001 is done. finalState=FINISHED 2019-03-28 15:52:21,171 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0001 requests cleared 2019-03-28 15:52:21,171 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0001 user: hbase queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-03-28 15:52:21,171 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0001 user: hbase leaf-queue of parent: root #applications: 0 2019-03-28 15:52:21,173 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0001_000001 2019-03-28 15:52:21,199 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0001 was removed 2019-03-28 16:01:17,608 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Release request cache is cleaned up 2019-03-29 15:51:21,948 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Rolling master-key for amrm-tokens 2019-03-29 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens 2019-03-29 15:51:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Going to activate master-key with key-id -1517142460 in 900000ms 2019-03-29 15:51:21,953 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-03-29 15:51:21,953 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens 2019-03-29 15:51:21,953 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Going to activate master-key with key-id 566300688 in 900000ms 2019-03-29 15:51:22,745 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-03-29 15:51:25,488 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 37 2019-03-29 15:51:25,488 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-03-29 15:51:25,497 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-03-29 15:51:25,498 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 79 2019-03-29 15:51:25,498 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-03-29 16:06:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Activating next master key with id: -1517142460 2019-03-29 16:06:21,954 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Activating next master key with id: 566300688 2019-03-29 16:06:21,998 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Activating next master key with id: -1222835188 2019-03-29 16:06:21,999 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-03-30 15:51:21,948 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Rolling master-key for amrm-tokens 2019-03-30 15:51:21,949 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-03-30 15:51:21,950 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens 2019-03-30 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Going to activate master-key with key-id -1517142459 in 900000ms 2019-03-30 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens 2019-03-30 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Going to activate master-key with key-id 566300689 in 900000ms 2019-03-30 15:51:26,224 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-03-30 15:51:28,824 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 38 2019-03-30 15:51:28,824 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-03-30 15:51:28,838 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 39 2019-03-30 15:51:28,838 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-03-30 15:51:28,843 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 40 2019-03-30 15:51:28,843 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-03-30 15:51:28,853 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 41 2019-03-30 15:51:28,853 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-03-30 15:51:28,867 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 42 2019-03-30 15:51:28,867 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-03-30 15:51:28,875 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-03-30 15:51:28,875 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 80 2019-03-30 15:51:28,875 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-03-30 16:06:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Activating next master key with id: -1517142459 2019-03-30 16:06:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Activating next master key with id: 566300689 2019-03-30 16:06:21,985 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Activating next master key with id: -1222835187 2019-03-30 16:06:21,985 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-03-31 15:51:21,947 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Rolling master-key for amrm-tokens 2019-03-31 15:51:21,949 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-03-31 15:51:21,950 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens 2019-03-31 15:51:21,950 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Going to activate master-key with key-id -1517142458 in 900000ms 2019-03-31 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens 2019-03-31 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Going to activate master-key with key-id 566300690 in 900000ms 2019-03-31 15:51:29,794 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-03-31 15:51:32,064 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 43 2019-03-31 15:51:32,064 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-03-31 15:51:32,074 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-03-31 15:51:32,074 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 81 2019-03-31 15:51:32,074 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-03-31 16:06:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Activating next master key with id: -1517142458 2019-03-31 16:06:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Activating next master key with id: 566300690 2019-03-31 16:06:21,979 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Activating next master key with id: -1222835186 2019-03-31 16:06:21,979 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-04-01 15:51:21,948 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Rolling master-key for amrm-tokens 2019-04-01 15:51:21,950 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-04-01 15:51:21,950 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens 2019-04-01 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Going to activate master-key with key-id -1517142457 in 900000ms 2019-04-01 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens 2019-04-01 15:51:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Going to activate master-key with key-id 566300691 in 900000ms 2019-04-01 15:51:32,928 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-04-01 15:51:35,195 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 44 2019-04-01 15:51:35,195 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-01 15:51:35,204 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-04-01 15:51:35,204 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 82 2019-04-01 15:51:35,204 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-04-01 16:06:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Activating next master key with id: -1517142457 2019-04-01 16:06:21,953 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Activating next master key with id: 566300691 2019-04-01 16:06:21,989 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Activating next master key with id: -1222835185 2019-04-01 16:06:21,993 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-04-02 15:51:21,947 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Rolling master-key for amrm-tokens 2019-04-02 15:51:21,949 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-04-02 15:51:21,950 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens 2019-04-02 15:51:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens 2019-04-02 15:51:21,955 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Going to activate master-key with key-id -1517142456 in 900000ms 2019-04-02 15:51:21,955 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Going to activate master-key with key-id 566300692 in 900000ms 2019-04-02 15:51:36,061 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-04-02 15:51:38,166 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 45 2019-04-02 15:51:38,167 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-02 15:51:38,174 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-04-02 15:51:38,175 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 83 2019-04-02 15:51:38,175 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-04-02 16:06:21,955 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Activating next master key with id: 566300692 2019-04-02 16:06:21,955 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Activating next master key with id: -1517142456 2019-04-02 16:06:21,988 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Activating next master key with id: -1222835184 2019-04-02 16:06:21,989 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-04-03 15:51:21,948 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Rolling master-key for amrm-tokens 2019-04-03 15:51:21,950 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-04-03 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens 2019-04-03 15:51:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens 2019-04-03 15:51:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Going to activate master-key with key-id 566300693 in 900000ms 2019-04-03 15:51:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Going to activate master-key with key-id -1517142455 in 900000ms 2019-04-03 15:51:39,161 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-04-03 15:51:41,149 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 46 2019-04-03 15:51:41,150 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-03 15:51:41,159 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-04-03 15:51:41,159 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 84 2019-04-03 15:51:41,159 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-04-03 16:06:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Activating next master key with id: 566300693 2019-04-03 16:06:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Activating next master key with id: -1517142455 2019-04-03 16:06:21,991 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Activating next master key with id: -1222835183 2019-04-03 16:06:21,992 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-04-04 15:51:21,948 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Rolling master-key for amrm-tokens 2019-04-04 15:51:21,950 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-04-04 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens 2019-04-04 15:51:21,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Going to activate master-key with key-id -1517142454 in 900000ms 2019-04-04 15:51:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens 2019-04-04 15:51:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Going to activate master-key with key-id 566300694 in 900000ms 2019-04-04 15:51:42,232 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-04-04 15:51:44,228 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 77 2019-04-04 15:51:44,229 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-04 15:51:44,238 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 47 2019-04-04 15:51:44,238 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-04 15:51:44,243 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 48 2019-04-04 15:51:44,243 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-04 15:51:44,248 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 49 2019-04-04 15:51:44,248 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-04 15:51:44,254 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 50 2019-04-04 15:51:44,254 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-04 15:51:44,258 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 51 2019-04-04 15:51:44,259 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-04 15:51:44,263 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 52 2019-04-04 15:51:44,263 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-04 15:51:44,267 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 53 2019-04-04 15:51:44,267 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-04 15:51:44,271 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: removing master key with keyID 54 2019-04-04 15:51:44,271 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Removing RMDTMasterKey. 2019-04-04 15:51:44,275 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-04-04 15:51:44,276 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 85 2019-04-04 15:51:44,276 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-04-04 16:06:21,952 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Activating next master key with id: -1517142454 2019-04-04 16:06:21,953 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Activating next master key with id: 566300694 2019-04-04 16:06:21,980 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Activating next master key with id: -1222835182 2019-04-04 16:06:21,980 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-04-05 09:16:38,364 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: NodeManager from node yarn-ats-3(cmPort: 45454 httpPort: 8042) registered with capability: , assigned nodeId yarn-ats-3:45454 2019-04-05 09:16:38,373 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: yarn-ats-3:45454 Node Transitioned from NEW to RUNNING 2019-04-05 09:16:38,380 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added node yarn-ats-3:45454 clusterResource: 2019-04-05 09:17:33,063 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: NodeManager from node yarn-ats-2(cmPort: 45454 httpPort: 8042) registered with capability: , assigned nodeId yarn-ats-2:45454 2019-04-05 09:17:33,064 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: yarn-ats-2:45454 Node Transitioned from NEW to RUNNING 2019-04-05 09:17:33,068 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added node yarn-ats-2:45454 clusterResource: 2019-04-05 09:17:59,984 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 2 2019-04-05 09:18:01,195 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0002' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 09:18:01,196 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0002 2019-04-05 09:18:01,198 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0002 was added 2019-04-05 09:18:01,199 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 2 submitted by user ambari-qa 2019-04-05 09:18:01,199 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0002 2019-04-05 09:18:01,199 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0002 2019-04-05 09:18:01,201 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0002 2019-04-05 09:18:01,201 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0002 State change from NEW to NEW_SAVING on event = START 2019-04-05 09:18:01,234 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0002 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 09:18:01,235 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0002 user: ambari-qa leaf-queue of parent: root #applications: 1 2019-04-05 09:18:01,235 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0002 from user: ambari-qa, in queue: default 2019-04-05 09:18:01,236 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0002 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 09:18:01,237 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0002_000001 2019-04-05 09:18:01,237 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0002_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 09:18:01,240 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0002 from user: ambari-qa activated in queue: default 2019-04-05 09:18:01,240 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0002 user: ambari-qa, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-04-05 09:18:01,240 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0002_000001 to scheduler from user ambari-qa in queue default 2019-04-05 09:18:01,243 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0002_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 09:18:01,264 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0002_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 09:18:01,265 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:18:01,265 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0002_01_000001 of capacity on host yarn-ats-2:45454, which has 1 containers, used and available after allocation 2019-04-05 09:18:01,265 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0002 CONTAINERID=container_e30_1553788280931_0002_01_000001 RESOURCE= 2019-04-05 09:18:01,280 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-2:45454 for container : container_e30_1553788280931_0002_01_000001 2019-04-05 09:18:01,281 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:18:01,282 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0002_000001 2019-04-05 09:18:01,282 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0002 AttemptId: appattempt_1553788280931_0002_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0002_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 09:18:01,282 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 09:18:01,282 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:18:01,283 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0002_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 09:18:01,299 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0002_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 09:18:01,301 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0002_000001 2019-04-05 09:18:01,307 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0002_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0002_000001 2019-04-05 09:18:01,308 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0002_000001 2019-04-05 09:18:01,310 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0002_000001 2019-04-05 09:18:01,955 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0002_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0002_000001 2019-04-05 09:18:01,955 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0002_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 09:18:01,955 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0002, attemptId: appattempt_1553788280931_0002_000001launchTime: 1554455881955 2019-04-05 09:18:02,285 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0002 with new address: yarn-ats-2:44543 timestamp: 1553788280931, 1 2019-04-05 09:18:02,287 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:18:03,291 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0002 with new address: yarn-ats-2:44543 timestamp: 1553788280931, 2 2019-04-05 09:18:08,016 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0002_000001 (auth:SIMPLE) 2019-04-05 09:18:08,031 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0002_000001 2019-04-05 09:18:08,031 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.92 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0002 APPATTEMPTID=appattempt_1553788280931_0002_000001 2019-04-05 09:18:08,032 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0002_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 09:18:08,032 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0002 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 09:18:09,329 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0002_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 09:18:09,331 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:18:09,331 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0002_01_000002 of capacity on host yarn-ats-2:45454, which has 2 containers, used and available after allocation 2019-04-05 09:18:09,331 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0002 CONTAINERID=container_e30_1553788280931_0002_01_000002 RESOURCE= 2019-04-05 09:18:09,333 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 09:18:09,333 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:18:10,135 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-2:45454 for container : container_e30_1553788280931_0002_01_000002 2019-04-05 09:18:10,136 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:18:11,172 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0002 2019-04-05 09:18:11,338 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:18:15,094 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000002 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:18:15,094 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0002 CONTAINERID=container_e30_1553788280931_0002_01_000002 RESOURCE= 2019-04-05 09:18:16,723 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0002_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 09:18:16,725 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:18:16,725 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0002_01_000003 of capacity on host yarn-ats-1:45454, which has 1 containers, used and available after allocation 2019-04-05 09:18:16,726 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0002 CONTAINERID=container_e30_1553788280931_0002_01_000003 RESOURCE= 2019-04-05 09:18:16,726 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 09:18:16,726 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:18:17,242 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-1:45454 for container : container_e30_1553788280931_0002_01_000003 2019-04-05 09:18:17,249 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:18:17,726 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:18:18,261 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0002 2019-04-05 09:18:21,492 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0002_000001 with final state: FINISHING, and exit status: -1000 2019-04-05 09:18:21,492 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0002_000001 State change from RUNNING to FINAL_SAVING on event = UNREGISTERED 2019-04-05 09:18:21,493 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0002 with final state: FINISHING 2019-04-05 09:18:21,493 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0002 State change from RUNNING to FINAL_SAVING on event = ATTEMPT_UNREGISTERED 2019-04-05 09:18:21,516 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000003 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:18:21,516 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0002 CONTAINERID=container_e30_1553788280931_0002_01_000003 RESOURCE= 2019-04-05 09:18:21,521 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0002 2019-04-05 09:18:21,522 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0002_000001 State change from FINAL_SAVING to FINISHING on event = ATTEMPT_UPDATE_SAVED 2019-04-05 09:18:21,529 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0002 State change from FINAL_SAVING to FINISHING on event = APP_UPDATE_SAVED 2019-04-05 09:18:22,497 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: application_1553788280931_0002 unregistered successfully. 2019-04-05 09:18:27,977 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0002_01_000001 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:18:27,978 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0002 CONTAINERID=container_e30_1553788280931_0002_01_000001 RESOURCE= 2019-04-05 09:18:27,979 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0002_000001 2019-04-05 09:18:27,979 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0002_000001 2019-04-05 09:18:27,979 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0002_000001 State change from FINISHING to FINISHED on event = CONTAINER_FINISHED 2019-04-05 09:18:27,982 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0002 State change from FINISHING to FINISHED on event = ATTEMPT_FINISHED 2019-04-05 09:18:27,983 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0002 2019-04-05 09:18:27,984 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0002,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553788280931_0002/,appMasterHost=yarn-ats-2,submitTime=1554455881193,startTime=1554455881197,finishTime=1554455901493,finalStatus=SUCCEEDED,memorySeconds=70428,vcoreSeconds=35,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=70428 MB-seconds\, 35 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 09:18:27,985 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0002_000001 is done. finalState=FINISHED 2019-04-05 09:18:27,985 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0002 requests cleared 2019-04-05 09:18:27,985 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0002 user: ambari-qa queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-04-05 09:18:27,985 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0002 user: ambari-qa leaf-queue of parent: root #applications: 0 2019-04-05 09:18:27,985 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0002_000001 2019-04-05 09:18:28,013 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0002 was removed 2019-04-05 09:18:29,503 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 3 2019-04-05 09:18:30,496 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0003' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 09:18:30,496 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0003 2019-04-05 09:18:30,497 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0003 was added 2019-04-05 09:18:30,497 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 3 submitted by user ambari-qa 2019-04-05 09:18:30,497 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0003 2019-04-05 09:18:30,499 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0003 2019-04-05 09:18:30,499 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0003 2019-04-05 09:18:30,499 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0003 State change from NEW to NEW_SAVING on event = START 2019-04-05 09:18:30,522 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0003 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 09:18:30,523 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0003 user: ambari-qa leaf-queue of parent: root #applications: 1 2019-04-05 09:18:30,523 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0003 from user: ambari-qa, in queue: default 2019-04-05 09:18:30,523 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0003 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 09:18:30,523 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0003_000001 2019-04-05 09:18:30,523 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0003_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 09:18:30,525 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0003 from user: ambari-qa activated in queue: default 2019-04-05 09:18:30,525 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0003 user: ambari-qa, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-04-05 09:18:30,525 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0003_000001 to scheduler from user ambari-qa in queue default 2019-04-05 09:18:30,527 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0003_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 09:18:30,540 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0003_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 09:18:30,541 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:18:30,541 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0003_01_000001 of capacity on host yarn-ats-1:45454, which has 1 containers, used and available after allocation 2019-04-05 09:18:30,541 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0003 CONTAINERID=container_e30_1553788280931_0003_01_000001 RESOURCE= 2019-04-05 09:18:30,541 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 09:18:30,541 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:18:30,544 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-1:45454 for container : container_e30_1553788280931_0003_01_000001 2019-04-05 09:18:30,545 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:18:30,545 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0003_000001 2019-04-05 09:18:30,546 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0003 AttemptId: appattempt_1553788280931_0003_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0003_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-1:45454, NodeHttpAddress: yarn-ats-1:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.91:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 09:18:30,546 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0003_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 09:18:30,554 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0003_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 09:18:30,554 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0003_000001 2019-04-05 09:18:30,557 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0003_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-1:45454, NodeHttpAddress: yarn-ats-1:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.91:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0003_000001 2019-04-05 09:18:30,557 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0003_000001 2019-04-05 09:18:30,557 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0003_000001 2019-04-05 09:18:30,706 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0003_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-1:45454, NodeHttpAddress: yarn-ats-1:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.91:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0003_000001 2019-04-05 09:18:30,707 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0003_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 09:18:30,707 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0003, attemptId: appattempt_1553788280931_0003_000001launchTime: 1554455910706 2019-04-05 09:18:31,539 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0003 with new address: yarn-ats-1:41535 timestamp: 1553788280931, 3 2019-04-05 09:18:31,542 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:18:32,547 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0003 with new address: yarn-ats-1:41535 timestamp: 1553788280931, 4 2019-04-05 09:18:36,200 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0003_000001 (auth:SIMPLE) 2019-04-05 09:18:36,212 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0003_000001 2019-04-05 09:18:36,212 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.91 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0003 APPATTEMPTID=appattempt_1553788280931_0003_000001 2019-04-05 09:18:36,213 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0003_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 09:18:36,214 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0003 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 09:18:37,576 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0003_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 09:18:37,577 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:18:37,578 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0003_01_000002 of capacity on host yarn-ats-1:45454, which has 2 containers, used and available after allocation 2019-04-05 09:18:37,578 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0003 CONTAINERID=container_e30_1553788280931_0003_01_000002 RESOURCE= 2019-04-05 09:18:37,578 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 09:18:37,579 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:18:38,333 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-1:45454 for container : container_e30_1553788280931_0003_01_000002 2019-04-05 09:18:38,334 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:18:39,364 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0003 2019-04-05 09:18:39,582 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:18:43,681 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000002 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:18:43,681 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0003 CONTAINERID=container_e30_1553788280931_0003_01_000002 RESOURCE= 2019-04-05 09:18:44,690 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0003_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 09:18:44,691 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:18:44,691 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0003_01_000003 of capacity on host yarn-ats-1:45454, which has 2 containers, used and available after allocation 2019-04-05 09:18:44,692 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0003 CONTAINERID=container_e30_1553788280931_0003_01_000003 RESOURCE= 2019-04-05 09:18:44,692 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 09:18:44,692 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:18:45,420 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:18:45,692 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:18:46,429 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0003 2019-04-05 09:18:48,869 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0003_000001 with final state: FINISHING, and exit status: -1000 2019-04-05 09:18:48,869 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0003_000001 State change from RUNNING to FINAL_SAVING on event = UNREGISTERED 2019-04-05 09:18:48,869 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0003 with final state: FINISHING 2019-04-05 09:18:48,869 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0003 State change from RUNNING to FINAL_SAVING on event = ATTEMPT_UNREGISTERED 2019-04-05 09:18:48,879 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0003 2019-04-05 09:18:48,880 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0003_000001 State change from FINAL_SAVING to FINISHING on event = ATTEMPT_UPDATE_SAVED 2019-04-05 09:18:48,881 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000003 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:18:48,881 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0003 CONTAINERID=container_e30_1553788280931_0003_01_000003 RESOURCE= 2019-04-05 09:18:48,904 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0003 State change from FINAL_SAVING to FINISHING on event = APP_UPDATE_SAVED 2019-04-05 09:18:49,872 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: application_1553788280931_0003 unregistered successfully. 2019-04-05 09:18:55,309 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0003_000001 2019-04-05 09:18:55,309 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0003_000001 2019-04-05 09:18:55,310 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0003_000001 State change from FINISHING to FINISHED on event = CONTAINER_FINISHED 2019-04-05 09:18:55,309 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0003_01_000001 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:18:55,311 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0003 CONTAINERID=container_e30_1553788280931_0003_01_000001 RESOURCE= 2019-04-05 09:18:55,314 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0003 State change from FINISHING to FINISHED on event = ATTEMPT_FINISHED 2019-04-05 09:18:55,314 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0003_000001 is done. finalState=FINISHED 2019-04-05 09:18:55,314 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0003 2019-04-05 09:18:55,314 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0003 requests cleared 2019-04-05 09:18:55,315 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0003 user: ambari-qa queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-04-05 09:18:55,316 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0003 user: ambari-qa leaf-queue of parent: root #applications: 0 2019-04-05 09:18:55,316 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0003,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553788280931_0003/,appMasterHost=yarn-ats-1,submitTime=1554455910495,startTime=1554455910496,finishTime=1554455928869,finalStatus=SUCCEEDED,memorySeconds=65564,vcoreSeconds=34,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=65564 MB-seconds\, 34 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 09:18:55,317 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0003_000001 2019-04-05 09:18:55,352 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0003 was removed 2019-04-05 09:23:03,684 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 4 2019-04-05 09:23:04,775 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0004' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 09:23:04,775 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0004 2019-04-05 09:23:04,777 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0004 was added 2019-04-05 09:23:04,778 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 4 submitted by user ambari-qa 2019-04-05 09:23:04,779 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0004 2019-04-05 09:23:04,780 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0004 2019-04-05 09:23:04,781 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0004 2019-04-05 09:23:04,781 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0004 State change from NEW to NEW_SAVING on event = START 2019-04-05 09:23:04,796 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0004 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 09:23:04,797 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0004 user: ambari-qa leaf-queue of parent: root #applications: 1 2019-04-05 09:23:04,797 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0004 from user: ambari-qa, in queue: default 2019-04-05 09:23:04,798 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0004 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 09:23:04,799 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0004_000001 2019-04-05 09:23:04,799 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0004_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 09:23:04,802 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0004 from user: ambari-qa activated in queue: default 2019-04-05 09:23:04,802 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0004 user: ambari-qa, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-04-05 09:23:04,802 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0004_000001 to scheduler from user ambari-qa in queue default 2019-04-05 09:23:04,804 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0004_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 09:23:04,832 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0004_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 09:23:04,833 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:23:04,833 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0004_01_000001 of capacity on host yarn-ats-2:45454, which has 1 containers, used and available after allocation 2019-04-05 09:23:04,833 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0004 CONTAINERID=container_e30_1553788280931_0004_01_000001 RESOURCE= 2019-04-05 09:23:04,834 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 09:23:04,834 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:23:04,841 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-2:45454 for container : container_e30_1553788280931_0004_01_000001 2019-04-05 09:23:04,842 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:23:04,842 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0004_000001 2019-04-05 09:23:04,842 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0004 AttemptId: appattempt_1553788280931_0004_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0004_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 09:23:04,843 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0004_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 09:23:04,854 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0004_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 09:23:04,854 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0004_000001 2019-04-05 09:23:04,861 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0004_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0004_000001 2019-04-05 09:23:04,862 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0004_000001 2019-04-05 09:23:04,862 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0004_000001 2019-04-05 09:23:04,996 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0004_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0004_000001 2019-04-05 09:23:04,997 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0004_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 09:23:04,997 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0004, attemptId: appattempt_1553788280931_0004_000001launchTime: 1554456184997 2019-04-05 09:23:05,833 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0004 with new address: yarn-ats-2:44543 timestamp: 1553788280931, 5 2019-04-05 09:23:05,835 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:23:06,838 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0004 with new address: yarn-ats-2:44543 timestamp: 1553788280931, 6 2019-04-05 09:23:10,412 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0004_000001 (auth:SIMPLE) 2019-04-05 09:23:10,422 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0004_000001 2019-04-05 09:23:10,422 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.92 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0004 APPATTEMPTID=appattempt_1553788280931_0004_000001 2019-04-05 09:23:10,423 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0004_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 09:23:10,423 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0004 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 09:23:11,804 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0004_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 09:23:11,805 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:23:11,805 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0004_01_000002 of capacity on host yarn-ats-1:45454, which has 1 containers, used and available after allocation 2019-04-05 09:23:11,805 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0004 CONTAINERID=container_e30_1553788280931_0004_01_000002 RESOURCE= 2019-04-05 09:23:11,805 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 09:23:11,805 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:23:12,522 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-1:45454 for container : container_e30_1553788280931_0004_01_000002 2019-04-05 09:23:12,523 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:23:13,554 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0004 2019-04-05 09:23:13,809 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:23:17,787 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000002 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:23:17,787 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0004 CONTAINERID=container_e30_1553788280931_0004_01_000002 RESOURCE= 2019-04-05 09:23:18,789 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0004_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 09:23:18,790 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:23:18,791 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0004_01_000003 of capacity on host yarn-ats-1:45454, which has 1 containers, used and available after allocation 2019-04-05 09:23:18,791 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0004 CONTAINERID=container_e30_1553788280931_0004_01_000003 RESOURCE= 2019-04-05 09:23:18,791 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 09:23:18,791 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:23:19,603 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:23:19,791 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:23:20,613 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0004 2019-04-05 09:23:23,132 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0004_000001 with final state: FINISHING, and exit status: -1000 2019-04-05 09:23:23,132 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0004_000001 State change from RUNNING to FINAL_SAVING on event = UNREGISTERED 2019-04-05 09:23:23,132 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0004 with final state: FINISHING 2019-04-05 09:23:23,133 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0004 State change from RUNNING to FINAL_SAVING on event = ATTEMPT_UNREGISTERED 2019-04-05 09:23:23,144 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0004 2019-04-05 09:23:23,145 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0004_000001 State change from FINAL_SAVING to FINISHING on event = ATTEMPT_UPDATE_SAVED 2019-04-05 09:23:23,148 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000003 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:23:23,148 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0004 CONTAINERID=container_e30_1553788280931_0004_01_000003 RESOURCE= 2019-04-05 09:23:23,174 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0004 State change from FINAL_SAVING to FINISHING on event = APP_UPDATE_SAVED 2019-04-05 09:23:24,138 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: application_1553788280931_0004 unregistered successfully. 2019-04-05 09:23:29,595 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0004_01_000001 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:23:29,595 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0004_000001 2019-04-05 09:23:29,595 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0004 CONTAINERID=container_e30_1553788280931_0004_01_000001 RESOURCE= 2019-04-05 09:23:29,595 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0004_000001 2019-04-05 09:23:29,596 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0004_000001 State change from FINISHING to FINISHED on event = CONTAINER_FINISHED 2019-04-05 09:23:29,598 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0004 State change from FINISHING to FINISHED on event = ATTEMPT_FINISHED 2019-04-05 09:23:29,598 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0004_000001 is done. finalState=FINISHED 2019-04-05 09:23:29,598 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0004 2019-04-05 09:23:29,598 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0004 requests cleared 2019-04-05 09:23:29,599 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0004 user: ambari-qa queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-04-05 09:23:29,599 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0004 user: ambari-qa leaf-queue of parent: root #applications: 0 2019-04-05 09:23:29,599 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0004,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553788280931_0004/,appMasterHost=yarn-ats-2,submitTime=1554456184772,startTime=1554456184776,finishTime=1554456203132,finalStatus=SUCCEEDED,memorySeconds=65765,vcoreSeconds=33,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=65765 MB-seconds\, 33 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 09:23:29,600 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0004_000001 2019-04-05 09:23:29,634 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0004 was removed 2019-04-05 09:27:53,226 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Reconnect from the node at: yarn-ats-1 2019-04-05 09:27:53,266 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: NodeManager from node yarn-ats-1(cmPort: 45454 httpPort: 8042) registered with capability: , assigned nodeId yarn-ats-1:45454 2019-04-05 09:27:53,278 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Removed node yarn-ats-1:45454 clusterResource: 2019-04-05 09:27:53,280 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added node yarn-ats-1:45454 clusterResource: 2019-04-05 09:28:12,343 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 5 2019-04-05 09:28:13,402 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0005' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 09:28:13,403 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0005 2019-04-05 09:28:13,405 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0005 was added 2019-04-05 09:28:13,405 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 5 submitted by user ambari-qa 2019-04-05 09:28:13,406 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0005 2019-04-05 09:28:13,406 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0005 2019-04-05 09:28:13,408 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0005 2019-04-05 09:28:13,409 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0005 State change from NEW to NEW_SAVING on event = START 2019-04-05 09:28:13,420 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0005 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 09:28:13,421 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0005 user: ambari-qa leaf-queue of parent: root #applications: 1 2019-04-05 09:28:13,421 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0005 from user: ambari-qa, in queue: default 2019-04-05 09:28:13,423 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0005 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 09:28:13,423 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0005_000001 2019-04-05 09:28:13,423 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0005_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 09:28:13,425 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0005 from user: ambari-qa activated in queue: default 2019-04-05 09:28:13,425 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0005 user: ambari-qa, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-04-05 09:28:13,425 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0005_000001 to scheduler from user ambari-qa in queue default 2019-04-05 09:28:13,428 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0005_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 09:28:13,731 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0005_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 09:28:13,732 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:28:13,732 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0005_01_000001 of capacity on host yarn-ats-3:45454, which has 1 containers, used and available after allocation 2019-04-05 09:28:13,732 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0005 CONTAINERID=container_e30_1553788280931_0005_01_000001 RESOURCE= 2019-04-05 09:28:13,733 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 09:28:13,733 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:28:13,735 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-3:45454 for container : container_e30_1553788280931_0005_01_000001 2019-04-05 09:28:13,736 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:28:13,736 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0005_000001 2019-04-05 09:28:13,736 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0005 AttemptId: appattempt_1553788280931_0005_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0005_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 09:28:13,737 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0005_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 09:28:13,747 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0005_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 09:28:13,748 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0005_000001 2019-04-05 09:28:13,753 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0005_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0005_000001 2019-04-05 09:28:13,753 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0005_000001 2019-04-05 09:28:13,753 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0005_000001 2019-04-05 09:28:14,451 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0005_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0005_000001 2019-04-05 09:28:14,452 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0005_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 09:28:14,452 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0005, attemptId: appattempt_1553788280931_0005_000001launchTime: 1554456494452 2019-04-05 09:28:14,750 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0005 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 7 2019-04-05 09:28:14,752 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:28:15,755 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0005 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 8 2019-04-05 09:28:20,897 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0005_000001 (auth:SIMPLE) 2019-04-05 09:28:20,911 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0005_000001 2019-04-05 09:28:20,911 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0005 APPATTEMPTID=appattempt_1553788280931_0005_000001 2019-04-05 09:28:20,912 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0005_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 09:28:20,912 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0005 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 09:28:22,435 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0005_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 09:28:22,435 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:28:22,436 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0005_01_000002 of capacity on host yarn-ats-2:45454, which has 1 containers, used and available after allocation 2019-04-05 09:28:22,436 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0005 CONTAINERID=container_e30_1553788280931_0005_01_000002 RESOURCE= 2019-04-05 09:28:22,436 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 09:28:22,436 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:28:23,005 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-2:45454 for container : container_e30_1553788280931_0005_01_000002 2019-04-05 09:28:23,006 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:28:23,437 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:28:24,041 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0005 2019-04-05 09:28:28,085 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000002 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:28:28,086 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0005 CONTAINERID=container_e30_1553788280931_0005_01_000002 RESOURCE= 2019-04-05 09:28:29,089 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0005_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 09:28:29,091 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:28:29,091 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0005_01_000003 of capacity on host yarn-ats-2:45454, which has 1 containers, used and available after allocation 2019-04-05 09:28:29,091 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0005 CONTAINERID=container_e30_1553788280931_0005_01_000003 RESOURCE= 2019-04-05 09:28:29,091 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 09:28:29,092 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:28:30,099 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:28:31,096 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:28:31,110 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0005 2019-04-05 09:28:33,402 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0005_000001 with final state: FINISHING, and exit status: -1000 2019-04-05 09:28:33,402 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0005_000001 State change from RUNNING to FINAL_SAVING on event = UNREGISTERED 2019-04-05 09:28:33,402 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0005 with final state: FINISHING 2019-04-05 09:28:33,403 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0005 State change from RUNNING to FINAL_SAVING on event = ATTEMPT_UNREGISTERED 2019-04-05 09:28:33,415 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0005 2019-04-05 09:28:33,416 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0005_000001 State change from FINAL_SAVING to FINISHING on event = ATTEMPT_UPDATE_SAVED 2019-04-05 09:28:33,416 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000003 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:28:33,417 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0005 CONTAINERID=container_e30_1553788280931_0005_01_000003 RESOURCE= 2019-04-05 09:28:33,428 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0005 State change from FINAL_SAVING to FINISHING on event = APP_UPDATE_SAVED 2019-04-05 09:28:34,407 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: application_1553788280931_0005 unregistered successfully. 2019-04-05 09:28:39,872 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0005_000001 2019-04-05 09:28:39,873 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0005_01_000001 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:28:39,873 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0005_000001 2019-04-05 09:28:39,873 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0005 CONTAINERID=container_e30_1553788280931_0005_01_000001 RESOURCE= 2019-04-05 09:28:39,874 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0005_000001 State change from FINISHING to FINISHED on event = CONTAINER_FINISHED 2019-04-05 09:28:39,878 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0005 State change from FINISHING to FINISHED on event = ATTEMPT_FINISHED 2019-04-05 09:28:39,878 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0005_000001 is done. finalState=FINISHED 2019-04-05 09:28:39,879 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0005 requests cleared 2019-04-05 09:28:39,879 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0005 2019-04-05 09:28:39,880 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0005 user: ambari-qa queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-04-05 09:28:39,880 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0005 user: ambari-qa leaf-queue of parent: root #applications: 0 2019-04-05 09:28:39,880 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0005,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553788280931_0005/,appMasterHost=yarn-ats-3,submitTime=1554456493399,startTime=1554456493403,finishTime=1554456513402,finalStatus=SUCCEEDED,memorySeconds=68185,vcoreSeconds=35,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=68185 MB-seconds\, 35 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 09:28:39,881 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0005_000001 2019-04-05 09:28:39,911 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0005 was removed 2019-04-05 09:35:58,229 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 6 2019-04-05 09:35:59,393 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0006' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 09:35:59,394 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0006 2019-04-05 09:35:59,396 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0006 was added 2019-04-05 09:35:59,396 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 6 submitted by user ambari-qa 2019-04-05 09:35:59,397 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0006 2019-04-05 09:35:59,397 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0006 2019-04-05 09:35:59,402 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0006 2019-04-05 09:35:59,402 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0006 State change from NEW to NEW_SAVING on event = START 2019-04-05 09:35:59,414 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0006 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 09:35:59,415 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0006 user: ambari-qa leaf-queue of parent: root #applications: 1 2019-04-05 09:35:59,415 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0006 from user: ambari-qa, in queue: default 2019-04-05 09:35:59,417 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0006 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 09:35:59,417 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0006_000001 2019-04-05 09:35:59,418 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0006_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 09:35:59,419 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0006 from user: ambari-qa activated in queue: default 2019-04-05 09:35:59,419 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0006 user: ambari-qa, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-04-05 09:35:59,420 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0006_000001 to scheduler from user ambari-qa in queue default 2019-04-05 09:35:59,423 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0006_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 09:35:59,529 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0006_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 09:35:59,530 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:35:59,530 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0006_01_000001 of capacity on host yarn-ats-2:45454, which has 1 containers, used and available after allocation 2019-04-05 09:35:59,530 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0006 CONTAINERID=container_e30_1553788280931_0006_01_000001 RESOURCE= 2019-04-05 09:35:59,534 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-2:45454 for container : container_e30_1553788280931_0006_01_000001 2019-04-05 09:35:59,535 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:35:59,535 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0006_000001 2019-04-05 09:35:59,536 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0006 AttemptId: appattempt_1553788280931_0006_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0006_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 09:35:59,536 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 09:35:59,537 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:35:59,537 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0006_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 09:35:59,545 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0006_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 09:35:59,546 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0006_000001 2019-04-05 09:35:59,551 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0006_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0006_000001 2019-04-05 09:35:59,551 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0006_000001 2019-04-05 09:35:59,551 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0006_000001 2019-04-05 09:35:59,654 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0006_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0006_000001 2019-04-05 09:35:59,654 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0006_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 09:35:59,654 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0006, attemptId: appattempt_1553788280931_0006_000001launchTime: 1554456959654 2019-04-05 09:36:00,527 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0006 with new address: yarn-ats-2:44543 timestamp: 1553788280931, 9 2019-04-05 09:36:00,528 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:36:01,532 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0006 with new address: yarn-ats-2:44543 timestamp: 1553788280931, 10 2019-04-05 09:36:05,039 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0006_000001 (auth:SIMPLE) 2019-04-05 09:36:05,048 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0006_000001 2019-04-05 09:36:05,049 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.92 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0006 APPATTEMPTID=appattempt_1553788280931_0006_000001 2019-04-05 09:36:05,051 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0006_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 09:36:05,051 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0006 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 09:36:06,564 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0006_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 09:36:06,565 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:36:06,565 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0006_01_000002 of capacity on host yarn-ats-2:45454, which has 2 containers, used and available after allocation 2019-04-05 09:36:06,565 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0006 CONTAINERID=container_e30_1553788280931_0006_01_000002 RESOURCE= 2019-04-05 09:36:06,565 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 09:36:06,565 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:36:07,148 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-2:45454 for container : container_e30_1553788280931_0006_01_000002 2019-04-05 09:36:07,150 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:36:07,563 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:36:08,185 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0006 2019-04-05 09:36:11,718 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000002 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:36:11,718 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0006 CONTAINERID=container_e30_1553788280931_0006_01_000002 RESOURCE= 2019-04-05 09:36:12,666 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0006_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 09:36:12,667 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 09:36:12,667 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0006_01_000003 of capacity on host yarn-ats-1:45454, which has 1 containers, used and available after allocation 2019-04-05 09:36:12,667 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0006 CONTAINERID=container_e30_1553788280931_0006_01_000003 RESOURCE= 2019-04-05 09:36:12,668 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 09:36:12,668 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 09:36:13,241 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-1:45454 for container : container_e30_1553788280931_0006_01_000003 2019-04-05 09:36:13,242 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 09:36:13,704 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 09:36:14,255 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0006 2019-04-05 09:36:18,140 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0006_000001 with final state: FINISHING, and exit status: -1000 2019-04-05 09:36:18,141 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0006_000001 State change from RUNNING to FINAL_SAVING on event = UNREGISTERED 2019-04-05 09:36:18,141 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0006 with final state: FINISHING 2019-04-05 09:36:18,141 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0006 State change from RUNNING to FINAL_SAVING on event = ATTEMPT_UNREGISTERED 2019-04-05 09:36:18,164 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0006 2019-04-05 09:36:18,166 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0006_000001 State change from FINAL_SAVING to FINISHING on event = ATTEMPT_UPDATE_SAVED 2019-04-05 09:36:18,172 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0006 State change from FINAL_SAVING to FINISHING on event = APP_UPDATE_SAVED 2019-04-05 09:36:18,189 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000003 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:36:18,189 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0006 CONTAINERID=container_e30_1553788280931_0006_01_000003 RESOURCE= 2019-04-05 09:36:19,146 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: application_1553788280931_0006 unregistered successfully. 2019-04-05 09:36:24,584 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0006_000001 2019-04-05 09:36:24,585 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0006_01_000001 Container Transitioned from RUNNING to COMPLETED 2019-04-05 09:36:24,585 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0006_000001 2019-04-05 09:36:24,585 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0006 CONTAINERID=container_e30_1553788280931_0006_01_000001 RESOURCE= 2019-04-05 09:36:24,585 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0006_000001 State change from FINISHING to FINISHED on event = CONTAINER_FINISHED 2019-04-05 09:36:24,590 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0006 State change from FINISHING to FINISHED on event = ATTEMPT_FINISHED 2019-04-05 09:36:24,590 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0006_000001 is done. finalState=FINISHED 2019-04-05 09:36:24,590 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0006 2019-04-05 09:36:24,590 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0006 requests cleared 2019-04-05 09:36:24,590 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0006 user: ambari-qa queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-04-05 09:36:24,590 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0006 user: ambari-qa leaf-queue of parent: root #applications: 0 2019-04-05 09:36:24,591 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0006,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553788280931_0006/,appMasterHost=yarn-ats-2,submitTime=1554456959391,startTime=1554456959394,finishTime=1554456978141,finalStatus=SUCCEEDED,memorySeconds=67899,vcoreSeconds=35,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=67899 MB-seconds\, 35 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 09:36:24,592 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0006_000001 2019-04-05 09:36:24,625 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0006 was removed 2019-04-05 14:23:00,510 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 7 2019-04-05 14:23:01,364 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0007' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 14:23:01,364 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0007 2019-04-05 14:23:01,366 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0007 was added 2019-04-05 14:23:01,367 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 7 submitted by user ambari-qa 2019-04-05 14:23:01,367 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0007 CALLERCONTEXT=CLI 2019-04-05 14:23:01,367 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0007 2019-04-05 14:23:01,376 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0007 State change from NEW to NEW_SAVING on event = START 2019-04-05 14:23:01,376 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0007 2019-04-05 14:23:01,399 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0007 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 14:23:01,400 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0007 user: ambari-qa leaf-queue of parent: root #applications: 1 2019-04-05 14:23:01,401 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0007 from user: ambari-qa, in queue: default 2019-04-05 14:23:01,401 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0007 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 14:23:01,402 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0007_000001 2019-04-05 14:23:01,402 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0007_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 14:23:01,404 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0007 from user: ambari-qa activated in queue: default 2019-04-05 14:23:01,404 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0007 user: ambari-qa, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-04-05 14:23:01,404 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0007_000001 to scheduler from user ambari-qa in queue default 2019-04-05 14:23:01,407 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0007_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 14:23:01,945 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0007_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 14:23:01,946 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:23:01,946 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0007_01_000001 of capacity on host yarn-ats-2:45454, which has 1 containers, used and available after allocation 2019-04-05 14:23:01,947 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0007 CONTAINERID=container_e30_1553788280931_0007_01_000001 RESOURCE= 2019-04-05 14:23:01,949 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-2:45454 for container : container_e30_1553788280931_0007_01_000001 2019-04-05 14:23:01,950 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:23:01,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0007_000001 2019-04-05 14:23:01,951 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 14:23:01,951 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:23:01,951 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0007 AttemptId: appattempt_1553788280931_0007_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0007_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 14:23:01,951 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0007_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 14:23:01,960 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0007_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 14:23:01,961 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0007_000001 2019-04-05 14:23:01,964 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0007_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0007_000001 2019-04-05 14:23:01,965 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0007_000001 2019-04-05 14:23:01,965 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0007_000001 2019-04-05 14:23:02,074 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0007_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-2:45454, NodeHttpAddress: yarn-ats-2:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.92:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0007_000001 2019-04-05 14:23:02,075 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0007_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 14:23:02,075 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0007, attemptId: appattempt_1553788280931_0007_000001launchTime: 1554474182075 2019-04-05 14:23:02,945 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0007 with new address: yarn-ats-2:44543 timestamp: 1553788280931, 11 2019-04-05 14:23:02,948 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:23:03,951 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0007 with new address: yarn-ats-2:44543 timestamp: 1553788280931, 12 2019-04-05 14:23:07,202 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0007_000001 (auth:SIMPLE) 2019-04-05 14:23:07,211 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0007_000001 2019-04-05 14:23:07,211 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.92 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0007 APPATTEMPTID=appattempt_1553788280931_0007_000001 2019-04-05 14:23:07,211 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0007_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 14:23:07,211 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0007 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 14:23:08,369 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0007_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 14:23:08,370 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:23:08,370 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0007_01_000002 of capacity on host yarn-ats-1:45454, which has 1 containers, used and available after allocation 2019-04-05 14:23:08,370 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0007 CONTAINERID=container_e30_1553788280931_0007_01_000002 RESOURCE= 2019-04-05 14:23:08,371 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 14:23:08,371 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:23:08,372 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0007_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 14:23:08,372 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:23:08,372 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0007_01_000003 of capacity on host yarn-ats-1:45454, which has 2 containers, used and available after allocation 2019-04-05 14:23:08,372 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0007 CONTAINERID=container_e30_1553788280931_0007_01_000003 RESOURCE= 2019-04-05 14:23:08,373 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 14:23:08,373 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:23:09,317 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-1:45454 for container : container_e30_1553788280931_0007_01_000002 2019-04-05 14:23:09,320 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:23:09,321 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:23:10,359 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0007 2019-04-05 14:23:10,371 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:23:10,371 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:23:15,927 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000003 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:23:15,928 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0007 CONTAINERID=container_e30_1553788280931_0007_01_000003 RESOURCE= 2019-04-05 14:23:15,933 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000002 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:23:15,933 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0007 CONTAINERID=container_e30_1553788280931_0007_01_000002 RESOURCE= 2019-04-05 14:23:16,932 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0007_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 14:23:16,933 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000004 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:23:16,933 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0007_01_000004 of capacity on host yarn-ats-1:45454, which has 1 containers, used and available after allocation 2019-04-05 14:23:16,933 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0007 CONTAINERID=container_e30_1553788280931_0007_01_000004 RESOURCE= 2019-04-05 14:23:16,934 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 14:23:16,934 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:23:17,429 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000004 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:23:17,934 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000004 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:23:18,442 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0007 2019-04-05 14:23:21,013 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0007_000001 with final state: FINISHING, and exit status: -1000 2019-04-05 14:23:21,013 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0007_000001 State change from RUNNING to FINAL_SAVING on event = UNREGISTERED 2019-04-05 14:23:21,013 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0007 with final state: FINISHING 2019-04-05 14:23:21,014 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0007 State change from RUNNING to FINAL_SAVING on event = ATTEMPT_UNREGISTERED 2019-04-05 14:23:21,066 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0007 2019-04-05 14:23:21,066 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0007_000001 State change from FINAL_SAVING to FINISHING on event = ATTEMPT_UPDATE_SAVED 2019-04-05 14:23:21,078 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000004 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:23:21,078 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0007 CONTAINERID=container_e30_1553788280931_0007_01_000004 RESOURCE= 2019-04-05 14:23:21,095 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0007 State change from FINAL_SAVING to FINISHING on event = APP_UPDATE_SAVED 2019-04-05 14:23:22,017 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: application_1553788280931_0007 unregistered successfully. 2019-04-05 14:23:27,481 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0007_01_000001 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:23:27,481 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0007 CONTAINERID=container_e30_1553788280931_0007_01_000001 RESOURCE= 2019-04-05 14:23:27,483 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0007_000001 2019-04-05 14:23:27,483 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0007_000001 2019-04-05 14:23:27,483 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0007_000001 State change from FINISHING to FINISHED on event = CONTAINER_FINISHED 2019-04-05 14:23:27,486 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0007 State change from FINISHING to FINISHED on event = ATTEMPT_FINISHED 2019-04-05 14:23:27,486 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0007_000001 is done. finalState=FINISHED 2019-04-05 14:23:27,486 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0007 2019-04-05 14:23:27,486 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0007 requests cleared 2019-04-05 14:23:27,486 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0007 user: ambari-qa queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-04-05 14:23:27,487 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0007,name=QuasiMonteCarlo,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553788280931_0007/,appMasterHost=yarn-ats-2,submitTime=1554474181361,startTime=1554474181365,finishTime=1554474201013,finalStatus=SUCCEEDED,memorySeconds=76268,vcoreSeconds=43,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=76268 MB-seconds\, 43 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 14:23:27,487 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0007 user: ambari-qa leaf-queue of parent: root #applications: 0 2019-04-05 14:23:27,487 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0007_000001 2019-04-05 14:23:27,521 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0007 was removed 2019-04-05 14:23:38,930 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 8 2019-04-05 14:23:39,753 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0008' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 14:23:39,753 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0008 2019-04-05 14:23:39,754 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0008 was added 2019-04-05 14:23:39,754 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 8 submitted by user ambari-qa 2019-04-05 14:23:39,754 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0008 CALLERCONTEXT=CLI 2019-04-05 14:23:39,755 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0008 2019-04-05 14:23:39,756 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0008 2019-04-05 14:23:39,756 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0008 State change from NEW to NEW_SAVING on event = START 2019-04-05 14:23:39,770 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0008 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 14:23:39,770 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0008 user: ambari-qa leaf-queue of parent: root #applications: 1 2019-04-05 14:23:39,770 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0008 from user: ambari-qa, in queue: default 2019-04-05 14:23:39,772 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0008 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 14:23:39,772 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0008_000001 2019-04-05 14:23:39,773 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0008_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 14:23:39,774 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0008 from user: ambari-qa activated in queue: default 2019-04-05 14:23:39,774 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0008 user: ambari-qa, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-04-05 14:23:39,774 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0008_000001 to scheduler from user ambari-qa in queue default 2019-04-05 14:23:39,777 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0008_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 14:23:40,021 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0008_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 14:23:40,022 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:23:40,022 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0008_01_000001 of capacity on host yarn-ats-3:45454, which has 1 containers, used and available after allocation 2019-04-05 14:23:40,022 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0008 CONTAINERID=container_e30_1553788280931_0008_01_000001 RESOURCE= 2019-04-05 14:23:40,022 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 14:23:40,023 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:23:40,024 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-3:45454 for container : container_e30_1553788280931_0008_01_000001 2019-04-05 14:23:40,025 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:23:40,025 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0008_000001 2019-04-05 14:23:40,025 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0008 AttemptId: appattempt_1553788280931_0008_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0008_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 14:23:40,026 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0008_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 14:23:40,034 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0008_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 14:23:40,035 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0008_000001 2019-04-05 14:23:40,037 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0008_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0008_000001 2019-04-05 14:23:40,037 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0008_000001 2019-04-05 14:23:40,037 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0008_000001 2019-04-05 14:23:40,190 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0008_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0008_000001 2019-04-05 14:23:40,190 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0008_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 14:23:40,190 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0008, attemptId: appattempt_1553788280931_0008_000001launchTime: 1554474220190 2019-04-05 14:23:41,023 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0008 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 13 2019-04-05 14:23:41,025 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:23:42,027 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0008 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 14 2019-04-05 14:23:45,893 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0008_000001 (auth:SIMPLE) 2019-04-05 14:23:45,907 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0008_000001 2019-04-05 14:23:45,907 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0008 APPATTEMPTID=appattempt_1553788280931_0008_000001 2019-04-05 14:23:45,907 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0008_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 14:23:45,907 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0008 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 14:23:47,043 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0008_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 14:23:47,044 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:23:47,044 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0008_01_000002 of capacity on host yarn-ats-3:45454, which has 2 containers, used and available after allocation 2019-04-05 14:23:47,044 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0008 CONTAINERID=container_e30_1553788280931_0008_01_000002 RESOURCE= 2019-04-05 14:23:47,046 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 14:23:47,046 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:23:47,046 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0008_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 14:23:47,047 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:23:47,047 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0008_01_000003 of capacity on host yarn-ats-3:45454, which has 3 containers, used and available after allocation 2019-04-05 14:23:47,047 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0008 CONTAINERID=container_e30_1553788280931_0008_01_000003 RESOURCE= 2019-04-05 14:23:47,047 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 14:23:47,047 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:23:48,018 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-3:45454 for container : container_e30_1553788280931_0008_01_000002 2019-04-05 14:23:48,019 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:23:48,020 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:23:49,055 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:23:49,056 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:23:49,057 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0008 2019-04-05 14:36:29,188 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 9 2019-04-05 14:36:30,074 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0009' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 14:36:30,075 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0009 2019-04-05 14:36:30,076 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0009 was added 2019-04-05 14:36:30,077 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 9 submitted by user ambari-qa 2019-04-05 14:36:30,077 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0009 CALLERCONTEXT=CLI 2019-04-05 14:36:30,077 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0009 2019-04-05 14:36:30,082 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0009 2019-04-05 14:36:30,082 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0009 State change from NEW to NEW_SAVING on event = START 2019-04-05 14:36:30,131 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0009 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 14:36:30,132 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0009 user: ambari-qa leaf-queue of parent: root #applications: 2 2019-04-05 14:36:30,132 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0009 from user: ambari-qa, in queue: default 2019-04-05 14:36:30,132 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0009 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 14:36:30,132 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0009_000001 2019-04-05 14:36:30,132 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0009_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 14:36:30,134 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0009 user: ambari-qa, leaf-queue: default #user-pending-applications: 1 #user-active-applications: 1 #queue-pending-applications: 1 #queue-active-applications: 1 2019-04-05 14:36:30,134 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0009_000001 to scheduler from user ambari-qa in queue default 2019-04-05 14:36:30,136 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0009_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 14:38:15,884 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 10 2019-04-05 14:38:16,905 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0010' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 14:38:16,905 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0010 2019-04-05 14:38:16,906 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0010 was added 2019-04-05 14:38:16,906 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 10 submitted by user ambari-qa 2019-04-05 14:38:16,906 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0010 2019-04-05 14:38:16,908 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0010 2019-04-05 14:38:16,909 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0010 2019-04-05 14:38:16,909 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0010 State change from NEW to NEW_SAVING on event = START 2019-04-05 14:38:16,930 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0010 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 14:38:16,931 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0010 user: ambari-qa leaf-queue of parent: root #applications: 3 2019-04-05 14:38:16,931 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0010 from user: ambari-qa, in queue: default 2019-04-05 14:38:16,932 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0010 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 14:38:16,932 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0010_000001 2019-04-05 14:38:16,932 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0010_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 14:38:16,934 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0010 user: ambari-qa, leaf-queue: default #user-pending-applications: 2 #user-active-applications: 1 #queue-pending-applications: 2 #queue-active-applications: 1 2019-04-05 14:38:16,934 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0010_000001 to scheduler from user ambari-qa in queue default 2019-04-05 14:38:16,936 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0010_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 14:44:02,817 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=dr.who OPERATION=Get Applications Request TARGET=ClientRMService RESULT=SUCCESS 2019-04-05 14:44:32,569 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=dr.who OPERATION=Kill Application Request TARGET=RMAppImpl RESULT=SUCCESS APPID=application_1553788280931_0008 2019-04-05 14:44:32,570 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0008 State change from RUNNING to KILLING on event = KILL 2019-04-05 14:44:32,571 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0008_000001 with final state: KILLED, and exit status: -1000 2019-04-05 14:44:32,571 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0008_000001 State change from RUNNING to FINAL_SAVING on event = KILL 2019-04-05 14:44:32,606 WARN org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: appattempt_1553788280931_0008_000001 is in FINAL_SAVING state, ignore container allocate request. 2019-04-05 14:44:32,610 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0008_000001 2019-04-05 14:44:32,610 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0008_000001 2019-04-05 14:44:32,611 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0008_000001 State change from FINAL_SAVING to KILLED on event = ATTEMPT_UPDATE_SAVED 2019-04-05 14:44:32,611 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0008 with final state: KILLED 2019-04-05 14:44:32,611 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0008 State change from KILLING to FINAL_SAVING on event = ATTEMPT_KILLED 2019-04-05 14:44:32,611 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0008 2019-04-05 14:44:32,612 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0008_000001 is done. finalState=KILLED 2019-04-05 14:44:32,614 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0008_000001 2019-04-05 14:44:32,616 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000002 Container Transitioned from RUNNING to KILLED 2019-04-05 14:44:32,616 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0008 CONTAINERID=container_e30_1553788280931_0008_01_000002 RESOURCE= 2019-04-05 14:44:32,617 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000003 Container Transitioned from RUNNING to KILLED 2019-04-05 14:44:32,617 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0008 CONTAINERID=container_e30_1553788280931_0008_01_000003 RESOURCE= 2019-04-05 14:44:32,618 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0008_01_000001 Container Transitioned from RUNNING to KILLED 2019-04-05 14:44:32,618 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0008 CONTAINERID=container_e30_1553788280931_0008_01_000001 RESOURCE= 2019-04-05 14:44:32,618 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0008 requests cleared 2019-04-05 14:44:32,619 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0009 from user: ambari-qa activated in queue: default 2019-04-05 14:44:32,619 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0008 user: ambari-qa queue: default #user-pending-applications: 1 #user-active-applications: 1 #queue-pending-applications: 1 #queue-active-applications: 1 2019-04-05 14:44:32,626 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0008 State change from FINAL_SAVING to KILLED on event = APP_UPDATE_SAVED 2019-04-05 14:44:32,626 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Killed TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0008 2019-04-05 14:44:32,626 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0008 user: ambari-qa leaf-queue of parent: root #applications: 2 2019-04-05 14:44:32,627 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0008,name=QuasiMonteCarlo,user=ambari-qa,queue=default,state=KILLED,trackingUrl=http://yarn-ats-1:8088/cluster/app/application_1553788280931_0008,appMasterHost=N/A,submitTime=1554474219752,startTime=1554474219753,finishTime=1554475472611,finalStatus=KILLED,memorySeconds=5116246,vcoreSeconds=3742,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=5116246 MB-seconds\, 3742 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 14:44:32,693 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0008 was removed 2019-04-05 14:44:32,738 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Container container_e30_1553788280931_0008_01_000001 completed with event FINISHED, but corresponding RMContainer doesn't exist. 2019-04-05 14:44:32,741 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0009_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 14:44:32,742 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:44:32,742 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0009_01_000001 of capacity on host yarn-ats-3:45454, which has 3 containers, used and available after allocation 2019-04-05 14:44:32,742 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0009 CONTAINERID=container_e30_1553788280931_0009_01_000001 RESOURCE= 2019-04-05 14:44:32,790 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-3:45454 for container : container_e30_1553788280931_0009_01_000001 2019-04-05 14:44:32,792 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:44:32,792 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0009_000001 2019-04-05 14:44:32,792 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0009 AttemptId: appattempt_1553788280931_0009_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0009_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 14:44:32,792 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 14:44:32,793 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:44:32,793 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0009_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 14:44:32,806 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0009_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 14:44:32,807 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0009_000001 2019-04-05 14:44:32,810 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0009_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0009_000001 2019-04-05 14:44:32,811 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0009_000001 2019-04-05 14:44:32,811 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0009_000001 2019-04-05 14:44:32,832 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Container container_e30_1553788280931_0008_01_000002 completed with event FINISHED, but corresponding RMContainer doesn't exist. 2019-04-05 14:44:32,832 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Container container_e30_1553788280931_0008_01_000001 completed with event FINISHED, but corresponding RMContainer doesn't exist. 2019-04-05 14:44:32,854 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Container container_e30_1553788280931_0008_01_000003 completed with event FINISHED, but corresponding RMContainer doesn't exist. 2019-04-05 14:44:33,028 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0009_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0009_000001 2019-04-05 14:44:33,028 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0009_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 14:44:33,028 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0009, attemptId: appattempt_1553788280931_0009_000001launchTime: 1554475473028 2019-04-05 14:44:33,860 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0009 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 15 2019-04-05 14:44:33,862 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:44:34,866 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0009 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 16 2019-04-05 14:44:35,956 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=dr.who OPERATION=Get Applications Request TARGET=ClientRMService RESULT=SUCCESS 2019-04-05 14:44:38,602 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0009_000001 (auth:SIMPLE) 2019-04-05 14:44:38,612 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0009_000001 2019-04-05 14:44:38,612 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0009 APPATTEMPTID=appattempt_1553788280931_0009_000001 2019-04-05 14:44:38,613 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0009_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 14:44:38,613 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0009 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 14:44:39,805 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0009_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 14:44:39,806 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:44:39,806 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0009_01_000002 of capacity on host yarn-ats-1:45454, which has 1 containers, used and available after allocation 2019-04-05 14:44:39,806 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0009 CONTAINERID=container_e30_1553788280931_0009_01_000002 RESOURCE= 2019-04-05 14:44:39,806 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 14:44:39,806 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:44:39,806 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0009_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 14:44:39,807 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:44:39,807 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0009_01_000003 of capacity on host yarn-ats-1:45454, which has 2 containers, used and available after allocation 2019-04-05 14:44:39,807 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0009 CONTAINERID=container_e30_1553788280931_0009_01_000003 RESOURCE= 2019-04-05 14:44:39,807 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 14:44:39,807 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:44:40,720 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-1:45454 for container : container_e30_1553788280931_0009_01_000002 2019-04-05 14:44:40,721 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:44:40,722 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:44:41,762 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0009 2019-04-05 14:44:41,809 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:44:41,810 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:44:44,149 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=dr.who OPERATION=Kill Application Request TARGET=RMAppImpl RESULT=SUCCESS APPID=application_1553788280931_0009 2019-04-05 14:44:44,150 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0009 State change from RUNNING to KILLING on event = KILL 2019-04-05 14:44:44,151 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0009_000001 with final state: KILLED, and exit status: -1000 2019-04-05 14:44:44,151 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0009_000001 State change from RUNNING to FINAL_SAVING on event = KILL 2019-04-05 14:44:44,162 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0009_000001 2019-04-05 14:44:44,162 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0009_000001 2019-04-05 14:44:44,162 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0009_000001 State change from FINAL_SAVING to KILLED on event = ATTEMPT_UPDATE_SAVED 2019-04-05 14:44:44,162 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0009 with final state: KILLED 2019-04-05 14:44:44,163 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0009 State change from KILLING to FINAL_SAVING on event = ATTEMPT_KILLED 2019-04-05 14:44:44,163 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0009 2019-04-05 14:44:44,163 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0009_000001 is done. finalState=KILLED 2019-04-05 14:44:44,163 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0009_000001 2019-04-05 14:44:44,163 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000001 Container Transitioned from RUNNING to KILLED 2019-04-05 14:44:44,163 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0009 CONTAINERID=container_e30_1553788280931_0009_01_000001 RESOURCE= 2019-04-05 14:44:44,164 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000002 Container Transitioned from RUNNING to KILLED 2019-04-05 14:44:44,164 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0009 CONTAINERID=container_e30_1553788280931_0009_01_000002 RESOURCE= 2019-04-05 14:44:44,165 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0009_01_000003 Container Transitioned from RUNNING to KILLED 2019-04-05 14:44:44,165 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0009 CONTAINERID=container_e30_1553788280931_0009_01_000003 RESOURCE= 2019-04-05 14:44:44,165 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0009 requests cleared 2019-04-05 14:44:44,166 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0010 from user: ambari-qa activated in queue: default 2019-04-05 14:44:44,166 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0009 user: ambari-qa queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-04-05 14:44:44,170 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0009 State change from FINAL_SAVING to KILLED on event = APP_UPDATE_SAVED 2019-04-05 14:44:44,170 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Killed TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0009 2019-04-05 14:44:44,171 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0009,name=QuasiMonteCarlo,user=ambari-qa,queue=default,state=KILLED,trackingUrl=http://yarn-ats-1:8088/cluster/app/application_1553788280931_0009,appMasterHost=N/A,submitTime=1554474990073,startTime=1554474990075,finishTime=1554475484162,finalStatus=KILLED,memorySeconds=32318,vcoreSeconds=19,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=32318 MB-seconds\, 19 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 14:44:44,183 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0009 user: ambari-qa leaf-queue of parent: root #applications: 1 2019-04-05 14:44:44,252 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Container container_e30_1553788280931_0009_01_000001 completed with event FINISHED, but corresponding RMContainer doesn't exist. 2019-04-05 14:44:44,253 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0010_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 14:44:44,254 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:44:44,254 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0010_01_000001 of capacity on host yarn-ats-3:45454, which has 1 containers, used and available after allocation 2019-04-05 14:44:44,255 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0010 CONTAINERID=container_e30_1553788280931_0010_01_000001 RESOURCE= 2019-04-05 14:44:44,256 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-3:45454 for container : container_e30_1553788280931_0010_01_000001 2019-04-05 14:44:44,256 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:44:44,257 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0010_000001 2019-04-05 14:44:44,257 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0010 AttemptId: appattempt_1553788280931_0010_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0010_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 14:44:44,257 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 14:44:44,257 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:44:44,257 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0010_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 14:44:44,293 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0010_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 14:44:44,294 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0010_000001 2019-04-05 14:44:44,297 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0010_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0010_000001 2019-04-05 14:44:44,297 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0010_000001 2019-04-05 14:44:44,297 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0010_000001 2019-04-05 14:44:44,321 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0009 was removed 2019-04-05 14:44:44,409 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Container container_e30_1553788280931_0009_01_000002 completed with event FINISHED, but corresponding RMContainer doesn't exist. 2019-04-05 14:44:44,441 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0010_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0010_000001 2019-04-05 14:44:44,441 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0010_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 14:44:44,441 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0010, attemptId: appattempt_1553788280931_0010_000001launchTime: 1554475484441 2019-04-05 14:44:44,443 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Container container_e30_1553788280931_0009_01_000002 completed with event FINISHED, but corresponding RMContainer doesn't exist. 2019-04-05 14:44:44,444 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Container container_e30_1553788280931_0009_01_000003 completed with event FINISHED, but corresponding RMContainer doesn't exist. 2019-04-05 14:44:45,254 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0010 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 17 2019-04-05 14:44:45,263 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:44:45,264 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Container container_e30_1553788280931_0009_01_000001 completed with event FINISHED, but corresponding RMContainer doesn't exist. 2019-04-05 14:44:46,259 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0010 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 18 2019-04-05 14:44:49,998 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0010_000001 (auth:SIMPLE) 2019-04-05 14:44:50,015 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0010_000001 2019-04-05 14:44:50,015 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0010 APPATTEMPTID=appattempt_1553788280931_0010_000001 2019-04-05 14:44:50,016 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0010_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 14:44:50,017 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0010 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 14:44:50,064 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=dr.who OPERATION=Get Applications Request TARGET=ClientRMService RESULT=SUCCESS 2019-04-05 14:44:51,288 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0010_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 14:44:51,288 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:44:51,289 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0010_01_000002 of capacity on host yarn-ats-3:45454, which has 2 containers, used and available after allocation 2019-04-05 14:44:51,289 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0010 CONTAINERID=container_e30_1553788280931_0010_01_000002 RESOURCE= 2019-04-05 14:44:51,289 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 14:44:51,289 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:44:52,114 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-3:45454 for container : container_e30_1553788280931_0010_01_000002 2019-04-05 14:44:52,115 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:44:53,147 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0010 2019-04-05 14:44:53,294 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:44:57,248 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000002 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:44:57,248 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0010 CONTAINERID=container_e30_1553788280931_0010_01_000002 RESOURCE= 2019-04-05 14:44:57,348 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=dr.who OPERATION=Get Applications Request TARGET=ClientRMService RESULT=SUCCESS 2019-04-05 14:44:58,250 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0010_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 14:44:58,251 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:44:58,251 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0010_01_000003 of capacity on host yarn-ats-3:45454, which has 2 containers, used and available after allocation 2019-04-05 14:44:58,251 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0010 CONTAINERID=container_e30_1553788280931_0010_01_000003 RESOURCE= 2019-04-05 14:44:58,251 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 14:44:58,251 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:44:59,207 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:45:00,214 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0010 2019-04-05 14:45:00,260 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:45:03,154 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0010_000001 with final state: FINISHING, and exit status: -1000 2019-04-05 14:45:03,155 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0010_000001 State change from RUNNING to FINAL_SAVING on event = UNREGISTERED 2019-04-05 14:45:03,155 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0010 with final state: FINISHING 2019-04-05 14:45:03,156 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0010 State change from RUNNING to FINAL_SAVING on event = ATTEMPT_UNREGISTERED 2019-04-05 14:45:03,163 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000003 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:45:03,163 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0010 CONTAINERID=container_e30_1553788280931_0010_01_000003 RESOURCE= 2019-04-05 14:45:03,171 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0010 2019-04-05 14:45:03,171 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0010_000001 State change from FINAL_SAVING to FINISHING on event = ATTEMPT_UPDATE_SAVED 2019-04-05 14:45:03,177 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0010 State change from FINAL_SAVING to FINISHING on event = APP_UPDATE_SAVED 2019-04-05 14:45:04,160 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: application_1553788280931_0010 unregistered successfully. 2019-04-05 14:45:09,604 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0010_000001 2019-04-05 14:45:09,604 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0010_01_000001 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:45:09,605 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0010_000001 2019-04-05 14:45:09,605 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0010 CONTAINERID=container_e30_1553788280931_0010_01_000001 RESOURCE= 2019-04-05 14:45:09,606 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0010_000001 State change from FINISHING to FINISHED on event = CONTAINER_FINISHED 2019-04-05 14:45:09,609 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0010 State change from FINISHING to FINISHED on event = ATTEMPT_FINISHED 2019-04-05 14:45:09,609 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0010_000001 is done. finalState=FINISHED 2019-04-05 14:45:09,610 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0010 requests cleared 2019-04-05 14:45:09,610 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0010 2019-04-05 14:45:09,611 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0010 user: ambari-qa queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-04-05 14:45:09,611 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0010 user: ambari-qa leaf-queue of parent: root #applications: 0 2019-04-05 14:45:09,611 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0010,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553788280931_0010/,appMasterHost=yarn-ats-3,submitTime=1554475096904,startTime=1554475096905,finishTime=1554475503155,finalStatus=SUCCEEDED,memorySeconds=68083,vcoreSeconds=34,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=68083 MB-seconds\, 34 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 14:45:09,612 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0010_000001 2019-04-05 14:45:09,660 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0010 was removed 2019-04-05 14:45:31,448 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 11 2019-04-05 14:45:32,578 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0011' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 14:45:32,578 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0011 2019-04-05 14:45:32,579 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0011 was added 2019-04-05 14:45:32,580 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 11 submitted by user ambari-qa 2019-04-05 14:45:32,580 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0011 2019-04-05 14:45:32,580 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0011 2019-04-05 14:45:32,582 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0011 2019-04-05 14:45:32,582 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0011 State change from NEW to NEW_SAVING on event = START 2019-04-05 14:45:32,596 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0011 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 14:45:32,597 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0011 user: ambari-qa leaf-queue of parent: root #applications: 1 2019-04-05 14:45:32,597 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0011 from user: ambari-qa, in queue: default 2019-04-05 14:45:32,597 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0011 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 14:45:32,598 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0011_000001 2019-04-05 14:45:32,598 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0011_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 14:45:32,599 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0011 from user: ambari-qa activated in queue: default 2019-04-05 14:45:32,599 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0011 user: ambari-qa, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-04-05 14:45:32,599 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0011_000001 to scheduler from user ambari-qa in queue default 2019-04-05 14:45:32,600 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0011_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 14:45:32,656 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0011_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 14:45:32,657 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:45:32,658 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0011_01_000001 of capacity on host yarn-ats-3:45454, which has 1 containers, used and available after allocation 2019-04-05 14:45:32,658 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0011 CONTAINERID=container_e30_1553788280931_0011_01_000001 RESOURCE= 2019-04-05 14:45:32,661 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-3:45454 for container : container_e30_1553788280931_0011_01_000001 2019-04-05 14:45:32,662 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:45:32,663 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0011_000001 2019-04-05 14:45:32,663 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0011 AttemptId: appattempt_1553788280931_0011_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0011_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 14:45:32,663 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 14:45:32,663 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:45:32,663 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0011_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 14:45:32,675 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0011_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 14:45:32,677 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0011_000001 2019-04-05 14:45:32,681 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0011_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0011_000001 2019-04-05 14:45:32,681 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0011_000001 2019-04-05 14:45:32,681 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0011_000001 2019-04-05 14:45:32,863 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0011_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0011_000001 2019-04-05 14:45:32,863 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0011_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 14:45:32,863 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0011, attemptId: appattempt_1553788280931_0011_000001launchTime: 1554475532863 2019-04-05 14:45:33,657 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0011 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 19 2019-04-05 14:45:33,659 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:45:34,662 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0011 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 20 2019-04-05 14:45:38,418 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0011_000001 (auth:SIMPLE) 2019-04-05 14:45:38,430 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0011_000001 2019-04-05 14:45:38,430 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0011 APPATTEMPTID=appattempt_1553788280931_0011_000001 2019-04-05 14:45:38,430 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0011_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 14:45:38,431 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0011 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 14:45:39,543 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0011_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 14:45:39,544 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:45:39,544 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0011_01_000002 of capacity on host yarn-ats-1:45454, which has 1 containers, used and available after allocation 2019-04-05 14:45:39,544 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0011 CONTAINERID=container_e30_1553788280931_0011_01_000002 RESOURCE= 2019-04-05 14:45:39,545 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 14:45:39,545 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:45:40,540 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-1:45454 for container : container_e30_1553788280931_0011_01_000002 2019-04-05 14:45:40,541 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:45:41,552 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:45:41,569 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0011 2019-04-05 14:45:45,763 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000002 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:45:45,763 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0011 CONTAINERID=container_e30_1553788280931_0011_01_000002 RESOURCE= 2019-04-05 14:45:46,695 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0011_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 14:45:46,696 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:45:46,696 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0011_01_000003 of capacity on host yarn-ats-3:45454, which has 2 containers, used and available after allocation 2019-04-05 14:45:46,696 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0011 CONTAINERID=container_e30_1553788280931_0011_01_000003 RESOURCE= 2019-04-05 14:45:46,697 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 14:45:46,697 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:45:47,609 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-3:45454 for container : container_e30_1553788280931_0011_01_000003 2019-04-05 14:45:47,610 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:45:47,698 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:45:48,621 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0011 2019-04-05 14:45:51,284 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0011_000001 with final state: FINISHING, and exit status: -1000 2019-04-05 14:45:51,284 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0011_000001 State change from RUNNING to FINAL_SAVING on event = UNREGISTERED 2019-04-05 14:45:51,284 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0011 with final state: FINISHING 2019-04-05 14:45:51,285 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0011 State change from RUNNING to FINAL_SAVING on event = ATTEMPT_UNREGISTERED 2019-04-05 14:45:51,290 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000003 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:45:51,290 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0011 CONTAINERID=container_e30_1553788280931_0011_01_000003 RESOURCE= 2019-04-05 14:45:51,308 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0011 2019-04-05 14:45:51,309 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0011_000001 State change from FINAL_SAVING to FINISHING on event = ATTEMPT_UPDATE_SAVED 2019-04-05 14:45:51,314 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0011 State change from FINAL_SAVING to FINISHING on event = APP_UPDATE_SAVED 2019-04-05 14:45:52,289 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: application_1553788280931_0011 unregistered successfully. 2019-04-05 14:45:57,736 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0011_01_000001 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:45:57,736 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0011 CONTAINERID=container_e30_1553788280931_0011_01_000001 RESOURCE= 2019-04-05 14:45:57,738 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0011_000001 2019-04-05 14:45:57,738 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0011_000001 2019-04-05 14:45:57,738 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0011_000001 State change from FINISHING to FINISHED on event = CONTAINER_FINISHED 2019-04-05 14:45:57,741 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0011 State change from FINISHING to FINISHED on event = ATTEMPT_FINISHED 2019-04-05 14:45:57,741 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0011_000001 is done. finalState=FINISHED 2019-04-05 14:45:57,742 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0011 2019-04-05 14:45:57,742 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0011 requests cleared 2019-04-05 14:45:57,742 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0011 user: ambari-qa queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-04-05 14:45:57,742 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0011 user: ambari-qa leaf-queue of parent: root #applications: 0 2019-04-05 14:45:57,742 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0011,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553788280931_0011/,appMasterHost=yarn-ats-3,submitTime=1554475532576,startTime=1554475532578,finishTime=1554475551284,finalStatus=SUCCEEDED,memorySeconds=67138,vcoreSeconds=35,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=67138 MB-seconds\, 35 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 14:45:57,744 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0011_000001 2019-04-05 14:46:15,983 INFO org.apache.hadoop.hbase.client.AsyncProcess: , tableName=prod.timelineservice.flowactivity2 2019-04-05 14:46:15,985 INFO org.apache.hadoop.hbase.client.AsyncProcess: Left over 9 task(s) are processed on server(s): [yarn-ats-1,16020,1552384446967] 2019-04-05 14:46:26,035 INFO org.apache.hadoop.hbase.client.AsyncProcess: #6, table=prod.timelineservice.flowactivity2, attempt=10/31 failed=1ops, last exception: org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region prod.timelineservice.flowactivity2,,1554475520009.74c8e2d812c28b662739ca68eaa508e2. is not online on yarn-ats-1,16020,1552384446967 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2942) at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:1072) at org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2122) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33656) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2196) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108) at java.lang.Thread.run(Thread.java:748) on yarn-ats-1,16020,1552384446967, tracking started null, retrying after=10024ms, replay=1ops 2019-04-05 14:46:26,036 INFO org.apache.hadoop.hbase.client.AsyncProcess: , tableName=prod.timelineservice.flowactivity2 2019-04-05 14:46:26,036 INFO org.apache.hadoop.hbase.client.AsyncProcess: Left over 10 task(s) are processed on server(s): [yarn-ats-1,16020,1552384446967] 2019-04-05 14:46:36,074 INFO org.apache.hadoop.hbase.client.AsyncProcess: , tableName=prod.timelineservice.flowactivity2 2019-04-05 14:46:36,082 INFO org.apache.hadoop.hbase.client.AsyncProcess: #6, table=prod.timelineservice.flowactivity2, attempt=11/31 succeeded on yarn-ats-2,16020,1552384450690, tracking started Fri Apr 05 14:45:57 UTC 2019 2019-04-05 14:46:36,086 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0011 was removed 2019-04-05 14:46:54,229 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 12 2019-04-05 14:46:55,278 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0012' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 14:46:55,278 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0012 2019-04-05 14:46:55,279 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0012 was added 2019-04-05 14:46:55,280 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 12 submitted by user ambari-qa 2019-04-05 14:46:55,280 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0012 2019-04-05 14:46:55,280 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0012 2019-04-05 14:46:55,282 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0012 2019-04-05 14:46:55,282 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0012 State change from NEW to NEW_SAVING on event = START 2019-04-05 14:46:55,347 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0012 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 14:46:55,347 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0012 user: ambari-qa leaf-queue of parent: root #applications: 1 2019-04-05 14:46:55,347 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0012 from user: ambari-qa, in queue: default 2019-04-05 14:46:55,348 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0012 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 14:46:55,348 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0012_000001 2019-04-05 14:46:55,348 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0012_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 14:46:55,350 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0012 from user: ambari-qa activated in queue: default 2019-04-05 14:46:55,350 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0012 user: ambari-qa, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-04-05 14:46:55,350 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0012_000001 to scheduler from user ambari-qa in queue default 2019-04-05 14:46:55,352 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0012_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 14:46:55,861 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0012_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 14:46:55,862 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:46:55,863 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0012_01_000001 of capacity on host yarn-ats-3:45454, which has 1 containers, used and available after allocation 2019-04-05 14:46:55,863 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0012 CONTAINERID=container_e30_1553788280931_0012_01_000001 RESOURCE= 2019-04-05 14:46:55,867 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-3:45454 for container : container_e30_1553788280931_0012_01_000001 2019-04-05 14:46:55,867 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:46:55,868 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0012_000001 2019-04-05 14:46:55,868 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0012 AttemptId: appattempt_1553788280931_0012_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0012_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 14:46:55,868 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 14:46:55,868 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:46:55,868 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0012_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 14:46:55,877 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0012_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 14:46:55,878 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0012_000001 2019-04-05 14:46:55,881 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0012_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0012_000001 2019-04-05 14:46:55,881 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0012_000001 2019-04-05 14:46:55,882 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0012_000001 2019-04-05 14:46:56,042 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0012_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0012_000001 2019-04-05 14:46:56,043 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0012_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 14:46:56,043 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0012, attemptId: appattempt_1553788280931_0012_000001launchTime: 1554475616042 2019-04-05 14:46:56,862 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0012 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 21 2019-04-05 14:46:56,863 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:46:57,866 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0012 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 22 2019-04-05 14:47:01,615 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0012_000001 (auth:SIMPLE) 2019-04-05 14:47:01,626 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0012_000001 2019-04-05 14:47:01,627 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0012 APPATTEMPTID=appattempt_1553788280931_0012_000001 2019-04-05 14:47:01,627 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0012_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 14:47:01,627 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0012 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 14:47:02,878 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0012_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 14:47:02,879 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:47:02,879 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0012_01_000002 of capacity on host yarn-ats-1:45454, which has 1 containers, used and available after allocation 2019-04-05 14:47:02,879 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0012 CONTAINERID=container_e30_1553788280931_0012_01_000002 RESOURCE= 2019-04-05 14:47:02,879 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 14:47:02,879 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:47:03,723 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-1:45454 for container : container_e30_1553788280931_0012_01_000002 2019-04-05 14:47:03,724 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:47:04,755 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0012 2019-04-05 14:47:04,880 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:47:08,949 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000002 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:47:08,950 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0012 CONTAINERID=container_e30_1553788280931_0012_01_000002 RESOURCE= 2019-04-05 14:47:09,904 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0012_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 14:47:09,904 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:47:09,905 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0012_01_000003 of capacity on host yarn-ats-3:45454, which has 2 containers, used and available after allocation 2019-04-05 14:47:09,905 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0012 CONTAINERID=container_e30_1553788280931_0012_01_000003 RESOURCE= 2019-04-05 14:47:09,905 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 14:47:09,905 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:47:10,801 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-3:45454 for container : container_e30_1553788280931_0012_01_000003 2019-04-05 14:47:10,802 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:47:10,906 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:47:11,810 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0012 2019-04-05 14:47:14,613 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0012_000001 with final state: FINISHING, and exit status: -1000 2019-04-05 14:47:14,614 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0012_000001 State change from RUNNING to FINAL_SAVING on event = UNREGISTERED 2019-04-05 14:47:14,614 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0012 with final state: FINISHING 2019-04-05 14:47:14,615 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0012 State change from RUNNING to FINAL_SAVING on event = ATTEMPT_UNREGISTERED 2019-04-05 14:47:14,629 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0012 2019-04-05 14:47:14,630 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0012_000001 State change from FINAL_SAVING to FINISHING on event = ATTEMPT_UPDATE_SAVED 2019-04-05 14:47:14,662 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0012 State change from FINAL_SAVING to FINISHING on event = APP_UPDATE_SAVED 2019-04-05 14:47:14,779 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000003 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:47:14,780 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0012 CONTAINERID=container_e30_1553788280931_0012_01_000003 RESOURCE= 2019-04-05 14:47:15,617 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: application_1553788280931_0012 unregistered successfully. 2019-04-05 14:47:21,098 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0012_000001 2019-04-05 14:47:21,098 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0012_01_000001 Container Transitioned from RUNNING to COMPLETED 2019-04-05 14:47:21,098 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0012_000001 2019-04-05 14:47:21,098 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0012 CONTAINERID=container_e30_1553788280931_0012_01_000001 RESOURCE= 2019-04-05 14:47:21,099 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0012_000001 State change from FINISHING to FINISHED on event = CONTAINER_FINISHED 2019-04-05 14:47:21,102 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0012 State change from FINISHING to FINISHED on event = ATTEMPT_FINISHED 2019-04-05 14:47:21,102 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0012_000001 is done. finalState=FINISHED 2019-04-05 14:47:21,102 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0012 requests cleared 2019-04-05 14:47:21,102 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0012 2019-04-05 14:47:21,103 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0012 user: ambari-qa queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-04-05 14:47:21,103 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0012 user: ambari-qa leaf-queue of parent: root #applications: 0 2019-04-05 14:47:21,103 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0012,name=word count,user=ambari-qa,queue=default,state=FINISHED,trackingUrl=http://yarn-ats-1:8088/proxy/application_1553788280931_0012/,appMasterHost=yarn-ats-3,submitTime=1554475615276,startTime=1554475615279,finishTime=1554475634614,finalStatus=SUCCEEDED,memorySeconds=67883,vcoreSeconds=35,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=67883 MB-seconds\, 35 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 14:47:21,104 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0012_000001 2019-04-05 14:47:21,153 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0012 was removed 2019-04-05 14:52:15,622 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 13 2019-04-05 14:52:16,503 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1553788280931_0013' is submitted without priority hence considering default queue/cluster priority: 0 2019-04-05 14:52:16,503 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1553788280931_0013 2019-04-05 14:52:16,505 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: the collector for application_1553788280931_0013 was added 2019-04-05 14:52:16,505 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 13 submitted by user ambari-qa 2019-04-05 14:52:16,505 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1553788280931_0013 CALLERCONTEXT=CLI 2019-04-05 14:52:16,506 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1553788280931_0013 2019-04-05 14:52:16,507 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0013 State change from NEW to NEW_SAVING on event = START 2019-04-05 14:52:16,507 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1553788280931_0013 2019-04-05 14:52:16,523 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0013 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-04-05 14:52:16,524 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1553788280931_0013 user: ambari-qa leaf-queue of parent: root #applications: 1 2019-04-05 14:52:16,524 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1553788280931_0013 from user: ambari-qa, in queue: default 2019-04-05 14:52:16,524 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0013 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-04-05 14:52:16,525 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1553788280931_0013_000001 2019-04-05 14:52:16,525 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0013_000001 State change from NEW to SUBMITTED on event = START 2019-04-05 14:52:16,528 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1553788280931_0013 from user: ambari-qa activated in queue: default 2019-04-05 14:52:16,528 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1553788280931_0013 user: ambari-qa, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-04-05 14:52:16,528 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1553788280931_0013_000001 to scheduler from user ambari-qa in queue default 2019-04-05 14:52:16,532 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0013_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-04-05 14:52:16,704 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0013_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-04-05 14:52:16,705 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000001 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:52:16,706 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0013_01_000001 of capacity on host yarn-ats-3:45454, which has 1 containers, used and available after allocation 2019-04-05 14:52:16,706 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0013 CONTAINERID=container_e30_1553788280931_0013_01_000001 RESOURCE= 2019-04-05 14:52:16,711 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-3:45454 for container : container_e30_1553788280931_0013_01_000001 2019-04-05 14:52:16,712 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:52:16,712 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1553788280931_0013_000001 2019-04-05 14:52:16,712 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1553788280931_0013 AttemptId: appattempt_1553788280931_0013_000001 MasterContainer: Container: [ContainerId: container_e30_1553788280931_0013_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] 2019-04-05 14:52:16,713 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.074074075 absoluteUsedCapacity=0.074074075 used= cluster= 2019-04-05 14:52:16,713 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:52:16,714 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0013_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-04-05 14:52:16,731 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0013_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-04-05 14:52:16,732 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1553788280931_0013_000001 2019-04-05 14:52:16,736 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_e30_1553788280931_0013_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0013_000001 2019-04-05 14:52:16,736 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1553788280931_0013_000001 2019-04-05 14:52:16,736 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1553788280931_0013_000001 2019-04-05 14:52:16,894 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_e30_1553788280931_0013_01_000001, AllocationRequestId: -1, Version: 0, NodeId: yarn-ats-3:45454, NodeHttpAddress: yarn-ats-3:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 172.26.81.95:45454 }, ExecutionType: GUARANTEED, ] for AM appattempt_1553788280931_0013_000001 2019-04-05 14:52:16,894 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0013_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-04-05 14:52:16,894 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1553788280931_0013, attemptId: appattempt_1553788280931_0013_000001launchTime: 1554475936894 2019-04-05 14:52:17,702 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0013 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 23 2019-04-05 14:52:17,705 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:52:18,707 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Update collector information for application application_1553788280931_0013 with new address: yarn-ats-3:36695 timestamp: 1553788280931, 24 2019-04-05 14:52:22,429 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1553788280931_0013_000001 (auth:SIMPLE) 2019-04-05 14:52:22,440 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1553788280931_0013_000001 2019-04-05 14:52:22,440 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1553788280931_0013 APPATTEMPTID=appattempt_1553788280931_0013_000001 2019-04-05 14:52:22,442 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0013_000001 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-04-05 14:52:22,442 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0013 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-04-05 14:52:23,718 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0013_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 14:52:23,719 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000002 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:52:23,719 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0013_01_000002 of capacity on host yarn-ats-2:45454, which has 1 containers, used and available after allocation 2019-04-05 14:52:23,719 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0013 CONTAINERID=container_e30_1553788280931_0013_01_000002 RESOURCE= 2019-04-05 14:52:23,720 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.11111111 absoluteUsedCapacity=0.11111111 used= cluster= 2019-04-05 14:52:23,720 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:52:23,720 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1553788280931_0013_000001 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-04-05 14:52:23,721 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000003 Container Transitioned from NEW to ALLOCATED 2019-04-05 14:52:23,721 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_e30_1553788280931_0013_01_000003 of capacity on host yarn-ats-2:45454, which has 2 containers, used and available after allocation 2019-04-05 14:52:23,721 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0013 CONTAINERID=container_e30_1553788280931_0013_01_000003 RESOURCE= 2019-04-05 14:52:23,721 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.14814815 absoluteUsedCapacity=0.14814815 used= cluster= 2019-04-05 14:52:23,721 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-04-05 14:52:24,536 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : yarn-ats-2:45454 for container : container_e30_1553788280931_0013_01_000002 2019-04-05 14:52:24,536 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:52:24,537 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-04-05 14:52:25,565 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1553788280931_0013 2019-04-05 14:52:25,720 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000002 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:52:25,721 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000003 Container Transitioned from ACQUIRED to RUNNING 2019-04-05 14:53:24,642 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa IP=172.26.81.95 OPERATION=Kill Application Request TARGET=RMAppImpl RESULT=SUCCESS APPID=application_1553788280931_0013 2019-04-05 14:53:24,643 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0013 State change from RUNNING to KILLING on event = KILL 2019-04-05 14:53:24,644 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1553788280931_0013_000001 with final state: KILLED, and exit status: -1000 2019-04-05 14:53:24,645 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0013_000001 State change from RUNNING to FINAL_SAVING on event = KILL 2019-04-05 14:53:24,673 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1553788280931_0013_000001 2019-04-05 14:53:24,674 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1553788280931_0013_000001 2019-04-05 14:53:24,675 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1553788280931_0013_000001 State change from FINAL_SAVING to KILLED on event = ATTEMPT_UPDATE_SAVED 2019-04-05 14:53:24,675 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1553788280931_0013 with final state: KILLED 2019-04-05 14:53:24,675 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0013 State change from KILLING to FINAL_SAVING on event = ATTEMPT_KILLED 2019-04-05 14:53:24,675 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1553788280931_0013 2019-04-05 14:53:24,676 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1553788280931_0013_000001 is done. finalState=KILLED 2019-04-05 14:53:24,677 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1553788280931_0013_000001 2019-04-05 14:53:24,678 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000003 Container Transitioned from RUNNING to KILLED 2019-04-05 14:53:24,679 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0013 CONTAINERID=container_e30_1553788280931_0013_01_000003 RESOURCE= 2019-04-05 14:53:24,682 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000002 Container Transitioned from RUNNING to KILLED 2019-04-05 14:53:24,682 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0013 CONTAINERID=container_e30_1553788280931_0013_01_000002 RESOURCE= 2019-04-05 14:53:24,683 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_e30_1553788280931_0013_01_000001 Container Transitioned from RUNNING to KILLED 2019-04-05 14:53:24,683 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1553788280931_0013 CONTAINERID=container_e30_1553788280931_0013_01_000001 RESOURCE= 2019-04-05 14:53:24,683 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1553788280931_0013 State change from FINAL_SAVING to KILLED on event = APP_UPDATE_SAVED 2019-04-05 14:53:24,684 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=ambari-qa OPERATION=Application Finished - Killed TARGET=RMAppManager RESULT=SUCCESS APPID=application_1553788280931_0013 2019-04-05 14:53:24,684 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1553788280931_0013 requests cleared 2019-04-05 14:53:24,684 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1553788280931_0013 user: ambari-qa queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-04-05 14:53:24,684 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1553788280931_0013 user: ambari-qa leaf-queue of parent: root #applications: 0 2019-04-05 14:53:24,685 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1553788280931_0013,name=QuasiMonteCarlo,user=ambari-qa,queue=default,state=KILLED,trackingUrl=http://yarn-ats-1:8088/cluster/app/application_1553788280931_0013,appMasterHost=N/A,submitTime=1554475936500,startTime=1554475936504,finishTime=1554476004675,finalStatus=KILLED,memorySeconds=264064,vcoreSeconds=187,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=264064 MB-seconds\, 187 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds 2019-04-05 14:53:24,728 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0013 was removed 2019-04-05 14:53:24,734 FATAL org.apache.hadoop.yarn.event.AsyncDispatcher: Error in dispatcher thread java.lang.NullPointerException at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher.putEntity(TimelineServiceV2Publisher.java:461) at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher.access$100(TimelineServiceV2Publisher.java:73) at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler.handle(TimelineServiceV2Publisher.java:496) at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler.handle(TimelineServiceV2Publisher.java:485) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:197) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:126) at java.lang.Thread.run(Thread.java:748) 2019-04-05 14:53:24,743 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Exiting, bbye.. 2019-04-05 14:53:24,758 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Container container_e30_1553788280931_0013_01_000001 completed with event FINISHED, but corresponding RMContainer doesn't exist. 2019-04-05 14:53:24,760 ERROR org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2019-04-05 14:53:24,764 INFO org.eclipse.jetty.server.handler.ContextHandler: Stopped o.e.j.w.WebAppContext@7c781c42{/,null,UNAVAILABLE}{/cluster} 2019-04-05 14:53:24,771 INFO org.eclipse.jetty.server.AbstractConnector: Stopped ServerConnector@625a9c5d{HTTP/1.1,[http/1.1]}{yarn-ats-1:8088} 2019-04-05 14:53:24,781 INFO org.eclipse.jetty.server.handler.ContextHandler: Stopped o.e.j.w.WebAppContext@257ef9ed{/ui2,file:///HADOOP/hadoop-3.2.0/share/hadoop/yarn/webapps/ui2/,UNAVAILABLE} 2019-04-05 14:53:24,782 INFO org.eclipse.jetty.server.handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@3773862a{/static,jar:file:/HADOOP/hadoop-3.2.0/share/hadoop/yarn/hadoop-yarn-common-3.2.0.jar!/webapps/static,UNAVAILABLE} 2019-04-05 14:53:24,782 INFO org.eclipse.jetty.server.handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@6134ac4a{/logs,file:///HADOOP/hadoop-3.2.0/logs/,UNAVAILABLE} 2019-04-05 14:53:24,792 INFO org.apache.hadoop.ipc.Server: Stopping server on 8050 2019-04-05 14:53:24,798 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8050 2019-04-05 14:53:24,798 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,798 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 2019-04-05 14:53:24,800 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,803 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,806 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,807 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,811 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,811 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,815 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,815 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,819 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,821 INFO org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl: closing the entity table 2019-04-05 14:53:24,824 INFO org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl: closing the app_flow table 2019-04-05 14:53:24,824 INFO org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl: closing the application table 2019-04-05 14:53:24,824 INFO org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl: closing the flow run table 2019-04-05 14:53:24,826 INFO org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl: closing the flowActivityTable table 2019-04-05 14:53:24,827 INFO org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl: closing the hbase Connection 2019-04-05 14:53:24,829 INFO org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x100008f6ce200ca 2019-04-05 14:53:24,831 ERROR org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Application attempt appattempt_1553788280931_0013_000001 doesn't exist in ApplicationMasterService cache. 2019-04-05 14:53:24,833 INFO org.apache.hadoop.ipc.Server: IPC Server handler 31 on 8030, call Call#88 Retry#0 org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB.allocate from 172.26.81.95:60176 org.apache.hadoop.yarn.exceptions.ApplicationAttemptNotFoundException: Application attempt appattempt_1553788280931_0013_000001 doesn't exist in ApplicationMasterService cache. at org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService.allocate(ApplicationMasterService.java:398) at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationMasterProtocolPBServiceImpl.allocate(ApplicationMasterProtocolPBServiceImpl.java:60) at org.apache.hadoop.yarn.proto.ApplicationMasterProtocol$ApplicationMasterProtocolService$2.callBlockingMethod(ApplicationMasterProtocol.java:99) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:524) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1025) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:876) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:822) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2682) 2019-04-05 14:53:24,839 INFO org.apache.zookeeper.ZooKeeper: Session: 0x100008f6ce200ca closed 2019-04-05 14:53:24,839 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down for session: 0x100008f6ce200ca 2019-04-05 14:53:24,853 INFO org.apache.hadoop.ipc.Server: Stopping server on 8141 2019-04-05 14:53:24,856 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 2019-04-05 14:53:24,856 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8141 2019-04-05 14:53:24,857 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioning to standby state 2019-04-05 14:53:24,857 INFO org.apache.hadoop.yarn.service.client.SystemServiceManagerImpl: Stopping org.apache.hadoop.yarn.service.client.SystemServiceManagerImpl 2019-04-05 14:53:24,858 WARN org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher: org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2019-04-05 14:53:24,862 INFO org.apache.hadoop.ipc.Server: Stopping server on 8030 2019-04-05 14:53:24,871 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 2019-04-05 14:53:24,872 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8030 2019-04-05 14:53:24,877 INFO org.apache.hadoop.ipc.Server: Stopping server on 8025 2019-04-05 14:53:24,888 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 2019-04-05 14:53:24,888 ERROR org.apache.hadoop.yarn.event.EventDispatcher: Returning, interrupted : java.lang.InterruptedException 2019-04-05 14:53:24,888 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8025 2019-04-05 14:53:24,893 INFO org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: NMLivelinessMonitor thread interrupted 2019-04-05 14:53:24,898 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.activities.ActivitiesManager: org.apache.hadoop.yarn.server.resourcemanager.scheduler.activities.ActivitiesManager thread interrupted 2019-04-05 14:53:24,900 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,905 INFO org.apache.hadoop.ipc.Server: IPC Server handler 43 on 8025: skipped Call#20281 Retry#0 org.apache.hadoop.yarn.server.api.ResourceTrackerPB.nodeHeartbeat from 172.26.81.92:50668 2019-04-05 14:53:24,906 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,909 INFO org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: org.apache.hadoop.yarn.server.resourcemanager.rmapp.monitor.RMAppLifetimeMonitor thread interrupted 2019-04-05 14:53:24,909 INFO org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: AMLivelinessMonitor thread interrupted 2019-04-05 14:53:24,909 ERROR org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2019-04-05 14:53:24,909 INFO org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer thread interrupted 2019-04-05 14:53:24,909 INFO org.apache.hadoop.yarn.util.AbstractLivelinessMonitor: AMLivelinessMonitor thread interrupted 2019-04-05 14:53:24,911 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping ResourceManager metrics system... 2019-04-05 14:53:24,919 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics system stopped. 2019-04-05 14:53:24,920 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics system shutdown complete. 2019-04-05 14:53:24,920 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: AsyncDispatcher is draining to stop, ignoring any new events. 2019-04-05 14:53:24,922 INFO org.apache.curator.framework.imps.CuratorFrameworkImpl: backgroundOperationsLoop exiting 2019-04-05 14:53:24,932 INFO org.apache.zookeeper.ZooKeeper: Session: 0x200008f1b5700d6 closed 2019-04-05 14:53:24,932 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down for session: 0x200008f1b5700d6 2019-04-05 14:53:24,933 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioned to standby state 2019-04-05 14:53:24,935 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down ResourceManager at yarn-ats-1/172.26.81.91 ************************************************************/