2019-01-13 00:40:46,299 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting ResourceManager STARTUP_MSG: host = hadoop11/10.3.1.11 STARTUP_MSG: args = [] STARTUP_MSG: version = 3.3.0-SNAPSHOT STARTUP_MSG: classpath = /home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/etc/hadoop:/tmp/trigger.jar:/tmp/trigger.jar:.:/home/hires/program/jdk1.8.0_65/lib/dt.jar:/home/hires/program/jdk1.8.0_65/lib/tools.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-databind-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jersey-json-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/gson-2.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/metrics-core-3.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-util-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/json-smart-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/dnsjava-2.1.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/stax2-api-3.1.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/accessors-smart-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/javax.activation-api-1.2.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/hadoop-auth-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-http-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-server-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-lang3-3.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-codec-1.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/asm-5.0.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/re2j-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-servlet-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-webapp-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-server-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jettison-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/log4j-1.2.17.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-io-2.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/curator-framework-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-core-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-annotations-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-collections-3.2.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-core-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-compress-1.18.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-client-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jsch-0.1.54.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/httpcore-4.4.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/zookeeper-3.4.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jsp-api-2.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/curator-recipes-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/guava-11.0.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/httpclient-4.5.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerby-config-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/netty-3.10.6.Final.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-net-3.6.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-beanutils-1.9.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-daemon-1.0.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jsr305-3.0.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/paranamer-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-security-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/hadoop-annotations-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/snappy-java-1.0.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-xml-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jersey-server-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jersey-core-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-io-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-text-1.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/token-provider-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/avro-1.7.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-cli-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/curator-client-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerby-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jersey-servlet-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-common-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/hadoop-kms-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/hadoop-common-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/hadoop-common-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/hadoop-registry-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/hadoop-nfs-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-databind-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/gson-2.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-util-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/json-smart-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/dnsjava-2.1.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/audience-annotations-0.5.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/javax.activation-api-1.2.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/hadoop-auth-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-http-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/netty-all-4.0.52.Final.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-lang3-3.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-codec-1.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/asm-5.0.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/re2j-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-servlet-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-webapp-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-server-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jettison-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-io-2.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/curator-framework-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-core-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-annotations-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-compress-1.18.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jsch-0.1.54.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-util-ajax-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/zookeeper-3.4.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/curator-recipes-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/okio-1.6.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-net-3.6.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-beanutils-1.9.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/paranamer-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-security-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/hadoop-annotations-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-xml-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-io-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-text-1.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/avro-1.7.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/curator-client-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-client-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-nfs-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-client-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/websocket-servlet-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/bcprov-jdk15on-1.60.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jersey-client-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/asm-commons-6.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/asm-tree-6.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jetty-annotations-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jetty-jndi-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/bcpkix-jdk15on-1.60.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/json-io-2.5.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/objenesis-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/javax-websocket-client-impl-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/guice-4.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jackson-jaxrs-base-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/javax.websocket-api-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/java-util-1.9.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/javax-websocket-server-impl-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/websocket-server-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jetty-plus-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/fst-2.50.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/websocket-client-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/javax.inject-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/websocket-common-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/snakeyaml-1.16.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jline-3.9.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/websocket-api-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-tests-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-services-api-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-common-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-client-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-api-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-registry-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-router-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-submarine-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-common-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-services-core-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-coprocessor-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-common-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-client-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/hbase-client-1.4.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/hbase-common-1.4.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/jcodings-1.0.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/metrics-core-2.2.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/htrace-core-3.1.0-incubating.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/joni-2.1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/hbase-protocol-1.4.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/hbase-annotations-1.4.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/commons-csv-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/commons-lang-2.6.jar STARTUP_MSG: build = https://github.com/apache/hadoop.git -r eee29ed7066e9401c7530b8b6f3b221bacef9a8a; compiled by 'lujie' on 2018-12-31T04:34Z STARTUP_MSG: java = 1.8.0_65 ************************************************************/ 2019-01-13 00:40:46,313 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: registered UNIX signal handlers for [TERM, HUP, INT] 2019-01-13 00:40:46,734 INFO org.apache.hadoop.conf.Configuration: found resource core-site.xml at file:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/etc/hadoop/core-site.xml 2019-01-13 00:40:46,953 INFO org.apache.hadoop.conf.Configuration: resource-types.xml not found 2019-01-13 00:40:46,954 INFO org.apache.hadoop.yarn.util.resource.ResourceUtils: Unable to find 'resource-types.xml'. 2019-01-13 00:40:47,026 INFO org.apache.hadoop.conf.Configuration: found resource yarn-site.xml at file:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/etc/hadoop/yarn-site.xml 2019-01-13 00:40:47,102 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2019-01-13 00:40:47,162 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher 2019-01-13 00:40:47,343 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms 2019-01-13 00:40:47,350 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms 2019-01-13 00:40:47,362 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms 2019-01-13 00:40:47,431 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler 2019-01-13 00:40:47,437 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager 2019-01-13 00:40:47,437 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler 2019-01-13 00:40:47,488 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.event.EventDispatcher 2019-01-13 00:40:47,489 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher 2019-01-13 00:40:47,490 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher 2019-01-13 00:40:47,491 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher 2019-01-13 00:40:47,688 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: Loaded properties from hadoop-metrics2.properties 2019-01-13 00:40:47,786 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2019-01-13 00:40:47,786 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics system started 2019-01-13 00:40:47,924 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.event.EventDispatcher 2019-01-13 00:40:47,934 INFO org.apache.hadoop.yarn.security.YarnAuthorizationProvider: org.apache.hadoop.yarn.security.ConfiguredYarnAuthorizer is instantiated. 2019-01-13 00:40:47,939 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager 2019-01-13 00:40:47,948 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher 2019-01-13 00:41:03,408 INFO org.apache.hadoop.yarn.server.resourcemanager.RMNMInfo: Registered RMNMInfo MBean 2019-01-13 00:41:03,408 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.monitor.RMAppLifetimeMonitor: Application lifelime monitor interval set to 3000 ms. 2019-01-13 00:41:03,417 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement.MultiNodeSortingManager: Initializing NodeSortingService=MultiNodeSortingManager 2019-01-13 00:41:03,421 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude) list 2019-01-13 00:41:03,429 INFO org.apache.hadoop.conf.Configuration: found resource capacity-scheduler.xml at file:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/etc/hadoop/capacity-scheduler.xml 2019-01-13 00:41:03,448 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Minimum allocation = 2019-01-13 00:41:03,448 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Maximum allocation = 2019-01-13 00:41:03,495 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root is undefined 2019-01-13 00:41:03,495 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root is undefined 2019-01-13 00:41:03,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: root, capacity=1.0, absoluteCapacity=1.0, maxCapacity=1.0, absoluteMaxCapacity=1.0, state=RUNNING, acls=ADMINISTER_QUEUE:*SUBMIT_APP:*, labels=*, , reservationsContinueLooking=true, orderingPolicy=utilization, priority=0 2019-01-13 00:41:03,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Initialized parent-queue root name=root, fullname=root 2019-01-13 00:41:04,171 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root.default is undefined 2019-01-13 00:41:04,171 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root.default is undefined 2019-01-13 00:41:04,178 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Initializing default capacity = 0.5 [= (float) configuredCapacity / 100 ] absoluteCapacity = 0.5 [= parentAbsoluteCapacity * capacity ] maxCapacity = 0.5 [= configuredMaxCapacity ] absoluteMaxCapacity = 0.5 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] effectiveMinResource= , effectiveMaxResource= userLimit = 100 [= configuredUserLimit ] userLimitFactor = 1.0 [= configuredUserLimitFactor ] maxApplications = 5000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 5000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = ADMINISTER_QUEUE:*SUBMIT_APP:* [= configuredAcls ] nodeLocalityDelay = 40 rackLocalityAdditionalDelay = -1 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 priority = 0 maxLifetime = -1 seconds defaultLifetime = -1 seconds 2019-01-13 00:41:04,178 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized queue: default: capacity=0.5, absoluteCapacity=0.5, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2019-01-13 00:41:04,184 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root.test is undefined 2019-01-13 00:41:04,184 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root.test is undefined 2019-01-13 00:41:04,185 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Initializing test capacity = 0.5 [= (float) configuredCapacity / 100 ] absoluteCapacity = 0.5 [= parentAbsoluteCapacity * capacity ] maxCapacity = 0.5 [= configuredMaxCapacity ] absoluteMaxCapacity = 0.5 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] effectiveMinResource= , effectiveMaxResource= userLimit = 100 [= configuredUserLimit ] userLimitFactor = 1.0 [= configuredUserLimitFactor ] maxApplications = 5000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 5000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = ADMINISTER_QUEUE: SUBMIT_APP: [= configuredAcls ] nodeLocalityDelay = 40 rackLocalityAdditionalDelay = -1 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 priority = 0 maxLifetime = -1 seconds defaultLifetime = -1 seconds 2019-01-13 00:41:04,185 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized queue: test: capacity=0.5, absoluteCapacity=0.5, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2019-01-13 00:41:04,186 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized queue: root: numChildQueue= 2, capacity=1.0, absoluteCapacity=1.0, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2019-01-13 00:41:04,188 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized root queue root: numChildQueue= 2, capacity=1.0, absoluteCapacity=1.0, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2019-01-13 00:41:04,188 INFO org.apache.hadoop.yarn.server.resourcemanager.placement.UserGroupMappingPlacementRule: Initialized queue mappings, override: false 2019-01-13 00:41:04,190 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement.MultiNodeSortingManager: MultiNode scheduling is 'false', and configured policies are 2019-01-13 00:41:04,190 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<>, maximumAllocation=<>, asynchronousScheduling=false, asyncScheduleInterval=5ms,multiNodePlacementEnabled=false 2019-01-13 00:41:04,201 INFO org.apache.hadoop.conf.Configuration: dynamic-resources.xml not found 2019-01-13 00:41:04,204 INFO org.apache.hadoop.yarn.server.resourcemanager.AMSProcessingChain: Initializing AMS Processing chain. Root Processor=[org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor]. 2019-01-13 00:41:04,204 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: disabled placement handler will be used, all scheduling requests will be rejected. 2019-01-13 00:41:04,206 INFO org.apache.hadoop.yarn.server.resourcemanager.AMSProcessingChain: Adding [org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint.processor.DisabledPlacementProcessor] tp top of AMS Processing chain. 2019-01-13 00:41:04,208 INFO org.apache.hadoop.yarn.server.resourcemanager.AMSProcessingChain: Adding [org.apache.hadoop.yarn.server.resourcemanager.OpportunisticContainerAllocatorAMService$OpportunisticAMSProcessor] tp top of AMS Processing chain. 2019-01-13 00:41:04,216 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: TimelineServicePublisher is not configured 2019-01-13 00:41:04,307 INFO org.eclipse.jetty.util.log: Logging initialized @20103ms 2019-01-13 00:41:04,505 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2019-01-13 00:41:04,512 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.resourcemanager is not defined 2019-01-13 00:41:04,532 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2019-01-13 00:41:04,537 INFO org.apache.hadoop.http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster 2019-01-13 00:41:04,537 INFO org.apache.hadoop.http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static 2019-01-13 00:41:04,537 INFO org.apache.hadoop.http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs 2019-01-13 00:41:04,539 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster 2019-01-13 00:41:04,539 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2019-01-13 00:41:04,539 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2019-01-13 00:41:04,546 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /cluster/* 2019-01-13 00:41:04,546 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* 2019-01-13 00:41:04,546 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /app/* 2019-01-13 00:41:05,054 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules 2019-01-13 00:41:05,060 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8088 2019-01-13 00:41:05,064 INFO org.eclipse.jetty.server.Server: jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-06T01:11:56+08:00, git hash: 84205aa28f11a4f31f2a3b86d1bba2cc8ab69827 2019-01-13 00:41:05,135 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2019-01-13 00:41:05,158 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-01-13 00:41:05,163 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s) 2019-01-13 00:41:05,164 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-01-13 00:41:05,217 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@41f4fe5{/logs,file:///home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/logs/,AVAILABLE} 2019-01-13 00:41:05,218 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@39e43310{/static,jar:file:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-common-3.3.0-SNAPSHOT.jar!/webapps/static,AVAILABLE} 2019-01-13 00:41:06,433 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@58278366{/,file:///tmp/jetty-hadoop11-8088-cluster-_-any-315105912293277404.dir/webapp/,AVAILABLE}{/cluster} 2019-01-13 00:41:06,448 INFO org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@3ebc955b{HTTP/1.1,[http/1.1]}{hadoop11:8088} 2019-01-13 00:41:06,448 INFO org.eclipse.jetty.server.Server: Started @22244ms 2019-01-13 00:41:06,448 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app cluster started at 8088 2019-01-13 00:41:06,555 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 100, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-01-13 00:41:06,578 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8033 2019-01-13 00:41:07,243 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server 2019-01-13 00:41:07,244 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-01-13 00:41:07,244 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8033: starting 2019-01-13 00:41:07,247 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioning to active state 2019-01-13 00:41:07,267 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-01-13 00:41:07,268 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens 2019-01-13 00:41:07,268 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens 2019-01-13 00:41:07,268 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-01-13 00:41:07,269 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 1 2019-01-13 00:41:07,269 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-01-13 00:41:07,269 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s) 2019-01-13 00:41:07,269 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-01-13 00:41:07,270 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 2 2019-01-13 00:41:07,270 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-01-13 00:41:07,272 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.nodelabels.event.NodeLabelsStoreEventType for class org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager$ForwardingEventHandler 2019-01-13 00:41:07,490 INFO org.apache.hadoop.yarn.nodelabels.store.AbstractFSNodeStore: Created store directory :file:/tmp/hadoop-yarn-hires/node-attribute 2019-01-13 00:41:07,553 INFO org.apache.hadoop.yarn.nodelabels.store.AbstractFSNodeStore: Finished write mirror at:file:/tmp/hadoop-yarn-hires/node-attribute/nodeattribute.mirror 2019-01-13 00:41:07,553 INFO org.apache.hadoop.yarn.nodelabels.store.AbstractFSNodeStore: Finished create editlog file at:file:/tmp/hadoop-yarn-hires/node-attribute/nodeattribute.editlog 2019-01-13 00:41:07,555 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.nodelabels.NodeAttributesStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.nodelabels.NodeAttributesManagerImpl$ForwardingEventHandler 2019-01-13 00:41:07,555 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement.MultiNodeSortingManager: Starting NodeSortingService=MultiNodeSortingManager 2019-01-13 00:41:07,594 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-01-13 00:41:07,594 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8031 2019-01-13 00:41:07,597 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server 2019-01-13 00:41:07,598 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-01-13 00:41:07,598 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8031: starting 2019-01-13 00:41:07,619 INFO org.apache.hadoop.util.JvmPauseMonitor: Starting JVM pause monitor 2019-01-13 00:41:07,633 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-01-13 00:41:07,646 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8030 2019-01-13 00:41:07,658 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.DistributedSchedulingAMProtocolPB to the server 2019-01-13 00:41:07,661 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-01-13 00:41:07,661 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8030: starting 2019-01-13 00:41:07,772 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-01-13 00:41:07,773 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8032 2019-01-13 00:41:07,778 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server 2019-01-13 00:41:07,779 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-01-13 00:41:07,779 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8032: starting 2019-01-13 00:41:08,701 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 1 2019-01-13 00:41:16,842 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1547311267249_0001' is submitted without priority hence considering default queue/cluster priority: 0 2019-01-13 00:41:16,842 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1547311267249_0001 2019-01-13 00:41:18,419 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 1 submitted by user hires 2019-01-13 00:41:18,420 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1547311267249_0001 2019-01-13 00:41:18,505 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires IP=10.3.1.11 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1547311267249_0001 QUEUENAME=default 2019-01-13 00:41:18,647 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547311267249_0001 State change from NEW to NEW_SAVING on event = START 2019-01-13 00:41:18,647 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1547311267249_0001 2019-01-13 00:41:18,649 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547311267249_0001 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-01-13 00:41:18,680 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1547311267249_0001 user: hires leaf-queue of parent: root #applications: 1 2019-01-13 00:41:18,682 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1547311267249_0001 from user: hires, in queue: default 2019-01-13 00:41:19,479 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547311267249_0001 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-01-13 00:41:19,672 INFO org.apache.hadoop.yarn.server.webproxy.ProxyCA: Created Certificate for OU=YARN-2af90ec3-7bf3-45e6-a100-2e4d6835f4ca 2019-01-13 00:41:19,721 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1547311267249_0001_000001 2019-01-13 00:41:19,726 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000001 State change from NEW to SUBMITTED on event = START 2019-01-13 00:41:19,754 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing CA Certificate and Private Key 2019-01-13 00:41:19,755 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioned to active state 2019-01-13 00:41:19,848 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skipping activateApplications for appattempt_1547311267249_0001_000001 since cluster resource is 2019-01-13 00:41:19,848 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1547311267249_0001 user: hires, leaf-queue: default #user-pending-applications: 1 #user-active-applications: 0 #queue-pending-applications: 1 #queue-active-applications: 0 2019-01-13 00:41:19,849 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1547311267249_0001_000001 to scheduler from user hires in queue default 2019-01-13 00:41:19,861 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-01-13 00:41:34,576 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: NodeManager from node hadoop11(cmPort: 47285 httpPort: 8042) registered with capability: , assigned nodeId hadoop11:47285 2019-01-13 00:41:34,587 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: hadoop11:47285 Node Transitioned from NEW to RUNNING 2019-01-13 00:41:34,610 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2019-01-13 00:41:34,610 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2019-01-13 00:41:34,611 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1547311267249_0001 from user: hires activated in queue: default 2019-01-13 00:41:34,615 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added node hadoop11:47285 clusterResource: 2019-01-13 00:41:34,713 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.distributed.NodeQueueLoadMonitor: Inserting ClusterNode [hadoop11:47285] with queue wait time [0] and wait queue length [0] 2019-01-13 00:41:34,722 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: NodeManager from node hadoop15(cmPort: 33806 httpPort: 8042) registered with capability: , assigned nodeId hadoop15:33806 2019-01-13 00:41:34,722 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: hadoop15:33806 Node Transitioned from NEW to RUNNING 2019-01-13 00:41:34,790 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1547311267249_0001_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-01-13 00:41:34,799 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_01_000001 Container Transitioned from NEW to ALLOCATED 2019-01-13 00:41:34,801 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_1547311267249_0001_01_000001 of capacity on host hadoop11:47285, which has 1 containers, used and available after allocation 2019-01-13 00:41:34,801 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547311267249_0001 CONTAINERID=container_1547311267249_0001_01_000001 RESOURCE= QUEUENAME=default 2019-01-13 00:41:34,845 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : hadoop11:47285 for container : container_1547311267249_0001_01_000001 2019-01-13 00:41:34,861 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-01-13 00:41:34,862 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1547311267249_0001_000001 2019-01-13 00:41:34,863 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1547311267249_0001 AttemptId: appattempt_1547311267249_0001_000001 MasterContainer: Container: [ContainerId: container_1547311267249_0001_01_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop11:47285, NodeHttpAddress: hadoop11:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.11:47285 }, ExecutionType: GUARANTEED, ] 2019-01-13 00:41:34,863 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used= cluster= 2019-01-13 00:41:34,870 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-01-13 00:41:34,874 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added node hadoop15:33806 clusterResource: 2019-01-13 00:41:34,893 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-01-13 00:41:34,901 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-01-13 00:41:34,901 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.distributed.NodeQueueLoadMonitor: Inserting ClusterNode [hadoop15:33806] with queue wait time [0] and wait queue length [0] 2019-01-13 00:41:34,907 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1547311267249_0001_000001 2019-01-13 00:41:35,064 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_1547311267249_0001_01_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop11:47285, NodeHttpAddress: hadoop11:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.11:47285 }, ExecutionType: GUARANTEED, ] for AM appattempt_1547311267249_0001_000001 2019-01-13 00:41:35,066 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1547311267249_0001_000001 2019-01-13 00:41:35,072 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1547311267249_0001_000001 2019-01-13 00:41:35,817 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_1547311267249_0001_01_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop11:47285, NodeHttpAddress: hadoop11:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.11:47285 }, ExecutionType: GUARANTEED, ] for AM appattempt_1547311267249_0001_000001 2019-01-13 00:41:35,818 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000001 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-01-13 00:41:35,818 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1547311267249_0001, attemptId: appattempt_1547311267249_0001_000001launchTime: 1547311295817 2019-01-13 00:41:36,820 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING 2019-01-13 00:41:36,821 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: update exist container 1, strExposedPorts = 2019-01-13 00:41:42,856 WARN SecurityLogger.org.apache.hadoop.ipc.Server: Auth failed for 10.3.1.11:59714:null (DIGEST-MD5: IO error acquiring password) with true cause: (Invalid AMRMToken from appattempt_1547311267249_0001_000001) 2019-01-13 00:41:43,680 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_01_000001 Container Transitioned from RUNNING to COMPLETED 2019-01-13 00:41:43,680 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547311267249_0001 CONTAINERID=container_1547311267249_0001_01_000001 RESOURCE= QUEUENAME=default 2019-01-13 00:41:43,687 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1547311267249_0001_000001 with final state: FAILED, and exit status: 1 2019-01-13 00:41:43,688 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000001 State change from LAUNCHED to FINAL_SAVING on event = CONTAINER_FINISHED 2019-01-13 00:41:43,688 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1547311267249_0001_000001 2019-01-13 00:41:43,690 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1547311267249_0001_000001 2019-01-13 00:41:43,690 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000001 State change from FINAL_SAVING to FAILED on event = ATTEMPT_UPDATE_SAVED 2019-01-13 00:41:43,690 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The number of failed attempts is 1. The max attempts is 2 2019-01-13 00:41:43,691 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1547311267249_0001_000002 2019-01-13 00:41:43,691 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1547311267249_0001_000001 is done. finalState=FAILED 2019-01-13 00:41:43,691 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000002 State change from NEW to SUBMITTED on event = START 2019-01-13 00:41:43,691 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1547311267249_0001 requests cleared 2019-01-13 00:41:43,691 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1547311267249_0001 user: hires queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-01-13 00:41:43,692 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2019-01-13 00:41:43,692 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2019-01-13 00:41:43,692 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1547311267249_0001 from user: hires activated in queue: default 2019-01-13 00:41:43,692 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1547311267249_0001 user: hires, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-01-13 00:41:43,692 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1547311267249_0001_000002 to scheduler from user hires in queue default 2019-01-13 00:41:43,693 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000002 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-01-13 00:41:43,883 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1547311267249_0001_000002 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-01-13 00:41:43,884 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_02_000001 Container Transitioned from NEW to ALLOCATED 2019-01-13 00:41:43,884 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_1547311267249_0001_02_000001 of capacity on host hadoop15:33806, which has 1 containers, used and available after allocation 2019-01-13 00:41:43,885 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547311267249_0001 CONTAINERID=container_1547311267249_0001_02_000001 RESOURCE= QUEUENAME=default 2019-01-13 00:41:43,888 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : hadoop15:33806 for container : container_1547311267249_0001_02_000001 2019-01-13 00:41:43,889 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_02_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-01-13 00:41:43,890 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1547311267249_0001_000002 2019-01-13 00:41:43,890 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1547311267249_0001 AttemptId: appattempt_1547311267249_0001_000002 MasterContainer: Container: [ContainerId: container_1547311267249_0001_02_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop15:33806, NodeHttpAddress: hadoop15:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.15:33806 }, ExecutionType: GUARANTEED, ] 2019-01-13 00:41:43,890 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used= cluster= 2019-01-13 00:41:43,890 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-01-13 00:41:43,891 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000002 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-01-13 00:41:43,892 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000002 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-01-13 00:41:43,893 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1547311267249_0001_000002 2019-01-13 00:41:43,899 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_1547311267249_0001_02_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop15:33806, NodeHttpAddress: hadoop15:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.15:33806 }, ExecutionType: GUARANTEED, ] for AM appattempt_1547311267249_0001_000002 2019-01-13 00:41:43,899 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1547311267249_0001_000002 2019-01-13 00:41:43,899 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1547311267249_0001_000002 2019-01-13 00:41:44,479 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_1547311267249_0001_02_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop15:33806, NodeHttpAddress: hadoop15:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.15:33806 }, ExecutionType: GUARANTEED, ] for AM appattempt_1547311267249_0001_000002 2019-01-13 00:41:44,479 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000002 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-01-13 00:41:44,909 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_02_000001 Container Transitioned from ACQUIRED to RUNNING 2019-01-13 00:41:44,909 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: update exist container 1, strExposedPorts = 2019-01-13 00:41:52,005 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1547311267249_0001_000002 (auth:SIMPLE) 2019-01-13 00:41:53,111 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Node with node id : hadoop15:33806 has shutdown, hence unregistering the node. 2019-01-13 00:41:53,113 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Deactivating Node hadoop15:33806 as it is now SHUTDOWN 2019-01-13 00:41:53,114 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: hadoop15:33806 Node Transitioned from RUNNING to SHUTDOWN 2019-01-13 00:41:53,120 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_02_000001 Container Transitioned from RUNNING to KILLED 2019-01-13 00:41:53,120 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547311267249_0001 CONTAINERID=container_1547311267249_0001_02_000001 RESOURCE= QUEUENAME=default 2019-01-13 00:41:53,121 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1547311267249_0001_000002 with final state: FAILED, and exit status: -100 2019-01-13 00:41:53,121 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000002 State change from LAUNCHED to FINAL_SAVING on event = CONTAINER_FINISHED 2019-01-13 00:41:53,121 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1547311267249_0001_000002 2019-01-13 00:41:53,121 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1547311267249_0001_000002 2019-01-13 00:41:53,122 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000002 State change from FINAL_SAVING to FAILED on event = ATTEMPT_UPDATE_SAVED 2019-01-13 00:41:53,122 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The number of failed attempts is 1. The max attempts is 2 2019-01-13 00:41:53,122 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1547311267249_0001_000003 2019-01-13 00:41:53,122 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000003 State change from NEW to SUBMITTED on event = START 2019-01-13 00:41:53,125 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Removed node hadoop15:33806 clusterResource: 2019-01-13 00:41:53,126 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1547311267249_0001_000002 is done. finalState=FAILED 2019-01-13 00:41:53,126 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1547311267249_0001 requests cleared 2019-01-13 00:41:53,127 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1547311267249_0001 user: hires queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-01-13 00:41:53,127 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2019-01-13 00:41:53,127 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2019-01-13 00:41:53,127 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1547311267249_0001 from user: hires activated in queue: default 2019-01-13 00:41:53,128 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1547311267249_0001 user: hires, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-01-13 00:41:53,128 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1547311267249_0001_000003 to scheduler from user hires in queue default 2019-01-13 00:41:53,129 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000003 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-01-13 00:41:53,730 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1547311267249_0001_000003 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-01-13 00:41:53,731 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_03_000001 Container Transitioned from NEW to ALLOCATED 2019-01-13 00:41:53,731 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_1547311267249_0001_03_000001 of capacity on host hadoop11:47285, which has 1 containers, used and available after allocation 2019-01-13 00:41:53,731 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547311267249_0001 CONTAINERID=container_1547311267249_0001_03_000001 RESOURCE= QUEUENAME=default 2019-01-13 00:41:53,734 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : hadoop11:47285 for container : container_1547311267249_0001_03_000001 2019-01-13 00:41:53,738 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_03_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-01-13 00:41:53,739 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1547311267249_0001_000003 2019-01-13 00:41:53,739 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1547311267249_0001 AttemptId: appattempt_1547311267249_0001_000003 MasterContainer: Container: [ContainerId: container_1547311267249_0001_03_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop11:47285, NodeHttpAddress: hadoop11:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.11:47285 }, ExecutionType: GUARANTEED, ] 2019-01-13 00:41:53,739 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used= cluster= 2019-01-13 00:41:53,739 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-01-13 00:41:53,739 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000003 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-01-13 00:41:53,740 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000003 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-01-13 00:41:53,742 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1547311267249_0001_000003 2019-01-13 00:41:53,746 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_1547311267249_0001_03_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop11:47285, NodeHttpAddress: hadoop11:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.11:47285 }, ExecutionType: GUARANTEED, ] for AM appattempt_1547311267249_0001_000003 2019-01-13 00:41:53,746 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1547311267249_0001_000003 2019-01-13 00:41:53,746 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1547311267249_0001_000003 2019-01-13 00:41:53,771 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_1547311267249_0001_03_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop11:47285, NodeHttpAddress: hadoop11:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.11:47285 }, ExecutionType: GUARANTEED, ] for AM appattempt_1547311267249_0001_000003 2019-01-13 00:41:53,771 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000003 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-01-13 00:41:54,736 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_03_000001 Container Transitioned from ACQUIRED to RUNNING 2019-01-13 00:41:54,737 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: update exist container 1, strExposedPorts = 2019-01-13 00:41:57,123 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1547311267249_0001_000002 2019-01-13 00:41:57,126 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires IP=10.3.1.15 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1547311267249_0001 APPATTEMPTID=appattempt_1547311267249_0001_000002 2019-01-13 00:41:57,127 ERROR org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: App attempt: appattempt_1547311267249_0001_000002 can't handle this event at current state org.apache.hadoop.yarn.state.InvalidStateTransitionException: Invalid event: REGISTERED at FAILED at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:913) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1073) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1054) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:197) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:126) at java.lang.Thread.run(Thread.java:745) 2019-01-13 00:41:57,145 WARN org.apache.hadoop.ipc.Server: IPC Server handler 48 on default port 8030, call Call#12 Retry#0 org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB.registerApplicationMaster from 10.3.1.15:58642: output error 2019-01-13 00:41:57,145 INFO org.apache.hadoop.ipc.Server: IPC Server handler 48 on default port 8030 caught an exception java.nio.channels.ClosedChannelException at sun.nio.ch.SocketChannelImpl.ensureWriteOpen(SocketChannelImpl.java:270) at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:461) at org.apache.hadoop.ipc.Server.channelWrite(Server.java:3457) at org.apache.hadoop.ipc.Server.access$1600(Server.java:137) at org.apache.hadoop.ipc.Server$Responder.processResponse(Server.java:1549) at org.apache.hadoop.ipc.Server$Responder.doRespond(Server.java:1619) at org.apache.hadoop.ipc.Server$Connection.sendResponse(Server.java:2712) at org.apache.hadoop.ipc.Server$Connection.access$300(Server.java:1691) at org.apache.hadoop.ipc.Server$RpcCall.doResponse(Server.java:1012) at org.apache.hadoop.ipc.Server$Call.doResponse(Server.java:824) at org.apache.hadoop.ipc.Server$Call.sendResponse(Server.java:810) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:950) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:878) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2830) 2019-01-13 00:41:58,775 WARN SecurityLogger.org.apache.hadoop.ipc.Server: Auth failed for 10.3.1.11:59759:null (DIGEST-MD5: IO error acquiring password) with true cause: (Invalid AMRMToken from appattempt_1547311267249_0001_000003) 2019-01-13 00:41:59,512 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547311267249_0001_03_000001 Container Transitioned from RUNNING to COMPLETED 2019-01-13 00:41:59,512 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547311267249_0001 CONTAINERID=container_1547311267249_0001_03_000001 RESOURCE= QUEUENAME=default 2019-01-13 00:41:59,513 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1547311267249_0001_000003 with final state: FAILED, and exit status: 1 2019-01-13 00:41:59,513 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000003 State change from LAUNCHED to FINAL_SAVING on event = CONTAINER_FINISHED 2019-01-13 00:41:59,513 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1547311267249_0001_000003 2019-01-13 00:41:59,513 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1547311267249_0001_000003 2019-01-13 00:41:59,513 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547311267249_0001_000003 State change from FINAL_SAVING to FAILED on event = ATTEMPT_UPDATE_SAVED 2019-01-13 00:41:59,513 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The number of failed attempts is 2. The max attempts is 2 2019-01-13 00:41:59,515 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1547311267249_0001 with final state: FAILED 2019-01-13 00:41:59,516 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547311267249_0001 State change from ACCEPTED to FINAL_SAVING on event = ATTEMPT_FAILED 2019-01-13 00:41:59,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1547311267249_0001_000003 is done. finalState=FAILED 2019-01-13 00:41:59,516 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1547311267249_0001 2019-01-13 00:41:59,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1547311267249_0001 requests cleared 2019-01-13 00:41:59,517 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1547311267249_0001 user: hires queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-01-13 00:41:59,517 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Application application_1547311267249_0001 failed 2 times due to AM Container for appattempt_1547311267249_0001_000003 exited with exitCode: 1 Failing this attempt.Diagnostics: [2019-01-13 00:41:59.495]Exception from container-launch. Container id: container_1547311267249_0001_03_000001 Exit code: 1 [2019-01-13 00:41:59.503]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class Jan 13, 2019 12:41:57 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM' Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest" log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. [2019-01-13 00:41:59.504]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class Jan 13, 2019 12:41:57 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM' Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest" log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. For more detailed output, check the application tracking page: http://hadoop11:8088/cluster/app/application_1547311267249_0001 Then click on links to logs of each attempt. . Failing the application. 2019-01-13 00:41:59,523 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547311267249_0001 State change from FINAL_SAVING to FAILED on event = APP_UPDATE_SAVED 2019-01-13 00:41:59,524 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1547311267249_0001 user: hires leaf-queue of parent: root #applications: 0 2019-01-13 00:41:59,526 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1547311267249_0001 failed 2 times due to AM Container for appattempt_1547311267249_0001_000003 exited with exitCode: 1 Failing this attempt.Diagnostics: [2019-01-13 00:41:59.495]Exception from container-launch. Container id: container_1547311267249_0001_03_000001 Exit code: 1 [2019-01-13 00:41:59.503]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class Jan 13, 2019 12:41:57 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM' Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest" log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. [2019-01-13 00:41:59.504]Container exited with a non-zero exit code 1. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class Jan 13, 2019 12:41:57 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class Jan 13, 2019 12:41:57 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM' Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" Jan 13, 2019 12:41:58 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest" log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. For more detailed output, check the application tracking page: http://hadoop11:8088/cluster/app/application_1547311267249_0001 Then click on links to logs of each attempt. . Failing the application. APPID=application_1547311267249_0001 2019-01-13 00:41:59,530 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1547311267249_0001,name=word count,user=hires,queue=default,state=FAILED,trackingUrl=http://hadoop11:8088/cluster/app/application_1547311267249_0001,appMasterHost=N/A,submitTime=1547311273539,startTime=1547311278417,finishTime=1547311319515,finalStatus=FAILED,memorySeconds=48981,vcoreSeconds=22,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=48981 MB-seconds\, 22 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds