2019-01-16 12:54:37,931 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting ResourceManager STARTUP_MSG: host = hadoop11/10.3.1.11 STARTUP_MSG: args = [] STARTUP_MSG: version = 3.3.0-SNAPSHOT STARTUP_MSG: classpath = /home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/etc/hadoop:/tmp/trigger.jar:/tmp/trigger.jar:.:/home/hires/program/jdk1.8.0_65/lib/dt.jar:/home/hires/program/jdk1.8.0_65/lib/tools.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-databind-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jersey-json-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/gson-2.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/metrics-core-3.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-util-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/json-smart-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/dnsjava-2.1.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/stax2-api-3.1.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/accessors-smart-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/javax.activation-api-1.2.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/hadoop-auth-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-http-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-server-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-lang3-3.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-codec-1.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/asm-5.0.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/re2j-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-servlet-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-webapp-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-server-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jettison-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/log4j-1.2.17.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-io-2.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/curator-framework-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-core-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-annotations-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-collections-3.2.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-core-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-compress-1.18.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-client-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jsch-0.1.54.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/httpcore-4.4.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/zookeeper-3.4.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jsp-api-2.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/curator-recipes-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/guava-11.0.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/httpclient-4.5.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerby-config-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/netty-3.10.6.Final.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-net-3.6.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-beanutils-1.9.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-daemon-1.0.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jsr305-3.0.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/paranamer-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-security-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/hadoop-annotations-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/snappy-java-1.0.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-xml-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jersey-server-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jersey-core-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jetty-io-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-text-1.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/token-provider-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/avro-1.7.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/commons-cli-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/curator-client-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerby-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/jersey-servlet-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-common-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/hadoop-kms-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/hadoop-common-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/hadoop-common-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/hadoop-registry-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/common/hadoop-nfs-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-databind-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/gson-2.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-util-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/json-smart-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/dnsjava-2.1.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/audience-annotations-0.5.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/javax.activation-api-1.2.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/hadoop-auth-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-http-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/netty-all-4.0.52.Final.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-lang3-3.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-codec-1.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/asm-5.0.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/re2j-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-servlet-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-webapp-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-server-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jettison-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-io-2.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/curator-framework-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-core-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-annotations-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-compress-1.18.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jsch-0.1.54.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-util-ajax-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/zookeeper-3.4.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/curator-recipes-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/okio-1.6.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-net-3.6.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-beanutils-1.9.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/paranamer-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-security-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/hadoop-annotations-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-xml-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jetty-io-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-text-1.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/avro-1.7.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/curator-client-2.13.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-client-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-nfs-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-client-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.3.0-SNAPSHOT-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/websocket-servlet-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/bcprov-jdk15on-1.60.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jersey-client-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/asm-commons-6.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/asm-tree-6.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jetty-annotations-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jetty-jndi-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/bcpkix-jdk15on-1.60.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/json-io-2.5.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/objenesis-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/javax-websocket-client-impl-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/guice-4.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jackson-jaxrs-base-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.9.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/javax.websocket-api-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/java-util-1.9.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/javax-websocket-server-impl-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/websocket-server-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jetty-plus-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/fst-2.50.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/websocket-client-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/javax.inject-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/websocket-common-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/snakeyaml-1.16.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/jline-3.9.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/lib/websocket-api-9.3.24.v20180605.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-tests-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-services-api-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-common-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-client-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-api-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-registry-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-router-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-submarine-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-common-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-services-core-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-coprocessor-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-common-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-client-3.3.0-SNAPSHOT.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/hbase-client-1.4.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/hbase-common-1.4.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/jcodings-1.0.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/metrics-core-2.2.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/htrace-core-3.1.0-incubating.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/joni-2.1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/hbase-protocol-1.4.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/hbase-annotations-1.4.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/commons-csv-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/timelineservice/lib/commons-lang-2.6.jar STARTUP_MSG: build = https://github.com/apache/hadoop.git -r eee29ed7066e9401c7530b8b6f3b221bacef9a8a; compiled by 'lujie' on 2018-12-31T04:34Z STARTUP_MSG: java = 1.8.0_65 ************************************************************/ 2019-01-16 12:54:37,948 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: registered UNIX signal handlers for [TERM, HUP, INT] 2019-01-16 12:54:38,435 INFO org.apache.hadoop.conf.Configuration: found resource core-site.xml at file:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/etc/hadoop/core-site.xml 2019-01-16 12:54:38,675 INFO org.apache.hadoop.conf.Configuration: resource-types.xml not found 2019-01-16 12:54:38,676 INFO org.apache.hadoop.yarn.util.resource.ResourceUtils: Unable to find 'resource-types.xml'. 2019-01-16 12:54:38,758 INFO org.apache.hadoop.conf.Configuration: found resource yarn-site.xml at file:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/etc/hadoop/yarn-site.xml 2019-01-16 12:54:38,841 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2019-01-16 12:54:38,908 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher 2019-01-16 12:54:39,117 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms 2019-01-16 12:54:39,124 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms 2019-01-16 12:54:39,137 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms 2019-01-16 12:54:39,230 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler 2019-01-16 12:54:39,240 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager 2019-01-16 12:54:39,240 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler 2019-01-16 12:54:39,311 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.event.EventDispatcher 2019-01-16 12:54:39,312 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher 2019-01-16 12:54:39,314 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher 2019-01-16 12:54:39,315 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher 2019-01-16 12:54:39,543 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: Loaded properties from hadoop-metrics2.properties 2019-01-16 12:54:39,650 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2019-01-16 12:54:39,651 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics system started 2019-01-16 12:54:39,689 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.event.EventDispatcher 2019-01-16 12:54:39,700 INFO org.apache.hadoop.yarn.security.YarnAuthorizationProvider: org.apache.hadoop.yarn.security.ConfiguredYarnAuthorizer is instantiated. 2019-01-16 12:54:39,705 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager 2019-01-16 12:54:39,716 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher 2019-01-16 12:54:55,218 INFO org.apache.hadoop.yarn.server.resourcemanager.RMNMInfo: Registered RMNMInfo MBean 2019-01-16 12:54:55,218 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.monitor.RMAppLifetimeMonitor: Application lifelime monitor interval set to 3000 ms. 2019-01-16 12:54:55,227 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement.MultiNodeSortingManager: Initializing NodeSortingService=MultiNodeSortingManager 2019-01-16 12:54:55,233 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude) list 2019-01-16 12:54:55,243 INFO org.apache.hadoop.conf.Configuration: found resource capacity-scheduler.xml at file:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/etc/hadoop/capacity-scheduler.xml 2019-01-16 12:54:55,262 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Minimum allocation = 2019-01-16 12:54:55,262 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Maximum allocation = 2019-01-16 12:54:55,315 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root is undefined 2019-01-16 12:54:55,315 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root is undefined 2019-01-16 12:54:55,330 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: root, capacity=1.0, absoluteCapacity=1.0, maxCapacity=1.0, absoluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APP:*ADMINISTER_QUEUE:*, labels=*, , reservationsContinueLooking=true, orderingPolicy=utilization, priority=0 2019-01-16 12:54:55,330 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Initialized parent-queue root name=root, fullname=root 2019-01-16 12:54:55,352 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root.default is undefined 2019-01-16 12:54:55,352 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root.default is undefined 2019-01-16 12:54:55,356 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Initializing default capacity = 0.5 [= (float) configuredCapacity / 100 ] absoluteCapacity = 0.5 [= parentAbsoluteCapacity * capacity ] maxCapacity = 0.5 [= configuredMaxCapacity ] absoluteMaxCapacity = 0.5 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] effectiveMinResource= , effectiveMaxResource= userLimit = 100 [= configuredUserLimit ] userLimitFactor = 1.0 [= configuredUserLimitFactor ] maxApplications = 5000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 5000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP:*ADMINISTER_QUEUE:* [= configuredAcls ] nodeLocalityDelay = 40 rackLocalityAdditionalDelay = -1 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 priority = 0 maxLifetime = -1 seconds defaultLifetime = -1 seconds 2019-01-16 12:54:55,356 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized queue: default: capacity=0.5, absoluteCapacity=0.5, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2019-01-16 12:54:55,361 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root.test is undefined 2019-01-16 12:54:55,361 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root.test is undefined 2019-01-16 12:54:55,362 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Initializing test capacity = 0.5 [= (float) configuredCapacity / 100 ] absoluteCapacity = 0.5 [= parentAbsoluteCapacity * capacity ] maxCapacity = 0.5 [= configuredMaxCapacity ] absoluteMaxCapacity = 0.5 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] effectiveMinResource= , effectiveMaxResource= userLimit = 100 [= configuredUserLimit ] userLimitFactor = 1.0 [= configuredUserLimitFactor ] maxApplications = 5000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 5000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP: ADMINISTER_QUEUE: [= configuredAcls ] nodeLocalityDelay = 40 rackLocalityAdditionalDelay = -1 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 priority = 0 maxLifetime = -1 seconds defaultLifetime = -1 seconds 2019-01-16 12:54:55,362 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized queue: test: capacity=0.5, absoluteCapacity=0.5, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2019-01-16 12:54:55,363 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized queue: root: numChildQueue= 2, capacity=1.0, absoluteCapacity=1.0, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2019-01-16 12:54:55,365 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerQueueManager: Initialized root queue root: numChildQueue= 2, capacity=1.0, absoluteCapacity=1.0, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2019-01-16 12:54:55,365 INFO org.apache.hadoop.yarn.server.resourcemanager.placement.UserGroupMappingPlacementRule: Initialized queue mappings, override: false 2019-01-16 12:54:55,367 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement.MultiNodeSortingManager: MultiNode scheduling is 'false', and configured policies are 2019-01-16 12:54:55,367 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<>, maximumAllocation=<>, asynchronousScheduling=false, asyncScheduleInterval=5ms,multiNodePlacementEnabled=false 2019-01-16 12:54:55,379 INFO org.apache.hadoop.conf.Configuration: dynamic-resources.xml not found 2019-01-16 12:54:55,382 INFO org.apache.hadoop.yarn.server.resourcemanager.AMSProcessingChain: Initializing AMS Processing chain. Root Processor=[org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor]. 2019-01-16 12:54:55,382 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: disabled placement handler will be used, all scheduling requests will be rejected. 2019-01-16 12:54:55,384 INFO org.apache.hadoop.yarn.server.resourcemanager.AMSProcessingChain: Adding [org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint.processor.DisabledPlacementProcessor] tp top of AMS Processing chain. 2019-01-16 12:54:55,386 INFO org.apache.hadoop.yarn.server.resourcemanager.AMSProcessingChain: Adding [org.apache.hadoop.yarn.server.resourcemanager.OpportunisticContainerAllocatorAMService$OpportunisticAMSProcessor] tp top of AMS Processing chain. 2019-01-16 12:54:55,395 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: TimelineServicePublisher is not configured 2019-01-16 12:54:55,493 INFO org.eclipse.jetty.util.log: Logging initialized @19731ms 2019-01-16 12:54:56,467 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2019-01-16 12:54:56,476 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.resourcemanager is not defined 2019-01-16 12:54:56,502 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2019-01-16 12:54:56,508 INFO org.apache.hadoop.http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster 2019-01-16 12:54:56,508 INFO org.apache.hadoop.http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs 2019-01-16 12:54:56,508 INFO org.apache.hadoop.http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static 2019-01-16 12:54:56,510 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster 2019-01-16 12:54:56,510 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2019-01-16 12:54:56,510 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2019-01-16 12:54:56,518 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /cluster/* 2019-01-16 12:54:56,518 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* 2019-01-16 12:54:56,518 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /app/* 2019-01-16 12:54:57,098 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules 2019-01-16 12:54:57,104 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8088 2019-01-16 12:54:57,110 INFO org.eclipse.jetty.server.Server: jetty-9.3.z-SNAPSHOT, build timestamp: 2018-06-06T01:11:56+08:00, git hash: 84205aa28f11a4f31f2a3b86d1bba2cc8ab69827 2019-01-16 12:54:57,188 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2019-01-16 12:54:57,215 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-01-16 12:54:57,220 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s) 2019-01-16 12:54:57,221 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-01-16 12:54:57,282 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@3e6534e7{/logs,file:///home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/logs/,AVAILABLE} 2019-01-16 12:54:57,283 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@9a6fbc0{/static,jar:file:/home/hires/cloudraid/hadoop/hadoop-3.3.0-SNAPSHOT/share/hadoop/yarn/hadoop-yarn-common-3.3.0-SNAPSHOT.jar!/webapps/static,AVAILABLE} 2019-01-16 12:54:58,539 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@15c6027d{/,file:///tmp/jetty-hadoop11-8088-cluster-_-any-9097427477784636546.dir/webapp/,AVAILABLE}{/cluster} 2019-01-16 12:54:58,556 INFO org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@64518270{HTTP/1.1,[http/1.1]}{hadoop11:8088} 2019-01-16 12:54:58,556 INFO org.eclipse.jetty.server.Server: Started @22794ms 2019-01-16 12:54:58,557 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app cluster started at 8088 2019-01-16 12:54:58,694 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 100, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-01-16 12:54:58,724 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8033 2019-01-16 12:54:59,478 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server 2019-01-16 12:54:59,479 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-01-16 12:54:59,479 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8033: starting 2019-01-16 12:54:59,482 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioning to active state 2019-01-16 12:54:59,508 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating AMRMToken 2019-01-16 12:54:59,508 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens 2019-01-16 12:54:59,509 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens 2019-01-16 12:54:59,509 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-01-16 12:54:59,509 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 1 2019-01-16 12:54:59,509 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-01-16 12:54:59,510 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s) 2019-01-16 12:54:59,510 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens 2019-01-16 12:54:59,510 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMDelegationTokenSecretManager: storing master key with keyID 2 2019-01-16 12:54:59,510 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing RMDTMasterKey. 2019-01-16 12:54:59,513 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.nodelabels.event.NodeLabelsStoreEventType for class org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager$ForwardingEventHandler 2019-01-16 12:54:59,766 INFO org.apache.hadoop.yarn.nodelabels.store.AbstractFSNodeStore: Created store directory :file:/tmp/hadoop-yarn-hires/node-attribute 2019-01-16 12:54:59,838 INFO org.apache.hadoop.yarn.nodelabels.store.AbstractFSNodeStore: Finished write mirror at:file:/tmp/hadoop-yarn-hires/node-attribute/nodeattribute.mirror 2019-01-16 12:54:59,838 INFO org.apache.hadoop.yarn.nodelabels.store.AbstractFSNodeStore: Finished create editlog file at:file:/tmp/hadoop-yarn-hires/node-attribute/nodeattribute.editlog 2019-01-16 12:54:59,840 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.nodelabels.NodeAttributesStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.nodelabels.NodeAttributesManagerImpl$ForwardingEventHandler 2019-01-16 12:54:59,841 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement.MultiNodeSortingManager: Starting NodeSortingService=MultiNodeSortingManager 2019-01-16 12:54:59,879 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-01-16 12:54:59,880 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8031 2019-01-16 12:54:59,883 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server 2019-01-16 12:54:59,884 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-01-16 12:54:59,884 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8031: starting 2019-01-16 12:54:59,908 INFO org.apache.hadoop.util.JvmPauseMonitor: Starting JVM pause monitor 2019-01-16 12:54:59,925 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-01-16 12:54:59,945 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8030 2019-01-16 12:54:59,958 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.DistributedSchedulingAMProtocolPB to the server 2019-01-16 12:54:59,962 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-01-16 12:54:59,962 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8030: starting 2019-01-16 12:55:00,111 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 5000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2019-01-16 12:55:00,112 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8032 2019-01-16 12:55:00,119 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server 2019-01-16 12:55:00,120 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2019-01-16 12:55:00,120 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8032: starting 2019-01-16 12:55:00,518 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 1 2019-01-16 12:55:09,970 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application 'application_1547614499484_0001' is submitted without priority hence considering default queue/cluster priority: 0 2019-01-16 12:55:09,970 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Priority '0' is acceptable in queue : default for application: application_1547614499484_0001 2019-01-16 12:55:10,160 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 1 submitted by user hires 2019-01-16 12:55:10,161 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1547614499484_0001 2019-01-16 12:55:10,166 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires IP=10.3.1.11 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1547614499484_0001 QUEUENAME=default 2019-01-16 12:55:10,189 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1547614499484_0001 2019-01-16 12:55:10,189 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547614499484_0001 State change from NEW to NEW_SAVING on event = START 2019-01-16 12:55:10,191 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547614499484_0001 State change from NEW_SAVING to SUBMITTED on event = APP_NEW_SAVED 2019-01-16 12:55:10,262 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1547614499484_0001 user: hires leaf-queue of parent: root #applications: 1 2019-01-16 12:55:10,265 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1547614499484_0001 from user: hires, in queue: default 2019-01-16 12:55:11,136 INFO org.apache.hadoop.yarn.server.webproxy.ProxyCA: Created Certificate for OU=YARN-3b666f75-0b86-4498-b909-dc8877ed8bd1 2019-01-16 12:55:11,204 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547614499484_0001 State change from SUBMITTED to ACCEPTED on event = APP_ACCEPTED 2019-01-16 12:55:11,225 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing CA Certificate and Private Key 2019-01-16 12:55:11,225 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioned to active state 2019-01-16 12:55:11,275 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1547614499484_0001_000001 2019-01-16 12:55:11,278 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000001 State change from NEW to SUBMITTED on event = START 2019-01-16 12:55:11,406 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skipping activateApplications for appattempt_1547614499484_0001_000001 since cluster resource is 2019-01-16 12:55:11,406 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1547614499484_0001 user: hires, leaf-queue: default #user-pending-applications: 1 #user-active-applications: 0 #queue-pending-applications: 1 #queue-active-applications: 0 2019-01-16 12:55:11,406 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1547614499484_0001_000001 to scheduler from user hires in queue default 2019-01-16 12:55:11,424 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000001 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-01-16 12:55:27,416 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: NodeManager from node hadoop15(cmPort: 44540 httpPort: 8042) registered with capability: , assigned nodeId hadoop15:44540 2019-01-16 12:55:27,418 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: NodeManager from node hadoop14(cmPort: 51816 httpPort: 8042) registered with capability: , assigned nodeId hadoop14:51816 2019-01-16 12:55:27,427 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: hadoop15:44540 Node Transitioned from NEW to RUNNING 2019-01-16 12:55:27,428 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: hadoop14:51816 Node Transitioned from NEW to RUNNING 2019-01-16 12:55:27,451 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2019-01-16 12:55:27,451 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2019-01-16 12:55:27,452 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1547614499484_0001 from user: hires activated in queue: default 2019-01-16 12:55:27,455 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added node hadoop15:44540 clusterResource: 2019-01-16 12:55:27,458 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added node hadoop14:51816 clusterResource: 2019-01-16 12:55:27,580 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.distributed.NodeQueueLoadMonitor: Inserting ClusterNode [hadoop15:44540] with queue wait time [0] and wait queue length [0] 2019-01-16 12:55:27,580 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.distributed.NodeQueueLoadMonitor: Inserting ClusterNode [hadoop14:51816] with queue wait time [0] and wait queue length [0] 2019-01-16 12:55:27,663 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1547614499484_0001_000001 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-01-16 12:55:27,673 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_01_000001 Container Transitioned from NEW to ALLOCATED 2019-01-16 12:55:27,674 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_1547614499484_0001_01_000001 of capacity on host hadoop15:44540, which has 1 containers, used and available after allocation 2019-01-16 12:55:27,675 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547614499484_0001 CONTAINERID=container_1547614499484_0001_01_000001 RESOURCE= QUEUENAME=default 2019-01-16 12:55:27,717 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : hadoop15:44540 for container : container_1547614499484_0001_01_000001 2019-01-16 12:55:27,732 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-01-16 12:55:27,733 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1547614499484_0001_000001 2019-01-16 12:55:27,733 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1547614499484_0001 AttemptId: appattempt_1547614499484_0001_000001 MasterContainer: Container: [ContainerId: container_1547614499484_0001_01_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop15:44540, NodeHttpAddress: hadoop15:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.15:44540 }, ExecutionType: GUARANTEED, ] 2019-01-16 12:55:27,733 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used= cluster= 2019-01-16 12:55:27,739 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-01-16 12:55:27,760 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-01-16 12:55:27,769 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-01-16 12:55:27,776 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1547614499484_0001_000001 2019-01-16 12:55:27,948 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_1547614499484_0001_01_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop15:44540, NodeHttpAddress: hadoop15:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.15:44540 }, ExecutionType: GUARANTEED, ] for AM appattempt_1547614499484_0001_000001 2019-01-16 12:55:27,951 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1547614499484_0001_000001 2019-01-16 12:55:27,958 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1547614499484_0001_000001 2019-01-16 12:55:29,327 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: Node with node id : hadoop15:44540 has shutdown, hence unregistering the node. 2019-01-16 12:55:29,331 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Deactivating Node hadoop15:44540 as it is now SHUTDOWN 2019-01-16 12:55:29,331 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: hadoop15:44540 Node Transitioned from RUNNING to SHUTDOWN 2019-01-16 12:55:29,348 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_01_000001 Container Transitioned from ACQUIRED to KILLED 2019-01-16 12:55:29,348 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547614499484_0001 CONTAINERID=container_1547614499484_0001_01_000001 RESOURCE= QUEUENAME=default 2019-01-16 12:55:29,352 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1547614499484_0001_000001 with final state: FAILED, and exit status: -100 2019-01-16 12:55:29,354 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000001 State change from ALLOCATED to FINAL_SAVING on event = CONTAINER_FINISHED 2019-01-16 12:55:29,354 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1547614499484_0001_000001 2019-01-16 12:55:29,355 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Removed node hadoop15:44540 clusterResource: 2019-01-16 12:55:29,355 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1547614499484_0001_000001 2019-01-16 12:55:29,356 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000001 State change from FINAL_SAVING to FAILED on event = ATTEMPT_UPDATE_SAVED 2019-01-16 12:55:29,356 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: The number of failed attempts is 0. The max attempts is 2 2019-01-16 12:55:29,356 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1547614499484_0001_000002 2019-01-16 12:55:29,357 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000002 State change from NEW to SUBMITTED on event = START 2019-01-16 12:55:29,357 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1547614499484_0001_000001 is done. finalState=FAILED 2019-01-16 12:55:29,357 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1547614499484_0001 requests cleared 2019-01-16 12:55:29,357 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1547614499484_0001 user: hires queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-01-16 12:55:29,358 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2019-01-16 12:55:29,358 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2019-01-16 12:55:29,358 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1547614499484_0001 from user: hires activated in queue: default 2019-01-16 12:55:29,358 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1547614499484_0001 user: hires, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2019-01-16 12:55:29,358 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1547614499484_0001_000002 to scheduler from user hires in queue default 2019-01-16 12:55:29,359 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000002 State change from SUBMITTED to SCHEDULED on event = ATTEMPT_ADDED 2019-01-16 12:55:29,627 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1547614499484_0001_000002 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-01-16 12:55:29,628 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000001 Container Transitioned from NEW to ALLOCATED 2019-01-16 12:55:29,628 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_1547614499484_0001_02_000001 of capacity on host hadoop14:51816, which has 1 containers, used and available after allocation 2019-01-16 12:55:29,628 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547614499484_0001 CONTAINERID=container_1547614499484_0001_02_000001 RESOURCE= QUEUENAME=default 2019-01-16 12:55:29,631 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : hadoop14:51816 for container : container_1547614499484_0001_02_000001 2019-01-16 12:55:29,632 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000001 Container Transitioned from ALLOCATED to ACQUIRED 2019-01-16 12:55:29,632 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1547614499484_0001_000002 2019-01-16 12:55:29,632 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1547614499484_0001 AttemptId: appattempt_1547614499484_0001_000002 MasterContainer: Container: [ContainerId: container_1547614499484_0001_02_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop14:51816, NodeHttpAddress: hadoop14:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.14:51816 }, ExecutionType: GUARANTEED, ] 2019-01-16 12:55:29,633 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used= cluster= 2019-01-16 12:55:29,633 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-01-16 12:55:29,635 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000002 State change from SCHEDULED to ALLOCATED_SAVING on event = CONTAINER_ALLOCATED 2019-01-16 12:55:29,636 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000002 State change from ALLOCATED_SAVING to ALLOCATED on event = ATTEMPT_NEW_SAVED 2019-01-16 12:55:29,637 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1547614499484_0001_000002 2019-01-16 12:55:29,642 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_1547614499484_0001_02_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop14:51816, NodeHttpAddress: hadoop14:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.14:51816 }, ExecutionType: GUARANTEED, ] for AM appattempt_1547614499484_0001_000002 2019-01-16 12:55:29,642 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1547614499484_0001_000002 2019-01-16 12:55:29,642 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1547614499484_0001_000002 2019-01-16 12:55:33,320 WARN org.apache.hadoop.ipc.Client: Exception encountered while connecting to the server : java.io.EOFException 2019-01-16 12:55:33,332 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Error launching appattempt_1547614499484_0001_000001. Got exception: java.io.IOException: DestHost:destPort hadoop15:44540 , LocalHost:localPort hadoop11/10.3.1.11:0. Failed on local exception: java.io.IOException: java.io.EOFException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:422) at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:831) at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:806) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1547) at org.apache.hadoop.ipc.Client.call(Client.java:1489) at org.apache.hadoop.ipc.Client.call(Client.java:1388) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:233) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy83.startContainers(Unknown Source) at org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagementProtocolPBClientImpl.startContainers(ContainerManagementProtocolPBClientImpl.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy84.startContainers(Unknown Source) at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.launch(AMLauncher.java:126) at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.run(AMLauncher.java:337) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: java.io.EOFException at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:770) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876) at org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:733) at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:827) at org.apache.hadoop.ipc.Client$Connection.access$3800(Client.java:421) at org.apache.hadoop.ipc.Client.getConnection(Client.java:1604) at org.apache.hadoop.ipc.Client.call(Client.java:1435) ... 20 more Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:392) at org.apache.hadoop.ipc.Client$IpcStreams.readResponse(Client.java:1849) at org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:361) at org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:627) at org.apache.hadoop.ipc.Client$Connection.access$2300(Client.java:421) at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:814) at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:810) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876) at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:810) ... 23 more 2019-01-16 12:55:33,334 ERROR org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: App attempt: appattempt_1547614499484_0001_000001 can't handle this event at current state org.apache.hadoop.yarn.state.InvalidStateTransitionException: Invalid event: LAUNCH_FAILED at FAILED at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:913) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:121) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1073) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1054) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:197) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:126) at java.lang.Thread.run(Thread.java:745) 2019-01-16 12:55:35,403 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_1547614499484_0001_02_000001, AllocationRequestId: -1, Version: 0, NodeId: hadoop14:51816, NodeHttpAddress: hadoop14:8042, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.3.1.14:51816 }, ExecutionType: GUARANTEED, ] for AM appattempt_1547614499484_0001_000002 2019-01-16 12:55:35,404 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000002 State change from ALLOCATED to LAUNCHED on event = LAUNCHED 2019-01-16 12:55:35,405 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: update the launch time for applicationId: application_1547614499484_0001, attemptId: appattempt_1547614499484_0001_000002launchTime: 1547614535404 2019-01-16 12:55:35,689 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000001 Container Transitioned from ACQUIRED to RUNNING 2019-01-16 12:55:35,690 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: update exist container 1, strExposedPorts = 2019-01-16 12:55:43,507 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1547614499484_0001_000002 (auth:SIMPLE) 2019-01-16 12:55:43,554 INFO org.apache.hadoop.yarn.server.resourcemanager.DefaultAMSProcessor: AM registration appattempt_1547614499484_0001_000002 2019-01-16 12:55:43,555 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires IP=10.3.1.14 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1547614499484_0001 APPATTEMPTID=appattempt_1547614499484_0001_000002 2019-01-16 12:55:43,556 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000002 State change from LAUNCHED to RUNNING on event = REGISTERED 2019-01-16 12:55:43,556 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547614499484_0001 State change from ACCEPTED to RUNNING on event = ATTEMPT_REGISTERED 2019-01-16 12:55:44,742 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1547614499484_0001_000002 container=null queue=default clusterResource= type=NODE_LOCAL requestedPartition= 2019-01-16 12:55:44,743 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000002 Container Transitioned from NEW to ALLOCATED 2019-01-16 12:55:44,744 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_1547614499484_0001_02_000002 of capacity on host hadoop14:51816, which has 2 containers, used and available after allocation 2019-01-16 12:55:44,744 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547614499484_0001 CONTAINERID=container_1547614499484_0001_02_000002 RESOURCE= QUEUENAME=default 2019-01-16 12:55:44,745 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used= cluster= 2019-01-16 12:55:44,745 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-01-16 12:55:45,776 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : hadoop14:51816 for container : container_1547614499484_0001_02_000002 2019-01-16 12:55:45,781 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000002 Container Transitioned from ALLOCATED to ACQUIRED 2019-01-16 12:55:46,752 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000002 Container Transitioned from ACQUIRED to RUNNING 2019-01-16 12:55:46,752 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: update exist container 2, strExposedPorts = 2019-01-16 12:55:46,827 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1547614499484_0001 2019-01-16 12:55:49,558 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000002 Container Transitioned from RUNNING to COMPLETED 2019-01-16 12:55:49,559 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547614499484_0001 CONTAINERID=container_1547614499484_0001_02_000002 RESOURCE= QUEUENAME=default 2019-01-16 12:55:51,569 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1547614499484_0001_000002 container=null queue=default clusterResource= type=OFF_SWITCH requestedPartition= 2019-01-16 12:55:51,570 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000003 Container Transitioned from NEW to ALLOCATED 2019-01-16 12:55:51,570 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerNode: Assigned container container_1547614499484_0001_02_000003 of capacity on host hadoop14:51816, which has 2 containers, used and available after allocation 2019-01-16 12:55:51,570 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547614499484_0001 CONTAINERID=container_1547614499484_0001_02_000003 RESOURCE= QUEUENAME=default 2019-01-16 12:55:51,570 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used= cluster= 2019-01-16 12:55:51,570 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted 2019-01-16 12:55:51,875 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000003 Container Transitioned from ALLOCATED to ACQUIRED 2019-01-16 12:55:52,574 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000003 Container Transitioned from ACQUIRED to RUNNING 2019-01-16 12:55:52,574 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: update exist container 3, strExposedPorts = 2019-01-16 12:55:52,882 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1547614499484_0001 2019-01-16 12:55:55,634 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000003 Container Transitioned from RUNNING to COMPLETED 2019-01-16 12:55:55,635 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547614499484_0001 CONTAINERID=container_1547614499484_0001_02_000003 RESOURCE= QUEUENAME=default 2019-01-16 12:55:55,652 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Updating application attempt appattempt_1547614499484_0001_000002 with final state: FINISHING, and exit status: -1000 2019-01-16 12:55:55,652 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000002 State change from RUNNING to FINAL_SAVING on event = UNREGISTERED 2019-01-16 12:55:55,653 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Updating application application_1547614499484_0001 with final state: FINISHING 2019-01-16 12:55:55,653 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547614499484_0001 State change from RUNNING to FINAL_SAVING on event = ATTEMPT_UNREGISTERED 2019-01-16 12:55:55,653 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Updating info for app: application_1547614499484_0001 2019-01-16 12:55:55,654 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000002 State change from FINAL_SAVING to FINISHING on event = ATTEMPT_UPDATE_SAVED 2019-01-16 12:55:55,654 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547614499484_0001 State change from FINAL_SAVING to FINISHING on event = APP_UPDATE_SAVED 2019-01-16 12:55:56,655 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: application_1547614499484_0001 unregistered successfully. 2019-01-16 12:56:01,769 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1547614499484_0001_02_000001 Container Transitioned from RUNNING to COMPLETED 2019-01-16 12:56:01,769 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Unregistering app attempt : appattempt_1547614499484_0001_000002 2019-01-16 12:56:01,769 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1547614499484_0001 CONTAINERID=container_1547614499484_0001_02_000001 RESOURCE= QUEUENAME=default 2019-01-16 12:56:01,769 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Application finished, removing password for appattempt_1547614499484_0001_000002 2019-01-16 12:56:01,773 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1547614499484_0001_000002 State change from FINISHING to FINISHED on event = CONTAINER_FINISHED 2019-01-16 12:56:01,781 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1547614499484_0001 State change from FINISHING to FINISHED on event = ATTEMPT_FINISHED 2019-01-16 12:56:01,781 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_1547614499484_0001_000002 is done. finalState=FINISHED 2019-01-16 12:56:01,781 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1547614499484_0001 requests cleared 2019-01-16 12:56:01,782 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_1547614499484_0001 user: hires queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2019-01-16 12:56:01,782 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Cleaning master appattempt_1547614499484_0001_000002 2019-01-16 12:56:01,782 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: application_1547614499484_0001 user: hires leaf-queue of parent: root #applications: 0 2019-01-16 12:56:01,783 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hires OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1547614499484_0001 2019-01-16 12:56:01,790 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1547614499484_0001,name=word count,user=hires,queue=default,state=FINISHED,trackingUrl=http://hadoop11:8088/proxy/application_1547614499484_0001/,appMasterHost=hadoop14,submitTime=1547614505429,startTime=1547614510159,finishTime=1547614555653,finalStatus=SUCCEEDED,memorySeconds=78384,vcoreSeconds=41,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=MAPREDUCE,resourceSeconds=78384 MB-seconds\, 41 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds