2018-08-05 12:19:45,836 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NodeManager STARTUP_MSG: host = hadoop11/10.3.1.11 STARTUP_MSG: args = [] STARTUP_MSG: version = 3.1.0 STARTUP_MSG: classpath = /home/hires/cloudraid/hadoop/hadoop-3.1.0/etc/hadoop:/home/hires/cloudraid/conf/classloader/javassist.jar:/home/hires/cloudraid/conf/classloader/trigger.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jersey-json-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerb-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/gson-2.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/metrics-core-3.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/curator-client-2.12.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/hadoop-annotations-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jetty-servlet-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/json-smart-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-lang3-3.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/stax2-api-3.1.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/accessors-smart-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/zookeeper-3.4.9.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jackson-core-2.7.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/curator-recipes-2.12.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerb-server-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-codec-1.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/asm-5.0.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/re2j-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/curator-framework-2.12.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jettison-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-io-2.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-collections-3.2.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerb-core-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerb-client-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jsch-0.1.54.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/httpcore-4.4.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jsp-api-2.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jetty-util-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/hamcrest-core-1.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/guava-11.0.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/httpclient-4.5.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jetty-server-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jetty-http-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/nimbus-jose-jwt-4.41.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/netty-3.10.5.Final.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerby-config-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jetty-webapp-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jackson-annotations-2.7.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-net-3.6.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-beanutils-1.9.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jsr305-3.0.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/paranamer-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/hadoop-auth-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-lang-2.6.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jetty-io-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/snappy-java-1.0.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jersey-server-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jersey-core-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jackson-databind-2.7.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/token-provider-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/xz-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/junit-4.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/avro-1.7.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/commons-cli-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jetty-security-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerby-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jetty-xml-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/jersey-servlet-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerb-common-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/hadoop-common-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/hadoop-nfs-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/hadoop-kms-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/common/hadoop-common-3.1.0-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/gson-2.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/curator-client-2.12.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/hadoop-annotations-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/json-smart-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-lang3-3.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-compress-1.4.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/zookeeper-3.4.9.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-core-2.7.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/curator-recipes-2.12.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/netty-all-4.0.52.Final.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-codec-1.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/asm-5.0.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/re2j-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/curator-framework-2.12.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jettison-1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-io-2.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jsch-0.1.54.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-util-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-server-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-http-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/okio-1.6.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/netty-3.10.5.Final.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-annotations-2.7.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-net-3.6.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-beanutils-1.9.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/paranamer-2.3.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/hadoop-auth-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-io-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jackson-databind-2.7.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/xz-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/avro-1.7.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-security-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-nfs-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-client-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-rbf-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.1.0-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-client-3.1.0-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-rbf-3.1.0-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/hdfs/hadoop-hdfs-3.1.0-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.0-tests.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/jackson-jaxrs-base-2.7.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/jersey-client-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/dnsjava-2.1.7.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/json-io-2.5.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/guice-4.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/java-util-1.9.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/fst-2.50.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/snakeyaml-1.16.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-client-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-services-api-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-common-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-api-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-registry-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-router-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-services-core-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-common-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-server-tests-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-client-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-common-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-hbase-coprocessor-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/hadoop-yarn-server-timelineservice-3.1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/lib/jcodings-1.0.13.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/lib/metrics-core-2.2.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/lib/htrace-core-3.1.0-incubating.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/lib/hbase-client-1.2.6.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/lib/joni-2.1.2.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/lib/hbase-common-1.2.6.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/lib/hbase-protocol-1.2.6.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/lib/commons-csv-1.0.jar:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/timelineservice/lib/hbase-annotations-1.2.6.jar STARTUP_MSG: build = https://github.com/apache/hadoop -r 16b70619a24cdcf5d3b0fcf4b58ca77238ccbe6d; compiled by 'centos' on 2018-03-30T00:00Z STARTUP_MSG: java = 1.8.0_65 ************************************************************/ 2018-08-05 12:19:45,851 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT] 2018-08-05 12:19:46,554 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2018-08-05 12:19:47,098 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2018-08-05 12:19:47,202 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2018-08-05 12:19:47,205 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2018-08-05 12:19:47,207 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2018-08-05 12:19:47,208 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2018-08-05 12:19:47,208 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2018-08-05 12:19:47,209 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2018-08-05 12:19:47,210 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2018-08-05 12:19:47,214 INFO org.apache.hadoop.yarn.server.nodemanager.logaggregation.tracker.NMLogAggregationStatusTracker: the rolling interval seconds for the NodeManager Cached Log aggregation status is 600 2018-08-05 12:19:47,248 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl 2018-08-05 12:19:47,249 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.NodeManager 2018-08-05 12:19:47,654 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2018-08-05 12:19:47,746 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-08-05 12:19:47,746 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system started 2018-08-05 12:19:47,782 INFO org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection: Disk Validator: yarn.nodemanager.disk-validator is loaded. 2018-08-05 12:19:47,797 INFO org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection: Disk Validator: yarn.nodemanager.disk-validator is loaded. 2018-08-05 12:19:47,877 INFO org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl: Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.ResourceCalculatorPlugin@2a7ed1f 2018-08-05 12:19:47,881 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2018-08-05 12:19:47,884 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2018-08-05 12:19:47,884 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: AMRMProxyService is disabled 2018-08-05 12:19:47,884 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: per directory file limit = 8192 2018-08-05 12:19:47,958 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: usercache path : file:/home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/usercache_DEL_1533442787890 2018-08-05 12:19:47,985 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Disk Validator: yarn.nodemanager.disk-validator is loaded. 2018-08-05 12:19:47,995 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2018-08-05 12:19:48,072 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Adding auxiliary service mapreduce_shuffle, "mapreduce_shuffle" 2018-08-05 12:19:48,247 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.ResourceCalculatorPlugin@609db546 2018-08-05 12:19:48,248 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Using ResourceCalculatorProcessTree : null 2018-08-05 12:19:48,250 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Physical memory check enabled: true 2018-08-05 12:19:48,250 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Virtual memory check enabled: true 2018-08-05 12:19:48,251 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: ContainersMonitor enabled: true 2018-08-05 12:19:48,253 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Not a recoverable state store. Nothing to recover. 2018-08-05 12:19:48,296 INFO org.apache.hadoop.conf.Configuration: resource-types.xml not found 2018-08-05 12:19:48,296 INFO org.apache.hadoop.yarn.util.resource.ResourceUtils: Unable to find 'resource-types.xml'. 2018-08-05 12:19:48,303 INFO org.apache.hadoop.conf.Configuration: node-resources.xml not found 2018-08-05 12:19:48,303 INFO org.apache.hadoop.yarn.util.resource.ResourceUtils: Unable to find 'node-resources.xml'. 2018-08-05 12:19:48,305 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Nodemanager resources is set to: 2018-08-05 12:19:48,311 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2018-08-05 12:19:48,443 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 2000 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2018-08-05 12:19:48,497 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 45230 2018-08-05 12:19:49,158 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server 2018-08-05 12:19:49,159 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2018-08-05 12:19:49,159 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 45230: starting 2018-08-05 12:19:49,173 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Updating node address : hadoop11:45230 2018-08-05 12:19:49,186 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 500 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2018-08-05 12:19:49,187 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8040 2018-08-05 12:19:49,190 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server 2018-08-05 12:19:49,191 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2018-08-05 12:19:49,191 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8040: starting 2018-08-05 12:19:49,192 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Localizer started on port 8040 2018-08-05 12:19:49,258 INFO org.apache.hadoop.mapred.IndexCache: IndexCache created with max memory = 10485760 2018-08-05 12:19:49,303 INFO org.apache.hadoop.mapred.ShuffleHandler: mapreduce_shuffle listening on port 13562 2018-08-05 12:19:49,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager started at hadoop11/10.3.1.11:45230 2018-08-05 12:19:49,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:0 2018-08-05 12:19:49,307 WARN org.apache.hadoop.yarn.server.nodemanager.logaggregation.tracker.NMLogAggregationStatusTracker: Log Aggregation is disabled.So is the LogAggregationStatusTracker. 2018-08-05 12:19:49,318 INFO org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:8042 2018-08-05 12:19:49,400 INFO org.eclipse.jetty.util.log: Logging initialized @4460ms 2018-08-05 12:19:49,624 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2018-08-05 12:19:49,631 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined 2018-08-05 12:19:49,646 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2018-08-05 12:19:49,649 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node 2018-08-05 12:19:49,649 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-08-05 12:19:49,649 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-08-05 12:19:49,651 INFO org.apache.hadoop.http.HttpServer2: Added filter authentication (class=org.apache.hadoop.security.authentication.server.AuthenticationFilter) to context node 2018-08-05 12:19:49,651 INFO org.apache.hadoop.http.HttpServer2: Added filter authentication (class=org.apache.hadoop.security.authentication.server.AuthenticationFilter) to context static 2018-08-05 12:19:49,651 INFO org.apache.hadoop.http.HttpServer2: Added filter authentication (class=org.apache.hadoop.security.authentication.server.AuthenticationFilter) to context logs 2018-08-05 12:19:49,658 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /node/* 2018-08-05 12:19:49,658 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* 2018-08-05 12:19:50,110 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules 2018-08-05 12:19:50,113 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8042 2018-08-05 12:19:50,116 INFO org.eclipse.jetty.server.Server: jetty-9.3.z-SNAPSHOT 2018-08-05 12:19:50,180 INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2018-08-05 12:19:50,184 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@b40bb6e{/logs,file:///home/hires/cloudraid/hadoop/hadoop-3.1.0/logs/,AVAILABLE} 2018-08-05 12:19:50,184 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@631e06ab{/static,jar:file:/home/hires/cloudraid/hadoop/hadoop-3.1.0/share/hadoop/yarn/hadoop-yarn-common-3.1.0.jar!/webapps/static,AVAILABLE} 2018-08-05 12:19:51,134 INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@bfc14b9{/,file:///tmp/jetty-0.0.0.0-8042-node-_-any-7426074247262499282.dir/webapp/,AVAILABLE}{/node} 2018-08-05 12:19:51,149 INFO org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@34b27915{HTTP/1.1,[http/1.1]}{0.0.0.0:8042} 2018-08-05 12:19:51,149 INFO org.eclipse.jetty.server.Server: Started @6213ms 2018-08-05 12:19:51,149 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app node started at 8042 2018-08-05 12:19:51,155 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Node ID assigned is : hadoop11:45230 2018-08-05 12:19:51,160 INFO org.apache.hadoop.util.JvmPauseMonitor: Starting JVM pause monitor 2018-08-05 12:19:51,180 INFO org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at hadoop11/10.3.1.11:8031 2018-08-05 12:19:51,279 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: [] 2018-08-05 12:19:51,299 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[] 2018-08-05 12:19:51,840 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id -1691607535 2018-08-05 12:19:51,842 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id 1049179870 2018-08-05 12:19:51,843 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as hadoop11:45230 with total resource of 2018-08-05 12:20:25,697 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1533442785309_0001_000001 (auth:SIMPLE) 2018-08-05 12:20:25,937 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1533442785309_0001_01_000004 by user hires 2018-08-05 12:20:26,070 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1533442785309_0001 2018-08-05 12:20:26,091 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1533442785309_0001 transitioned from NEW to INITING 2018-08-05 12:20:26,091 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_1533442785309_0001_01_000004 to application application_1533442785309_0001 2018-08-05 12:20:26,094 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hires IP=10.3.1.15 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1533442785309_0001 CONTAINERID=container_1533442785309_0001_01_000004 2018-08-05 12:20:26,104 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1533442785309_0001 transitioned from INITING to RUNNING 2018-08-05 12:20:26,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1533442785309_0001_01_000004 transitioned from NEW to LOCALIZING 2018-08-05 12:20:26,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1533442785309_0001 2018-08-05 12:20:26,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1533442785309_0001 2018-08-05 12:20:26,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle 2018-08-05 12:20:26,134 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1533442785309_0001 2018-08-05 12:20:26,230 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1533442785309_0001_01_000004 2018-08-05 12:20:26,348 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1533442785309_0001_01_000004 transitioned from LOCALIZING to KILLING 2018-08-05 12:20:26,364 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1533442785309_0001_000002 (auth:SIMPLE) 2018-08-05 12:20:26,374 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1533442785309_0001_02_000001 by user hires 2018-08-05 12:20:26,378 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hires IP=10.3.1.11 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1533442785309_0001 CONTAINERID=container_1533442785309_0001_02_000001 2018-08-05 12:20:26,497 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/nmPrivate/container_1533442785309_0001_01_000004.tokens 2018-08-05 12:20:26,536 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user hires 2018-08-05 12:20:26,537 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1533442785309_0001_000001 (auth:SIMPLE) 2018-08-05 12:20:26,552 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1533442785309_0001_01_000004 2018-08-05 12:20:26,552 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hires IP=10.3.1.15 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1533442785309_0001 CONTAINERID=container_1533442785309_0001_01_000004 2018-08-05 12:20:26,604 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/nmPrivate/container_1533442785309_0001_01_000004.tokens to /home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/usercache/hires/appcache/application_1533442785309_0001/container_1533442785309_0001_01_000004.tokens 2018-08-05 12:20:26,605 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Localizer CWD set to /home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/usercache/hires/appcache/application_1533442785309_0001 = file:/home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/usercache/hires/appcache/application_1533442785309_0001 2018-08-05 12:20:26,632 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer: Disk Validator: yarn.nodemanager.disk-validator is loaded. 2018-08-05 12:20:31,426 WARN org.apache.hadoop.ipc.Server: IPC Server handler 4 on 8040, call Call#36 Retry#0 org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB.heartbeat from 10.3.1.11:51734 java.lang.NullPointerException at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalResourcesTrackerImpl.getPathForLocalization(LocalResourcesTrackerImpl.java:503) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.getPathForLocalization(ResourceLocalizationService.java:1187) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.processHeartbeat(ResourceLocalizationService.java:1151) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker.processHeartbeat(ResourceLocalizationService.java:752) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.heartbeat(ResourceLocalizationService.java:370) at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.service.LocalizationProtocolPBServiceImpl.heartbeat(LocalizationProtocolPBServiceImpl.java:48) at org.apache.hadoop.yarn.proto.LocalizationProtocol$LocalizationProtocolService$2.callBlockingMethod(LocalizationProtocol.java:63) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:869) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:815) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2675) 2018-08-05 12:20:31,434 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Localizer failed for container_1533442785309_0001_01_000004 java.io.IOException: java.lang.NullPointerException: java.lang.NullPointerException at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalResourcesTrackerImpl.getPathForLocalization(LocalResourcesTrackerImpl.java:503) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.getPathForLocalization(ResourceLocalizationService.java:1187) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.processHeartbeat(ResourceLocalizationService.java:1151) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker.processHeartbeat(ResourceLocalizationService.java:752) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.heartbeat(ResourceLocalizationService.java:370) at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.service.LocalizationProtocolPBServiceImpl.heartbeat(LocalizationProtocolPBServiceImpl.java:48) at org.apache.hadoop.yarn.proto.LocalizationProtocol$LocalizationProtocolService$2.callBlockingMethod(LocalizationProtocol.java:63) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:869) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:815) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2675) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:199) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:180) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:1209) Caused by: java.lang.NullPointerException: java.lang.NullPointerException at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalResourcesTrackerImpl.getPathForLocalization(LocalResourcesTrackerImpl.java:503) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.getPathForLocalization(ResourceLocalizationService.java:1187) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.processHeartbeat(ResourceLocalizationService.java:1151) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker.processHeartbeat(ResourceLocalizationService.java:752) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.heartbeat(ResourceLocalizationService.java:370) at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.service.LocalizationProtocolPBServiceImpl.heartbeat(LocalizationProtocolPBServiceImpl.java:48) at org.apache.hadoop.yarn.proto.LocalizationProtocol$LocalizationProtocolService$2.callBlockingMethod(LocalizationProtocol.java:63) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:869) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:815) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2675) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:422) at org.apache.hadoop.yarn.ipc.RPCUtil.instantiateException(RPCUtil.java:53) at org.apache.hadoop.yarn.ipc.RPCUtil.instantiateRuntimeException(RPCUtil.java:85) at org.apache.hadoop.yarn.ipc.RPCUtil.unwrapAndThrowException(RPCUtil.java:122) at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.client.LocalizationProtocolPBClientImpl.heartbeat(LocalizationProtocolPBClientImpl.java:65) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.localizeFiles(ContainerLocalizer.java:304) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:197) ... 2 more Caused by: org.apache.hadoop.ipc.RemoteException(java.lang.NullPointerException): java.lang.NullPointerException at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalResourcesTrackerImpl.getPathForLocalization(LocalResourcesTrackerImpl.java:503) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.getPathForLocalization(ResourceLocalizationService.java:1187) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.processHeartbeat(ResourceLocalizationService.java:1151) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker.processHeartbeat(ResourceLocalizationService.java:752) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.heartbeat(ResourceLocalizationService.java:370) at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.service.LocalizationProtocolPBServiceImpl.heartbeat(LocalizationProtocolPBServiceImpl.java:48) at org.apache.hadoop.yarn.proto.LocalizationProtocol$LocalizationProtocolService$2.callBlockingMethod(LocalizationProtocol.java:63) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:869) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:815) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2675) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1491) at org.apache.hadoop.ipc.Client.call(Client.java:1437) at org.apache.hadoop.ipc.Client.call(Client.java:1347) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:228) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116) at com.sun.proxy.$Proxy81.heartbeat(Unknown Source) at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.client.LocalizationProtocolPBClientImpl.heartbeat(LocalizationProtocolPBClientImpl.java:63) ... 4 more 2018-08-05 12:20:36,393 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_1533442785309_0001_02_000001 to application application_1533442785309_0001 2018-08-05 12:20:36,393 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hires OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1533442785309_0001 CONTAINERID=container_1533442785309_0001_01_000004 2018-08-05 12:20:36,401 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1533442785309_0001_01_000004 transitioned from KILLING to DONE 2018-08-05 12:20:36,404 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1533442785309_0001_02_000001 transitioned from NEW to LOCALIZING 2018-08-05 12:20:36,404 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_1533442785309_0001_01_000004 from application application_1533442785309_0001 2018-08-05 12:20:36,407 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1533442785309_0001_01_000004 2018-08-05 12:20:36,407 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1533442785309_0001 2018-08-05 12:20:36,409 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1533442785309_0001 2018-08-05 12:20:36,410 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1533442785309_0001_02_000001 2018-08-05 12:20:36,436 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/nmPrivate/container_1533442785309_0001_02_000001.tokens 2018-08-05 12:20:36,438 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user hires 2018-08-05 12:20:36,456 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/nmPrivate/container_1533442785309_0001_02_000001.tokens to /home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/usercache/hires/appcache/application_1533442785309_0001/container_1533442785309_0001_02_000001.tokens 2018-08-05 12:20:36,456 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Localizer CWD set to /home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/usercache/hires/appcache/application_1533442785309_0001 = file:/home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/usercache/hires/appcache/application_1533442785309_0001 2018-08-05 12:20:36,480 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer: Disk Validator: yarn.nodemanager.disk-validator is loaded. 2018-08-05 12:20:37,412 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1533442785309_0001_01_000004] 2018-08-05 12:20:38,290 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1533442785309_0001_02_000001 transitioned from LOCALIZING to SCHEDULED 2018-08-05 12:20:38,290 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler: Starting container [container_1533442785309_0001_02_000001] 2018-08-05 12:20:38,384 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1533442785309_0001_02_000001 transitioned from SCHEDULED to RUNNING 2018-08-05 12:20:38,384 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1533442785309_0001_02_000001 2018-08-05 12:20:38,445 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/usercache/hires/appcache/application_1533442785309_0001/container_1533442785309_0001_02_000001/default_container_executor.sh] 2018-08-05 12:20:40,322 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: container_1533442785309_0001_02_000001's ip = 10.3.1.11, and hostname = hadoop11 2018-08-05 12:20:43,430 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Skipping monitoring container container_1533442785309_0001_02_000001 since CPU usage is not yet available. 2018-08-05 12:20:50,984 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1533442785309_0001_000002 (auth:SIMPLE) 2018-08-05 12:20:50,993 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1533442785309_0001_02_000002 by user hires 2018-08-05 12:20:51,015 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hires IP=10.3.1.11 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1533442785309_0001 CONTAINERID=container_1533442785309_0001_02_000002 2018-08-05 12:20:51,016 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_1533442785309_0001_02_000002 to application application_1533442785309_0001 2018-08-05 12:20:51,017 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1533442785309_0001_02_000002 transitioned from NEW to LOCALIZING 2018-08-05 12:20:51,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1533442785309_0001 2018-08-05 12:20:51,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1533442785309_0001 2018-08-05 12:20:51,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got APPLICATION_INIT for service mapreduce_shuffle 2018-08-05 12:20:51,018 INFO org.apache.hadoop.mapred.ShuffleHandler: Added token for job_1533442785309_0001 2018-08-05 12:20:51,019 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1533442785309_0001_02_000002 transitioned from LOCALIZING to SCHEDULED 2018-08-05 12:20:51,019 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler: Starting container [container_1533442785309_0001_02_000002] 2018-08-05 12:20:51,074 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1533442785309_0001_02_000002 transitioned from SCHEDULED to RUNNING 2018-08-05 12:20:51,074 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_1533442785309_0001_02_000002 2018-08-05 12:20:51,145 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/usercache/hires/appcache/application_1533442785309_0001/container_1533442785309_0001_02_000002/default_container_executor.sh] 2018-08-05 12:20:52,713 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: container_1533442785309_0001_02_000002's ip = 10.3.1.11, and hostname = hadoop11 2018-08-05 12:20:55,900 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Skipping monitoring container container_1533442785309_0001_02_000002 since CPU usage is not yet available. 2018-08-05 12:20:57,762 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1533442785309_0001_02_000002 succeeded 2018-08-05 12:20:57,782 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1533442785309_0001_02_000002 transitioned from RUNNING to EXITED_WITH_SUCCESS 2018-08-05 12:20:57,782 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1533442785309_0001_02_000002 2018-08-05 12:21:09,931 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hires OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1533442785309_0001 CONTAINERID=container_1533442785309_0001_02_000002 2018-08-05 12:21:09,933 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1533442785309_0001_02_000002 transitioned from EXITED_WITH_SUCCESS to DONE 2018-08-05 12:21:09,933 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_1533442785309_0001_02_000002 from application application_1533442785309_0001 2018-08-05 12:21:09,934 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1533442785309_0001_02_000002 2018-08-05 12:21:09,934 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1533442785309_0001 2018-08-05 12:21:09,936 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /home/hires/cloudraid/hadoop/hadoop-3.1.0/tmp/nm-local-dir/usercache/hires/appcache/application_1533442785309_0001/container_1533442785309_0001_02_000002 2018-08-05 12:21:11,944 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1533442785309_0001_02_000002]