17/03/29 09:21:36 INFO yarn.ApplicationMaster: Registered signal handlers for [TERM, HUP, INT] 17/03/29 09:21:37 INFO yarn.ApplicationMaster: ApplicationAttemptId: appattempt_1490661058002_0011_000001 17/03/29 09:21:38 INFO spark.SecurityManager: Changing view acls to: hive 17/03/29 09:21:38 INFO spark.SecurityManager: Changing modify acls to: hive 17/03/29 09:21:38 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hive); users with modify permissions: Set(hive) 17/03/29 09:21:38 INFO yarn.ApplicationMaster: Starting the user application in a separate Thread 17/03/29 09:21:38 INFO yarn.ApplicationMaster: Waiting for spark context initialization 17/03/29 09:21:38 INFO yarn.ApplicationMaster: Waiting for spark context initialization ... 17/03/29 09:21:38 INFO client.RemoteDriver: Connecting to: :54907 17/03/29 09:21:39 WARN rpc.Rpc: Invalid log level null, reverting to default. 17/03/29 09:21:39 INFO spark.SparkContext: Running Spark version 1.6.0 17/03/29 09:21:39 INFO spark.SecurityManager: Changing view acls to: hive 17/03/29 09:21:39 INFO spark.SecurityManager: Changing modify acls to: hive 17/03/29 09:21:39 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hive); users with modify permissions: Set(hive) 17/03/29 09:21:39 INFO util.Utils: Successfully started service 'sparkDriver' on port 34368. 17/03/29 09:21:39 INFO slf4j.Slf4jLogger: Slf4jLogger started 17/03/29 09:21:39 INFO Remoting: Starting remoting 17/03/29 09:21:40 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriverActorSystem@172.31.115.94:46931] 17/03/29 09:21:40 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkDriverActorSystem@172.31.115.94:46931] 17/03/29 09:21:40 INFO util.Utils: Successfully started service 'sparkDriverActorSystem' on port 46931. 17/03/29 09:21:40 INFO spark.SparkEnv: Registering MapOutputTracker 17/03/29 09:21:40 INFO spark.SparkEnv: Registering BlockManagerMaster 17/03/29 09:21:40 INFO storage.DiskBlockManager: Created local directory at /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/blockmgr-430082bd-68d7-43ff-95b0-fb14b5db43e8 17/03/29 09:21:40 INFO storage.MemoryStore: MemoryStore started with capacity 442.5 MB 17/03/29 09:21:40 INFO spark.SparkEnv: Registering OutputCommitCoordinator 17/03/29 09:21:40 INFO ui.JettyUtils: Adding filter: org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter 17/03/29 09:21:40 INFO util.Utils: Successfully started service 'SparkUI' on port 53928. 17/03/29 09:21:40 INFO ui.SparkUI: Started SparkUI at http://172.31.115.94:53928 17/03/29 09:21:40 INFO cluster.YarnClusterScheduler: Created YarnClusterScheduler 17/03/29 09:21:40 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 50262. 17/03/29 09:21:40 INFO netty.NettyBlockTransferService: Server created on 50262 17/03/29 09:21:40 INFO storage.BlockManager: external shuffle service port = 7337 17/03/29 09:21:40 INFO storage.BlockManagerMaster: Trying to register BlockManager 17/03/29 09:21:40 INFO storage.BlockManagerMasterEndpoint: Registering block manager 172.31.115.94:50262 with 442.5 MB RAM, BlockManagerId(driver, 172.31.115.94, 50262) 17/03/29 09:21:40 INFO storage.BlockManagerMaster: Registered BlockManager 17/03/29 09:21:40 INFO scheduler.EventLoggingListener: Logging events to hdfs://:8020/user/spark/applicationHistory/application_1490661058002_0011_1 17/03/29 09:21:41 INFO cluster.YarnSchedulerBackend$YarnSchedulerEndpoint: ApplicationMaster registered as NettyRpcEndpointRef(spark://YarnAM@172.31.115.94:34368) 17/03/29 09:21:41 INFO client.RMProxy: Connecting to ResourceManager at /172.31.115.53:8030 17/03/29 09:21:41 INFO yarn.YarnRMClient: Registering the ApplicationMaster 17/03/29 09:21:41 INFO yarn.YarnAllocator: Will request 1 executor containers, each with 4 cores and 511 MB memory including 76 MB overhead 17/03/29 09:21:41 INFO yarn.YarnAllocator: Container request (host: Any, capability: ) 17/03/29 09:21:41 INFO yarn.ApplicationMaster: Started progress reporter thread with (heartbeat : 3000, initial allocation : 200) intervals 17/03/29 09:21:41 INFO impl.AMRMClientImpl: Received new token for : :8041 17/03/29 09:21:41 INFO yarn.YarnAllocator: Launching container container_1490661058002_0011_01_000002 for on host 17/03/29 09:21:41 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: spark://CoarseGrainedScheduler@172.31.115.94:34368, executorHostname: 17/03/29 09:21:41 INFO yarn.ExecutorRunnable: Starting Executor Container 17/03/29 09:21:41 INFO yarn.YarnAllocator: Received 1 containers from YARN, launching executors on 1 of them. 17/03/29 09:21:41 INFO impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 17/03/29 09:21:41 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext 17/03/29 09:21:41 INFO yarn.ExecutorRunnable: Preparing Local resources 17/03/29 09:21:41 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource { scheme: "hdfs" host: "" port: 8020 file: "/user/hive/.sparkStaging/application_1490661058002_0011/hive-exec-1.1.0-cdh5.7.1.jar" } size: 19272670 timestamp: 1490804486375 type: FILE visibility: PRIVATE, __spark_conf__ -> resource { scheme: "hdfs" host: "" port: 8020 file: "/user/hive/.sparkStaging/application_1490661058002_0011/__spark_conf__4586154098163003748.zip" } size: 53357 timestamp: 1490804486515 type: ARCHIVE visibility: PRIVATE) 17/03/29 09:21:41 INFO yarn.ExecutorRunnable: =============================================================================== YARN executor launch context: env: CLASSPATH -> {{PWD}}{{PWD}}/__spark_conf__{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/lib/spark/lib/spark-assembly.jar$HADOOP_CLIENT_CONF_DIR$HADOOP_CONF_DIR$HADOOP_COMMON_HOME/*$HADOOP_COMMON_HOME/lib/*$HADOOP_HDFS_HOME/*$HADOOP_HDFS_HOME/lib/*$HADOOP_YARN_HOME/*$HADOOP_YARN_HOME/lib/*$HADOOP_MAPRED_HOME/*$HADOOP_MAPRED_HOME/lib/*$MR2_CLASSPATH{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/ST4-4.0.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/accumulo-core-1.6.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/accumulo-fate-1.6.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/accumulo-start-1.6.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/accumulo-trace-1.6.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/activation-1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/ant-1.9.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/ant-launcher-1.9.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/antlr-2.7.7.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/antlr-runtime-3.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/aopalliance-1.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/apache-log4j-extras-1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/apache-log4j-extras-1.2.17.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/apacheds-i18n-2.0.0-M15.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/apacheds-kerberos-codec-2.0.0-M15.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/api-asn1-api-1.0.0-M20.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/api-util-1.0.0-M20.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/asm-3.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/asm-commons-3.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/asm-tree-3.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/async-1.4.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/asynchbase-1.5.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-1.7.6-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-compiler-1.7.6-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-ipc-1.7.6-cdh5.7.1-tests.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-ipc-1.7.6-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-mapred-1.7.6-cdh5.7.1-hadoop2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-maven-plugin-1.7.6-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-protobuf-1.7.6-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-service-archetype-1.7.6-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-thrift-1.7.6-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/aws-java-sdk-core-1.10.6.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/aws-java-sdk-kms-1.10.6.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/aws-java-sdk-s3-1.10.6.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/bonecp-0.8.0.RELEASE.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/calcite-avatica-1.0.0-incubating.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/calcite-core-1.0.0-incubating.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/calcite-linq4j-1.0.0-incubating.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-beanutils-1.7.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-beanutils-core-1.8.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-cli-1.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-codec-1.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-codec-1.8.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-collections-3.2.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-compiler-2.7.6.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-compress-1.4.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-configuration-1.6.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-daemon-1.0.13.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-dbcp-1.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-digester-1.8.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-el-1.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-httpclient-3.0.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-httpclient-3.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-io-2.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-jexl-2.1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-lang-2.6.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-logging-1.1.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-math-2.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-math3-3.1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-net-3.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-pool-1.5.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-vfs2-2.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-client-2.6.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-client-2.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-framework-2.6.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-framework-2.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-recipes-2.6.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-recipes-2.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/datanucleus-api-jdo-3.2.6.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/datanucleus-core-3.2.10.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/datanucleus-rdbms-3.2.9.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/derby-10.11.1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/eigenbase-properties-1.1.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/fastutil-6.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/findbugs-annotations-1.3.9-1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-avro-source-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-dataset-sink-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-file-channel-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-hdfs-sink-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-hive-sink-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-irc-sink-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-jdbc-channel-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-jms-source-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-kafka-channel-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-kafka-source-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-auth-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-configuration-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-core-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-elasticsearch-sink-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-embedded-agent-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-hbase-sink-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-kafka-sink-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-log4jappender-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-morphline-solr-sink-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-node-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-sdk-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-scribe-source-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-spillable-memory-channel-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-taildir-source-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-thrift-source-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-tools-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-twitter-source-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/geronimo-annotation_1.0_spec-1.1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/geronimo-jaspic_1.0_spec-1.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/geronimo-jta_1.1_spec-1.1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/groovy-all-2.4.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/gson-2.2.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/guava-11.0.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/guava-11.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/guava-14.0.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/guice-3.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/guice-servlet-3.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-annotations-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-ant-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-archive-logs-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-archives-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-auth-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-aws-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-azure-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-common-2.6.0-cdh5.7.1-tests.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-common-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-datajoin-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-distcp-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-extras-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-gridmix-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-hdfs-2.6.0-cdh5.7.1-tests.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-hdfs-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-hdfs-nfs-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-app-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-common-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-core-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-hs-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.7.1-tests.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-nativetask-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-shuffle-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-examples-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-nfs-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-openstack-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-rumen-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-sls-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-streaming-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-api-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-client-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-common-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-registry-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-common-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-nodemanager-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-tests-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-web-proxy-2.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hamcrest-core-1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hamcrest-core-1.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-annotations-1.2.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-client-1.2.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-common-1.2.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-hadoop-compat-1.2.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-hadoop2-compat-1.2.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-protocol-1.2.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-server-1.2.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/high-scale-lib-1.1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-accumulo-handler-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-ant-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-beeline-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-cli-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-common-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-contrib-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-exec-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-hbase-handler-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-hwi-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-jdbc-1.1.0-cdh5.7.1-standalone.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-jdbc-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-metastore-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-serde-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-service-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-shims-0.23-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-shims-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-shims-common-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-shims-scheduler-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-testutils-1.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/htrace-core-3.2.0-incubating.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/htrace-core4-4.0.1-incubating.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/httpclient-4.2.5.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/httpcore-4.2.5.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hue-plugins-3.9.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/irclib-1.10.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-annotations-2.2.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-core-2.2.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-core-asl-1.8.8.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-databind-2.2.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-jaxrs-1.8.8.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-mapper-asl-1.8.8.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-xc-1.8.8.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jamon-runtime-2.3.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/janino-2.7.6.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jasper-compiler-5.5.23.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jasper-runtime-5.5.23.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/java-xmlbuilder-0.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/javax.inject-1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jaxb-api-2.2.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jaxb-impl-2.2.3-1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jcommander-1.32.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jdo-api-3.0.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jersey-client-1.9.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jersey-core-1.9.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jersey-guice-1.9.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jersey-json-1.9.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jersey-server-1.9.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jets3t-0.9.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jettison-1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jetty-6.1.26.cloudera.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jetty-all-7.6.0.v20120127.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jetty-all-server-7.6.0.v20120127.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jetty-util-6.1.26.cloudera.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jetty-util-6.1.26.cloudera.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jline-2.11.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jline-2.12.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/joda-time-1.6.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/joda-time-2.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jopt-simple-4.9.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jpam-1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jsch-0.1.42.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jsp-api-2.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jsr305-1.3.9.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jsr305-3.0.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jta-1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/junit-4.11.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kafka-clients-0.9.0-kafka-2.0.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kafka_2.10-0.9.0-kafka-2.0.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kite-data-core-1.0.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kite-data-hbase-1.0.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kite-data-hive-1.0.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kite-hadoop-compatibility-1.0.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/leveldbjni-all-1.8.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/libfb303-0.9.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/libthrift-0.9.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/log4j-1.2.16.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/log4j-1.2.17.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/logredactor-1.0.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/lz4-1.3.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/mail-1.4.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/mapdb-0.9.9.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/maven-scm-api-1.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/maven-scm-provider-svn-commons-1.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/maven-scm-provider-svnexe-1.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/metrics-core-2.2.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/metrics-core-3.0.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/metrics-json-3.0.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/metrics-jvm-3.0.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/microsoft-windowsazure-storage-sdk-0.6.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/mina-core-2.0.4.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/mockito-all-1.8.5.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/netty-3.6.2.Final.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/netty-all-4.0.23.Final.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/opencsv-2.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/oro-2.0.8.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/paranamer-2.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-avro-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-cascading-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-column-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-common-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-encoding-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-format-2.1.0-cdh5.7.1-javadoc.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-format-2.1.0-cdh5.7.1-sources.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-format-2.1.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-generator-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-hadoop-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-hadoop-bundle-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-jackson-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-pig-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-pig-bundle-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-protobuf-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-scala_2.10-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-scrooge_2.10-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-test-hadoop2-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-thrift-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-tools-1.5.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/plexus-utils-1.5.6.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/protobuf-java-2.5.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/regexp-1.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/scala-library-2.10.5.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/serializer-2.7.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/servlet-api-2.5-20110124.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/servlet-api-2.5.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/slf4j-api-1.7.5.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/slf4j-log4j12-1.7.5.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/snappy-java-1.0.4.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/spark-1.6.0-cdh5.7.1-yarn-shuffle.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/spark-streaming-flume-sink_2.10-1.6.0-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/stax-api-1.0-2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/stax-api-1.0.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/stringtemplate-3.2.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/super-csv-2.2.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/tempus-fugit-1.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/trevni-avro-1.7.6-cdh5.7.1-hadoop2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/trevni-avro-1.7.6-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/trevni-core-1.7.6-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/twitter4j-core-3.0.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/twitter4j-media-support-3.0.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/twitter4j-stream-3.0.3.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/unused-1.0.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/velocity-1.5.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/velocity-1.7.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/xalan-2.7.2.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/xercesImpl-2.9.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/xml-apis-1.3.04.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/xmlenc-0.52.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/xz-1.0.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/zkclient-0.7.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/jars/zookeeper-3.4.5-cdh5.7.1.jar:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hadoop/LICENSE.txt:{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hadoop/NOTICE.txt SPARK_YARN_CACHE_ARCHIVES -> hdfs://:8020/user/hive/.sparkStaging/application_1490661058002_0011/__spark_conf__4586154098163003748.zip#__spark_conf__ SPARK_LOG_URL_STDERR -> http://:8042/node/containerlogs/container_1490661058002_0011_01_000002/hive/stderr?start=-4096 SPARK_YARN_CACHE_FILES_FILE_SIZES -> 19272670 SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1490661058002_0011 SPARK_DIST_CLASSPATH -> /opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/ST4-4.0.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/accumulo-core-1.6.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/accumulo-fate-1.6.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/accumulo-start-1.6.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/accumulo-trace-1.6.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/ant-1.9.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/ant-launcher-1.9.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/antlr-2.7.7.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/antlr-runtime-3.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/aopalliance-1.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/apache-log4j-extras-1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/apache-log4j-extras-1.2.17.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/apacheds-i18n-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/api-asn1-api-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/api-util-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/asm-commons-3.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/asm-tree-3.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/async-1.4.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/asynchbase-1.5.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-1.7.6-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-compiler-1.7.6-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-ipc-1.7.6-cdh5.7.1-tests.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-ipc-1.7.6-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-mapred-1.7.6-cdh5.7.1-hadoop2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-maven-plugin-1.7.6-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-protobuf-1.7.6-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-service-archetype-1.7.6-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/avro-thrift-1.7.6-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/aws-java-sdk-core-1.10.6.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/aws-java-sdk-kms-1.10.6.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/aws-java-sdk-s3-1.10.6.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/bonecp-0.8.0.RELEASE.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/calcite-avatica-1.0.0-incubating.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/calcite-core-1.0.0-incubating.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/calcite-linq4j-1.0.0-incubating.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-beanutils-1.7.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-codec-1.8.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-collections-3.2.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-compiler-2.7.6.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-configuration-1.6.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-daemon-1.0.13.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-dbcp-1.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-digester-1.8.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-httpclient-3.0.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-jexl-2.1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-math-2.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-math3-3.1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-net-3.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-pool-1.5.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/commons-vfs2-2.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-client-2.6.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-client-2.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-framework-2.6.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-framework-2.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-recipes-2.6.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/curator-recipes-2.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/datanucleus-api-jdo-3.2.6.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/datanucleus-core-3.2.10.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/datanucleus-rdbms-3.2.9.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/derby-10.11.1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/eigenbase-properties-1.1.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/fastutil-6.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/findbugs-annotations-1.3.9-1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-avro-source-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-dataset-sink-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-file-channel-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-hdfs-sink-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-hive-sink-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-irc-sink-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-jdbc-channel-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-jms-source-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-kafka-channel-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-kafka-source-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-auth-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-configuration-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-core-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-elasticsearch-sink-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-embedded-agent-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-hbase-sink-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-kafka-sink-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-log4jappender-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-morphline-solr-sink-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-node-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-ng-sdk-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-scribe-source-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-spillable-memory-channel-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-taildir-source-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-thrift-source-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-tools-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/flume-twitter-source-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/geronimo-annotation_1.0_spec-1.1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/geronimo-jaspic_1.0_spec-1.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/geronimo-jta_1.1_spec-1.1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/groovy-all-2.4.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/gson-2.2.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/guava-11.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/guava-14.0.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/guice-3.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/guice-servlet-3.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-annotations-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-ant-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-archive-logs-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-archives-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-auth-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-aws-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-azure-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-common-2.6.0-cdh5.7.1-tests.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-common-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-datajoin-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-distcp-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-extras-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-gridmix-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-hdfs-2.6.0-cdh5.7.1-tests.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-hdfs-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-hdfs-nfs-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-app-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-common-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-core-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-hs-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.7.1-tests.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-nativetask-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-client-shuffle-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-mapreduce-examples-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-nfs-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-openstack-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-rumen-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-sls-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-streaming-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-api-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-client-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-common-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-registry-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-common-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-nodemanager-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-tests-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hadoop-yarn-server-web-proxy-2.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hamcrest-core-1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hamcrest-core-1.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-annotations-1.2.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-client-1.2.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-common-1.2.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-hadoop-compat-1.2.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-hadoop2-compat-1.2.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-protocol-1.2.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hbase-server-1.2.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/high-scale-lib-1.1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-accumulo-handler-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-ant-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-beeline-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-cli-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-common-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-contrib-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-exec-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-hbase-handler-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-hwi-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-jdbc-1.1.0-cdh5.7.1-standalone.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-jdbc-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-metastore-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-serde-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-service-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-shims-0.23-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-shims-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-shims-common-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-shims-scheduler-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hive-testutils-1.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/htrace-core-3.2.0-incubating.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/htrace-core4-4.0.1-incubating.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/httpclient-4.2.5.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/httpcore-4.2.5.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/hue-plugins-3.9.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/irclib-1.10.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-annotations-2.2.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-core-2.2.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-databind-2.2.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jamon-runtime-2.3.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/janino-2.7.6.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jasper-compiler-5.5.23.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/java-xmlbuilder-0.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/javax.inject-1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jcommander-1.32.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jdo-api-3.0.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jersey-client-1.9.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jersey-guice-1.9.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jersey-json-1.9.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jets3t-0.9.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jettison-1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jetty-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jetty-all-7.6.0.v20120127.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jetty-all-server-7.6.0.v20120127.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jetty-util-6.1.26.cloudera.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jetty-util-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jline-2.11.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jline-2.12.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/joda-time-1.6.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/joda-time-2.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jopt-simple-4.9.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jpam-1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jsch-0.1.42.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jsr305-1.3.9.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/jta-1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/junit-4.11.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kafka-clients-0.9.0-kafka-2.0.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kafka_2.10-0.9.0-kafka-2.0.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kite-data-core-1.0.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kite-data-hbase-1.0.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kite-data-hive-1.0.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/kite-hadoop-compatibility-1.0.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/leveldbjni-all-1.8.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/libfb303-0.9.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/libthrift-0.9.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/logredactor-1.0.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/lz4-1.3.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/mail-1.4.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/mapdb-0.9.9.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/maven-scm-api-1.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/maven-scm-provider-svn-commons-1.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/maven-scm-provider-svnexe-1.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/metrics-core-2.2.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/metrics-core-3.0.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/metrics-json-3.0.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/metrics-jvm-3.0.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/microsoft-windowsazure-storage-sdk-0.6.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/mina-core-2.0.4.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/mockito-all-1.8.5.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/netty-all-4.0.23.Final.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/opencsv-2.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/oro-2.0.8.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/paranamer-2.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-avro-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-cascading-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-column-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-common-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-encoding-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-format-2.1.0-cdh5.7.1-javadoc.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-format-2.1.0-cdh5.7.1-sources.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-format-2.1.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-generator-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-hadoop-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-hadoop-bundle-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-jackson-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-pig-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-pig-bundle-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-protobuf-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-scala_2.10-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-scrooge_2.10-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-test-hadoop2-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-thrift-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/parquet-tools-1.5.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/plexus-utils-1.5.6.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/regexp-1.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/scala-library-2.10.5.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/serializer-2.7.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/servlet-api-2.5-20110124.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/spark-1.6.0-cdh5.7.1-yarn-shuffle.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/spark-streaming-flume-sink_2.10-1.6.0-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/stax-api-1.0.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/stringtemplate-3.2.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/super-csv-2.2.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/tempus-fugit-1.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/trevni-avro-1.7.6-cdh5.7.1-hadoop2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/trevni-avro-1.7.6-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/trevni-core-1.7.6-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/twitter4j-core-3.0.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/twitter4j-media-support-3.0.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/twitter4j-stream-3.0.3.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/unused-1.0.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/velocity-1.5.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/velocity-1.7.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/xalan-2.7.2.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/xercesImpl-2.9.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/xml-apis-1.3.04.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/zkclient-0.7.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/jars/zookeeper-3.4.5-cdh5.7.1.jar:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hadoop/LICENSE.txt:/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hadoop/NOTICE.txt SPARK_YARN_CACHE_FILES_VISIBILITIES -> PRIVATE SPARK_YARN_CACHE_ARCHIVES_FILE_SIZES -> 53357 SPARK_USER -> hive SPARK_YARN_MODE -> true SPARK_YARN_CACHE_ARCHIVES_TIME_STAMPS -> 1490804486515 SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1490804486375 SPARK_LOG_URL_STDOUT -> http://:8042/node/containerlogs/container_1490661058002_0011_01_000002/hive/stdout?start=-4096 SPARK_YARN_CACHE_FILES -> hdfs://:8020/user/hive/.sparkStaging/application_1490661058002_0011/hive-exec-1.1.0-cdh5.7.1.jar#__app__.jar SPARK_YARN_CACHE_ARCHIVES_VISIBILITIES -> PRIVATE command: LD_LIBRARY_PATH="{{HADOOP_COMMON_HOME}}/../../../CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hadoop/lib/native:$LD_LIBRARY_PATH" {{JAVA_HOME}}/bin/java -server -XX:OnOutOfMemoryError='kill %p' -Xms435m -Xmx435m '-Dhive.spark.log.dir=/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/spark/logs/' -Djava.io.tmpdir={{PWD}}/tmp '-Dspark.driver.port=34368' '-Dspark.hadoop.hbase.regionserver.port=60020' '-Dspark.authenticate=false' '-Dspark.shuffle.service.port=7337' '-Dspark.ui.port=0' '-Dspark.hadoop.hbase.master.port=60000' '-Dspark.hadoop.hbase.master.info.port=60010' '-Dspark.hadoop.hbase.rest.port=8080' '-Dspark.hadoop.hbase.status.multicast.address.port=16100' '-Dspark.hadoop.hbase.regionserver.info.port=60030' -Dspark.yarn.app.container.log.dir= -XX:MaxPermSize=256m org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://CoarseGrainedScheduler@172.31.115.94:34368 --executor-id 1 --hostname --cores 4 --app-id application_1490661058002_0011 --user-class-path file:$PWD/__app__.jar 1> /stdout 2> /stderr =============================================================================== 17/03/29 09:21:41 INFO impl.ContainerManagementProtocolProxy: Opening proxy : :8041 17/03/29 09:21:48 INFO cluster.YarnClusterSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (:53256) with ID 1 17/03/29 09:21:48 INFO spark.ExecutorAllocationManager: New executor 1 has registered (new total is 1) 17/03/29 09:21:48 INFO storage.BlockManagerMasterEndpoint: Registering block manager :32989 with 225.2 MB RAM, BlockManagerId(1, , 32989) 17/03/29 09:21:48 INFO cluster.YarnClusterSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.8 17/03/29 09:21:48 INFO cluster.YarnClusterScheduler: YarnClusterScheduler.postStartHook done 17/03/29 09:21:48 INFO spark.SparkContext: Added JAR hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hive-exec-1.1.0-cdh5.7.1.jar at hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hive-exec-1.1.0-cdh5.7.1.jar with timestamp 1490804508370 17/03/29 09:21:48 INFO spark.SparkContext: Added JAR hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hive-hbase-handler-1.1.0-cdh5.7.1.jar at hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hive-hbase-handler-1.1.0-cdh5.7.1.jar with timestamp 1490804508390 17/03/29 09:21:48 INFO spark.SparkContext: Added JAR hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-hadoop-compat.jar at hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-hadoop-compat.jar with timestamp 1490804508412 17/03/29 09:21:48 INFO spark.SparkContext: Added JAR hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-common.jar at hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-common.jar with timestamp 1490804508439 17/03/29 09:21:48 INFO spark.SparkContext: Added JAR hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-client.jar at hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-client.jar with timestamp 1490804508475 17/03/29 09:21:48 INFO spark.SparkContext: Added JAR hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/htrace-core4-4.0.1-incubating.jar at hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/htrace-core4-4.0.1-incubating.jar with timestamp 1490804508506 17/03/29 09:21:48 INFO spark.SparkContext: Added JAR hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/htrace-core-3.2.0-incubating.jar at hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/htrace-core-3.2.0-incubating.jar with timestamp 1490804508538 17/03/29 09:21:48 INFO spark.SparkContext: Added JAR hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/htrace-core.jar at hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/htrace-core.jar with timestamp 1490804508570 17/03/29 09:21:48 INFO spark.SparkContext: Added JAR hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-hadoop2-compat.jar at hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-hadoop2-compat.jar with timestamp 1490804508592 17/03/29 09:21:48 INFO spark.SparkContext: Added JAR hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-protocol.jar at hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-protocol.jar with timestamp 1490804508637 17/03/29 09:21:48 INFO spark.SparkContext: Added JAR hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-server.jar at hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-server.jar with timestamp 1490804508681 17/03/29 09:21:48 INFO client.RemoteDriver: Received job request 90d38964-d62e-47d6-a628-0497fdc4b449 17/03/29 09:21:48 INFO client.SparkClientUtilities: Copying hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-hadoop-compat.jar to /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-hadoop-compat.jar 17/03/29 09:21:48 INFO client.SparkClientUtilities: Added jar[file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-hadoop-compat.jar] to classpath. 17/03/29 09:21:48 INFO client.SparkClientUtilities: Copying hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/htrace-core.jar to /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/htrace-core.jar 17/03/29 09:21:48 INFO client.SparkClientUtilities: Added jar[file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/htrace-core.jar] to classpath. 17/03/29 09:21:48 INFO client.SparkClientUtilities: Copying hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/htrace-core-3.2.0-incubating.jar to /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/htrace-core-3.2.0-incubating.jar 17/03/29 09:21:48 INFO client.SparkClientUtilities: Added jar[file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/htrace-core-3.2.0-incubating.jar] to classpath. 17/03/29 09:21:48 INFO client.SparkClientUtilities: Copying hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/htrace-core4-4.0.1-incubating.jar to /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/htrace-core4-4.0.1-incubating.jar 17/03/29 09:21:48 INFO client.SparkClientUtilities: Added jar[file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/htrace-core4-4.0.1-incubating.jar] to classpath. 17/03/29 09:21:48 INFO client.SparkClientUtilities: Copying hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-server.jar to /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-server.jar 17/03/29 09:21:48 INFO client.SparkClientUtilities: Added jar[file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-server.jar] to classpath. 17/03/29 09:21:48 INFO client.SparkClientUtilities: Copying hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-client.jar to /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-client.jar 17/03/29 09:21:48 INFO client.SparkClientUtilities: Added jar[file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-client.jar] to classpath. 17/03/29 09:21:48 INFO client.SparkClientUtilities: Copying hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-hadoop2-compat.jar to /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-hadoop2-compat.jar 17/03/29 09:21:48 INFO client.SparkClientUtilities: Added jar[file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-hadoop2-compat.jar] to classpath. 17/03/29 09:21:48 INFO client.SparkClientUtilities: Copying hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hive-exec-1.1.0-cdh5.7.1.jar to /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hive-exec-1.1.0-cdh5.7.1.jar 17/03/29 09:21:49 INFO client.SparkClientUtilities: Added jar[file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hive-exec-1.1.0-cdh5.7.1.jar] to classpath. 17/03/29 09:21:49 INFO client.SparkClientUtilities: Copying hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-protocol.jar to /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-protocol.jar 17/03/29 09:21:49 INFO client.SparkClientUtilities: Added jar[file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-protocol.jar] to classpath. 17/03/29 09:21:49 INFO client.SparkClientUtilities: Copying hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hbase-common.jar to /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-common.jar 17/03/29 09:21:49 INFO client.SparkClientUtilities: Added jar[file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-common.jar] to classpath. 17/03/29 09:21:49 INFO client.SparkClientUtilities: Copying hdfs://:8020/tmp/hive/hive/_spark_session_dir/7681d040-0824-4523-87a5-e99af1b35351/hive-hbase-handler-1.1.0-cdh5.7.1.jar to /yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hive-hbase-handler-1.1.0-cdh5.7.1.jar 17/03/29 09:21:49 INFO client.SparkClientUtilities: Added jar[file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hive-hbase-handler-1.1.0-cdh5.7.1.jar] to classpath. 17/03/29 09:21:49 INFO spark.RemoteHiveSparkClient: Logging job configuration: 17/03/29 09:21:49 INFO spark.RemoteHiveSparkClient: {"properties":[{"key":"mapreduce.jobhistory.jhist.format","value":"json","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.server2.authentication.kerberos.principal","value":"hive/_HOST@EXAMPLE.COM","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hadoop.proxyuser.hive.groups","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"dfs.block.access.token.lifetime","value":"600","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.skewjoin.key","value":"100000","isFinal":false,"resource":"programatically"},{"key":"mapreduce.job.heap.memory-mb.ratio","value":"0.8","isFinal":false,"resource":"mapred-site.xml"},{"key":"hive.index.compact.binary.search","value":"true","isFinal":false,"resource":"programatically"},{"key":"mapreduce.map.log.level","value":"INFO","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.namenode.lazypersist.file.scrub.interval.sec","value":"300","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.admin.user.env","value":"LD_LIBRARY_PATH=$HADOOP_COMMON_HOME/lib/native:$JAVA_LIBRARY_PATH","isFinal":false,"resource":"mapred-site.xml"},{"key":"file.bytes-per-checksum","value":"512","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.client.completion.pollinterval","value":"5000","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.log-aggregation-enable","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.nodemanager.aux-services.mapreduce_shuffle.class","value":"org.apache.hadoop.mapred.ShuffleHandler","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.client.pause","value":"100","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.namenode.edit.log.autoroll.check.interval.ms","value":"300000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.job.speculative.retry-after-speculate","value":"15000","isFinal":false,"resource":"mapred-default.xml"},{"key":"ipc.client.fallback-to-simple-auth-allowed","value":"false","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.client.failover.connection.retries","value":"0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.jobtracker.system.dir","value":"/tmp/hadoop-hive/mapred/system","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.metastore.event.db.listener.timetolive","value":"86400s","isFinal":false,"resource":"programatically"},{"key":"yarn.scheduler.minimum-allocation-mb","value":"1024","isFinal":false,"resource":"yarn-site.xml"},{"key":"mapreduce.task.profile.map.params","value":"-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.map.memory.mb","value":"0","isFinal":false,"resource":"mapred-site.xml"},{"key":"mapreduce.tasktracker.dns.interface","value":"default","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.datanode.failed.volumes.tolerated","value":"0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.server2.authentication","value":"kerberos","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"_hive.tmp_table_space","value":"/tmp/hive/hive/12f47c70-bb11-4231-b832-205077c49b7f/_tmp_space.db","isFinal":false,"resource":"programatically"},{"key":"stream.stderr.reporter.prefix","value":"reporter:","isFinal":false,"resource":"programatically"},{"key":"dfs.client.slow.io.warning.threshold.ms","value":"30000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.security.groups.cache.secs","value":"300","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.nodemanager.env-whitelist","value":"JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,HADOOP_YARN_HOME","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.top.window.num.buckets","value":"10","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.metastore.authorization.storage.checks","value":"false","isFinal":false,"resource":"programatically"},{"key":"map.sort.class","value":"org.apache.hadoop.util.QuickSort","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.namenode.safemode.threshold-pct","value":"0.999f","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.jobtracker.jobhistory.task.numberprogresssplits","value":"12","isFinal":false,"resource":"mapred-default.xml"},{"key":"datanucleus.storeManagerType","value":"rdbms","isFinal":false,"resource":"programatically"},{"key":"dfs.short.circuit.shared.memory.watcher.interrupt.check.ms","value":"60000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"fs.AbstractFileSystem.s3a.impl","value":"org.apache.hadoop.fs.s3a.S3A","isFinal":false,"resource":"core-default.xml"},{"key":"fs.s3n.block.size","value":"67108864","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.resourcemanager.client.thread-count","value":"50","isFinal":false,"resource":"yarn-site.xml"},{"key":"dfs.client.read.shortcircuit","value":"false","isFinal":false,"resource":"hdfs-site.xml"},{"key":"mapreduce.job.end-notification.max.retry.interval","value":"5000","isFinal":true,"resource":"mapred-default.xml"},{"key":"hadoop.security.authentication","value":"kerberos","isFinal":false,"resource":"core-site.xml"},{"key":"dfs.client.mmap.retry.timeout.ms","value":"300000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.datanode.readahead.bytes","value":"4193404","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.mob.sweep.tool.compaction.memstore.flush.size","value":"134217728","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.jobhistory.max-age-ms","value":"604800000","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.app.mapreduce.client-am.ipc.max-retries","value":"3","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.mapjoin.followby.map.aggr.hash.percentmemory","value":"0.3","isFinal":false,"resource":"programatically"},{"key":"hive.script.recordwriter","value":"org.apache.hadoop.hive.ql.exec.TextRecordWriter","isFinal":false,"resource":"programatically"},{"key":"hive.multigroupby.singlereducer","value":"true","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.sleep-delay-before-sigkill.ms","value":"250","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.vectorized.execution.reduce.groupby.enabled","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.server2.authentication.ldap.guidKey","value":"uid","isFinal":false,"resource":"programatically"},{"key":"hadoop.shell.missing.defaultFs.warning","value":"true","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.rootdir.perms","value":"700","isFinal":false,"resource":"hbase-default.xml"},{"key":"fs.trash.interval","value":"1","isFinal":false,"resource":"core-site.xml"},{"key":"dfs.datanode.max.locked.memory","value":"0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.http.filter.initializers","value":"org.apache.hadoop.http.lib.StaticUserWebFilter","isFinal":false,"resource":"core-default.xml"},{"key":"fs.har.impl","value":"org.apache.hadoop.hive.shims.HiveHarFileSystem","isFinal":false,"resource":"programatically"},{"key":"dfs.datanode.ipc.address","value":"0.0.0.0:50020","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.namenode.delegation.token.renew-interval","value":"86400000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.resourcemanager.webapp.address","value":":8088","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.spark.client.rpc.sasl.mechanisms","value":"DIGEST-MD5","isFinal":false,"resource":"programatically"},{"key":"hive.optimize.index.groupby","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.shuffle.max.connections","value":"80","isFinal":false,"resource":"mapred-site.xml"},{"key":"yarn.nodemanager.local-cache.max-files-per-directory","value":"8192","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.replication.work.multiplier.per.iteration","value":"2","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.cluster.distributed","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.jobtracker.address","value":"local","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.client.scanner.caching","value":"2147483647","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.datanode.slow.io.warning.threshold.ms","value":"300","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.client.max-cached-nodemanagers-proxies","value":"0","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.tasktracker.instrumentation","value":"org.apache.hadoop.mapred.TaskTrackerMetricsInst","isFinal":false,"resource":"mapred-default.xml"},{"key":"hadoop.registry.zk.quorum","value":"localhost:2181","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.app.mapreduce.am.job.committer.commit-window","value":"10000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hadoop.registry.zk.session.timeout.ms","value":"60000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.tez.exec.print.summary","value":"false","isFinal":false,"resource":"programatically"},{"key":"nfs.exports.allowed.hosts","value":"* rw","isFinal":false,"resource":"core-default.xml"},{"key":"hive.metastore.filter.hook","value":"org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl","isFinal":false,"resource":"programatically"},{"key":"hbase.http.max.threads","value":"10","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.metastore.integral.jdo.pushdown","value":"false","isFinal":false,"resource":"programatically"},{"key":"hadoop.util.hash.type","value":"murmur","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.namenode.replication.min","value":"1","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.server2.webui.use.ssl","value":"false","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hbase.regionserver.checksum.verify","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.cli.print.current.db","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.debug.localtask","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.security.authorization.enabled","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.warehouse.subdir.inherit.perms","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"mapreduce.jobtracker.retiredjobs.cache.size","value":"1000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.zookeeper.peerport","value":"2888","isFinal":false,"resource":"hbase-default.xml"},{"key":"s3.client-write-packet-size","value":"65536","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.resourcemanager.scheduler.address","value":":8030","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.metastore.try.direct.sql","value":"true","isFinal":false,"resource":"programatically"},{"key":"fs.s3.block.size","value":"67108864","isFinal":false,"resource":"core-default.xml"},{"key":"hadoop.security.group.mapping.ldap.search.filter.user","value":"(&(objectClass=user)(sAMAccountName={0}))","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.permissions.superusergroup","value":"supergroup","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.resourcemanager.resource-tracker.address","value":":8031","isFinal":false,"resource":"yarn-site.xml"},{"key":"hbase.hregion.memstore.flush.size","value":"134217728","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.execution.engine","value":"spark","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hbase.hstore.time.to.purge.deletes","value":"0","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.script.operator.env.blacklist","value":"hive.txn.valid.txns,hive.script.operator.env.blacklist","isFinal":false,"resource":"programatically"},{"key":"hive.server2.long.polling.timeout","value":"5000ms","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.zk-timeout-ms","value":"10000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.regionserver.logroll.period","value":"3600000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.orc.splits.include.file.footer","value":"false","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.http-address","value":":50070","isFinal":false,"resource":"hdfs-site.xml"},{"key":"yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds","value":"-1","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.auth.token.max.lifetime","value":"604800000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.zookeeper.dns.nameserver","value":"default","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.namenode.service.handler.count","value":"10","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.nodemanager.default-container-executor.log-dirs.permissions","value":"710","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.server2.async.exec.wait.queue.size","value":"100","isFinal":false,"resource":"programatically"},{"key":"mapreduce.client.output.filter","value":"FAILED","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.reduce.shuffle.memory.limit.percent","value":"0.25","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.server.compactchecker.interval.multiplier","value":"1000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.replication.rpc.codec","value":"org.apache.hadoop.hbase.codec.KeyValueCodecWithTags","isFinal":false,"resource":"hbase-default.xml"},{"key":"nfs.rtmax","value":"1048576","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.data.umask.enable","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.default.fileformat","value":"TextFile","isFinal":false,"resource":"programatically"},{"key":"hadoop.ssl.client.conf","value":"ssl-client.xml","isFinal":true,"resource":"core-site.xml"},{"key":"fs.ftp.host","value":"0.0.0.0","isFinal":false,"resource":"core-default.xml"},{"key":"hive.optimize.groupby","value":"true","isFinal":false,"resource":"programatically"},{"key":"hadoop.http.authentication.simple.anonymous.allowed","value":"true","isFinal":false,"resource":"core-default.xml"},{"key":"nfs.server.port","value":"2049","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.master.logcleaner.ttl","value":"600000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.optimize.remove.identity.project","value":"true","isFinal":false,"resource":"programatically"},{"key":"dfs.ha.log-roll.period","value":"120","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.security.kms.client.authentication.retry-count","value":"1","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.task.io.sort.factor","value":"64","isFinal":false,"resource":"mapred-site.xml"},{"key":"dfs.datanode.https.address","value":"0.0.0.0:50475","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.resourcemanager.principal","value":"yarn/_HOST@EXAMPLE.COM","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.server2.thrift.http.max.worker.threads","value":"500","isFinal":false,"resource":"programatically"},{"key":"hive.limit.query.max.table.partition","value":"-1","isFinal":false,"resource":"programatically"},{"key":"hive.unlock.numretries","value":"10","isFinal":false,"resource":"programatically"},{"key":"hive.exec.job.debug.capture.stacktraces","value":"true","isFinal":false,"resource":"programatically"},{"key":"hbase.status.multicast.address.ip","value":"226.1.1.3","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.hmshandler.retry.interval","value":"2000ms","isFinal":false,"resource":"programatically"},{"key":"mapreduce.job.reduces","value":"-1","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"mapreduce.tasktracker.reduce.tasks.maximum","value":"2","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.namenode.checkpoint.edits.dir","value":"file:///tmp/hadoop-hive/dfs/namesecondary","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.jobhistory.cleaner.interval-ms","value":"86400000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.stats.atomic","value":"false","isFinal":false,"resource":"programatically"},{"key":"hbase.master.logcleaner.plugins","value":"org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.mob.file.compaction.threads.max","value":"1","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.nodemanager.vmem-check-enabled","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.hstore.blockingWaitTime","value":"90000","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.nodemanager.linux-container-executor.nonsecure-mode.user-pattern","value":"^[_.A-Za-z0-9][-@_.A-Za-z0-9]{0,255}?[$]?$","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.replication.considerLoad","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.cli.print.header","value":"false","isFinal":false,"resource":"programatically"},{"key":"ha.health-monitor.sleep-after-disconnect.ms","value":"1000","isFinal":false,"resource":"core-default.xml"},{"key":"zlib.compress.level","value":"DEFAULT_COMPRESSION","isFinal":false,"resource":"mapred-site.xml"},{"key":"mapreduce.job.counters.max","value":"120","isFinal":false,"resource":"mapred-site.xml"},{"key":"s3.blocksize","value":"67108864","isFinal":false,"resource":"core-default.xml"},{"key":"hive.exec.default.partition.name","value":"__HIVE_DEFAULT_PARTITION__","isFinal":false,"resource":"programatically"},{"key":"hive.mapred.partitioner","value":"org.apache.hadoop.hive.ql.io.DefaultHivePartitioner","isFinal":false,"resource":"programatically"},{"key":"hive.groupby.mapaggr.checkinterval","value":"100000","isFinal":false,"resource":"programatically"},{"key":"hive.server2.compile.lock.timeout","value":"0s","isFinal":false,"resource":"programatically"},{"key":"mapreduce.tasktracker.tasks.sleeptimebeforesigkill","value":"5000","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.job.classloader","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.application.classpath","value":"$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*,$MR2_CLASSPATH","isFinal":false,"resource":"mapred-site.xml"},{"key":"yarn.resourcemanager.connect.max-wait.ms","value":"900000","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.resourcemanager.ha.automatic-failover.embedded","value":"true","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.map.aggr.hash.min.reduction","value":"0.5","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobhistory.joblist.cache.size","value":"20000","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.task.profile.maps","value":"0-2","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.client.short.circuit.replica.stale.threshold.ms","value":"1800000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.exec.mode.local.auto.input.files.max","value":"4","isFinal":false,"resource":"programatically"},{"key":"hive.compactor.worker.timeout","value":"86400s","isFinal":false,"resource":"programatically"},{"key":"yarn.scheduler.fair.preemption","value":"false","isFinal":false,"resource":"yarn-site.xml"},{"key":"hadoop.security.kms.client.encrypted.key.cache.num.refill.threads","value":"2","isFinal":false,"resource":"core-default.xml"},{"key":"hive.variable.substitute","value":"true","isFinal":false,"resource":"programatically"},{"key":"hadoop.ssl.server.conf","value":"ssl-server.xml","isFinal":true,"resource":"core-site.xml"},{"key":"hive.test.mode.prefix","value":"test_","isFinal":false,"resource":"programatically"},{"key":"hadoop.proxyuser.hue.hosts","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"dfs.namenode.full.block.report.lease.length.ms","value":"300000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.input.fileinputformat.list-status.num-threads","value":"1","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.test.mode.samplefreq","value":"32","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.edits.dir","value":"file:///dfs/nn","isFinal":false,"resource":"hdfs-default.xml"},{"key":"s3.bytes-per-checksum","value":"512","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.metrics.showTableName","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"fs.permissions.umask-mode","value":"022","isFinal":false,"resource":"hdfs-site.xml"},{"key":"yarn.resourcemanager.proxy-user-privileges.enabled","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.vectorized.execution.reduce.enabled","value":"false","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.skewjoin.mapjoin.map.tasks","value":"10000","isFinal":false,"resource":"programatically"},{"key":"yarn.app.mapreduce.am.containerlauncher.threadpool-initial-size","value":"10","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.http.policy","value":"HTTP_ONLY","isFinal":false,"resource":"yarn-default.xml"},{"key":"hadoop.proxyuser.flume.groups","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"dfs.namenode.path.based.cache.refresh.interval.ms","value":"30000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.resourcemanager.zk-acl","value":"world:anyone:rwcda","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.nodemanager.linux-container-executor.cgroups.mount","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"ipc.client.connect.max.retries.on.timeouts","value":"45","isFinal":false,"resource":"core-default.xml"},{"key":"hive.map.groupby.sorted.testmode","value":"false","isFinal":false,"resource":"programatically"},{"key":"hadoop.fuse.connection.timeout","value":"300","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.block.access.key.update.interval","value":"600","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.job.token.tracking.ids.enabled","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.exec.orc.default.row.index.stride","value":"10000","isFinal":false,"resource":"programatically"},{"key":"ha.health-monitor.rpc-timeout.ms","value":"45000","isFinal":false,"resource":"core-default.xml"},{"key":"hive.script.recordreader","value":"org.apache.hadoop.hive.ql.exec.TextRecordReader","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.server.max.message.size","value":"104857600","isFinal":false,"resource":"programatically"},{"key":"hive.server2.async.exec.keepalive.time","value":"10s","isFinal":false,"resource":"programatically"},{"key":"mapreduce.client.submit.file.replication","value":"1","isFinal":false,"resource":"mapred-site.xml"},{"key":"hbase.hregion.majorcompaction.jitter","value":"0.50","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.mob.file.compaction.batch.size","value":"100","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.stats.dbconnectionstring","value":"jdbc:derby:;databaseName=TempStatsStore;create=true","isFinal":false,"resource":"programatically"},{"key":"hive.zookeeper.connection.max.retries","value":"3","isFinal":false,"resource":"programatically"},{"key":"hive.stats.list.num.entries","value":"10","isFinal":false,"resource":"programatically"},{"key":"hive.server2.logging.operation.enabled","value":"true","isFinal":false,"resource":"programatically"},{"key":"hadoop.ssl.require.client.cert","value":"false","isFinal":true,"resource":"core-site.xml"},{"key":"dfs.datanode.cache.revocation.timeout.ms","value":"900000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"spark.dynamicAllocation.initialExecutors","value":"1","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.server2.thrift.login.timeout","value":"20s","isFinal":false,"resource":"programatically"},{"key":"dfs.ha.tail-edits.period","value":"60","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.client.nodemanager-connect.retry-interval-ms","value":"10000","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.inotify.max.events.per.rpc","value":"1000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.rpc.protection","value":"authentication","isFinal":false,"resource":"core-site.xml"},{"key":"yarn.resourcemanager.fs.state-store.uri","value":"/tmp/hadoop-hive/yarn/system/rmstore","isFinal":false,"resource":"yarn-default.xml"},{"key":"hadoop.proxyuser.httpfs.hosts","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"hive.exec.dynamic.partition","value":"true","isFinal":false,"resource":"programatically"},{"key":"dfs.datanode.scan.period.hours","value":"504","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.datanode.block.id.layout.upgrade.threads","value":"12","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.tez.exec.inplace.progress","value":"true","isFinal":false,"resource":"programatically"},{"key":"hbase.security.exec.permission.checks","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.client.read.shortcircuit.skip.checksum","value":"false","isFinal":false,"resource":"hdfs-site.xml"},{"key":"hive.cli.pretty.output.num.cols","value":"-1","isFinal":false,"resource":"programatically"},{"key":"hive.counters.group.name","value":"HIVE","isFinal":false,"resource":"programatically"},{"key":"dfs.client.file-block-storage-locations.timeout.millis","value":"1000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.client.nodemanager-client-async.thread-pool-max-size","value":"500","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.exec.orc.block.padding.tolerance","value":"0.05","isFinal":false,"resource":"programatically"},{"key":"dfs.domain.socket.path","value":"/var/run/hdfs-sockets/dn","isFinal":false,"resource":"hdfs-site.xml"},{"key":"mapreduce.tasktracker.dns.nameserver","value":"default","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.namenode.stale.datanode.interval","value":"30000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.join.cache.size","value":"25000","isFinal":false,"resource":"programatically"},{"key":"hive.file.max.footer","value":"100","isFinal":false,"resource":"programatically"},{"key":"yarn.timeline-service.address","value":"0.0.0.0:10200","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.app-submission.cross-platform","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"fs.scheme.class","value":"dfs","isFinal":false,"resource":"programatically"},{"key":"hive.archive.enabled","value":"false","isFinal":false,"resource":"programatically"},{"key":"hbase.regionserver.region.split.policy","value":"org.apache.hadoop.hbase.regionserver.IncreasingToUpperBoundRegionSplitPolicy","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.http.policy","value":"HTTP_ONLY","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.map.output.compress","value":"true","isFinal":false,"resource":"mapred-site.xml"},{"key":"hbase.replication.source.maxthreads","value":"10","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.metastore.archive.intermediate.original","value":"_INTERMEDIATE_ORIGINAL","isFinal":false,"resource":"programatically"},{"key":"hbase.online.schema.update.enable","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.shuffle.max.threads","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.cluster.delegation.token.store.zookeeper.znode","value":"/hivedelegation","isFinal":false,"resource":"programatically"},{"key":"zookeeper.session.timeout","value":"90000","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.jobhistory.done-dir","value":"/user/history/done","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.tez.auto.reducer.parallelism","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.security.authorization.manager","value":"org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider","isFinal":false,"resource":"programatically"},{"key":"hive.spark.client.connect.timeout","value":"1000ms","isFinal":false,"resource":"programatically"},{"key":"hive.mapred.mode","value":"nonstrict","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.reject-unresolved-dn-topology-mapping","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.ssl.enabled","value":"false","isFinal":false,"resource":"core-site.xml"},{"key":"fs.s3a.connection.establish.timeout","value":"5000","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.jobtracker.expire.trackers.interval","value":"600000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.stats.join.factor","value":"1.1","isFinal":false,"resource":"programatically"},{"key":"hive.hwi.listen.port","value":"9999","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobhistory.recovery.enable","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.stats.retries.wait","value":"3000ms","isFinal":false,"resource":"programatically"},{"key":"hbase.tmp.dir","value":"/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/hbase-hive","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.zookeeper.quorum","value":"","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"datanucleus.cache.level2.type","value":"none","isFinal":false,"resource":"programatically"},{"key":"mapreduce.job.reduce.slowstart.completedmaps","value":"0.8","isFinal":false,"resource":"mapred-site.xml"},{"key":"mapreduce.output.fileoutputformat.compress.type","value":"BLOCK","isFinal":false,"resource":"mapred-site.xml"},{"key":"mapreduce.reduce.shuffle.parallelcopies","value":"10","isFinal":false,"resource":"mapred-site.xml"},{"key":"hive.tez.container.size","value":"-1","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.delete.thread-count","value":"4","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.timeline-service.client.max-retries","value":"30","isFinal":false,"resource":"yarn-default.xml"},{"key":"hadoop.ssl.enabled.protocols","value":"TLSv1,SSLv2Hello,TLSv1.1,TLSv1.2","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.jobtracker.http.address","value":"0.0.0.0:50030","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.nodemanager.resource.memory-mb","value":"8192","isFinal":false,"resource":"yarn-default.xml"},{"key":"hadoop.kerberos.kinit.command","value":"kinit","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.output.fileoutputformat.compress.codec","value":"org.apache.hadoop.io.compress.DefaultCodec","isFinal":false,"resource":"mapred-site.xml"},{"key":"dfs.namenode.kerberos.internal.spnego.principal","value":"HTTP/_HOST@EXAMPLE.COM","isFinal":false,"resource":"hdfs-site.xml"},{"key":"hive.convert.join.bucket.mapjoin.tez","value":"false","isFinal":false,"resource":"programatically"},{"key":"yarn.app.mapreduce.am.container.log.backups","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.task.profile","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.server2.webui.port","value":"10002","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"ipc.client.rpc-timeout.ms","value":"0","isFinal":false,"resource":"core-default.xml"},{"key":"hive.io.rcfile.record.interval","value":"2147483647","isFinal":false,"resource":"programatically"},{"key":"hadoop.ssl.hostname.verifier","value":"DEFAULT","isFinal":false,"resource":"core-default.xml"},{"key":"hive.map.groupby.sorted","value":"false","isFinal":false,"resource":"programatically"},{"key":"stream.stderr.reporter.enabled","value":"true","isFinal":false,"resource":"programatically"},{"key":"fs.s3a.connection.ssl.enabled","value":"true","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.resourcemanager.scheduler.client.thread-count","value":"50","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.compute.splits.in.am","value":"true","isFinal":false,"resource":"programatically"},{"key":"io.seqfile.local.dir","value":"/tmp/hadoop-hive/io/local","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.datanode.directoryscan.threads","value":"1","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.exec.counters.pull.interval","value":"1000","isFinal":false,"resource":"programatically"},{"key":"yarn.client.failover-retries","value":"0","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.input.lineinputformat.linespermap","value":"1","isFinal":false,"resource":"mapred-default.xml"},{"key":"hadoop.proxyuser.flume.hosts","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"hive.new.job.grouping.set.cardinality","value":"30","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.container-monitor.interval-ms","value":"3000","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.job.queuename","value":"default","isFinal":false,"resource":"mapred-default.xml"},{"key":"spark.shuffle.service.enabled","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"spark.yarn.executor.memoryOverhead","value":"76","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.datanode.dns.nameserver","value":"default","isFinal":false,"resource":"hdfs-default.xml"},{"key":"javax.jdo.option.NonTransactionalRead","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.cli.errors.ignore","value":"false","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.max-log-aggregation-diagnostics-in-memory","value":"10","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.app.mapreduce.client-am.ipc.max-retries-on-timeouts","value":"3","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.datanode.directoryscan.throttle.limit.ms.per.sec","value":"1000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.exec.mode.local.auto.inputbytes.max","value":"134217728","isFinal":false,"resource":"programatically"},{"key":"hbase.normalizer.period","value":"1800000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.stageid.rearrange","value":"none","isFinal":false,"resource":"programatically"},{"key":"fs.automatic.close","value":"true","isFinal":false,"resource":"core-default.xml"},{"key":"spark.driver.memory","value":"966367641","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"mapreduce.framework.name","value":"yarn","isFinal":false,"resource":"mapred-site.xml"},{"key":"dfs.client.failover.sleep.max.millis","value":"15000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.master.info.bindAddress","value":"0.0.0.0","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.resourcemanager.max-completed-applications","value":"10000","isFinal":false,"resource":"yarn-site.xml"},{"key":"yarn.app.mapreduce.am.staging-dir","value":"/user","isFinal":false,"resource":"mapred-site.xml"},{"key":"hbase.client.write.buffer","value":"2097152","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.server2.thrift.http.path","value":"cliservice","isFinal":false,"resource":"programatically"},{"key":"yarn.nm.liveness-monitor.expiry-interval-ms","value":"600000","isFinal":false,"resource":"yarn-site.xml"},{"key":"mapreduce.reduce.shuffle.fetch.retry.enabled","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"datanucleus.autoCreateSchema","value":"true","isFinal":false,"resource":"programatically"},{"key":"mapreduce.tasktracker.report.address","value":"127.0.0.1:0","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.exec.orc.memory.pool","value":"0.5","isFinal":false,"resource":"programatically"},{"key":"hive.optimize.metadataonly","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.mapred.reduce.tasks.speculative.execution","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.lockmgr.zookeeper.default.partition.name","value":"__HIVE_DEFAULT_ZOOKEEPER_PARTITION__","isFinal":false,"resource":"programatically"},{"key":"hive.conf.validation","value":"true","isFinal":false,"resource":"programatically"},{"key":"hbase.hstore.compaction.max","value":"10","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.query.id","value":"hive_20170329092121_1a5984e3-7f54-47a7-972d-3aeb3697b613","isFinal":false,"resource":"programatically"},{"key":"ftp.client-write-packet-size","value":"65536","isFinal":false,"resource":"core-default.xml"},{"key":"hive.metastore.kerberos.principal","value":"hive/_HOST@EXAMPLE.COM","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hbase.regionserver.dns.interface","value":"default","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.prewarm.enabled","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.task.io.sort.mb","value":"256","isFinal":false,"resource":"mapred-site.xml"},{"key":"hadoop.security.kms.client.encrypted.key.cache.expiry","value":"43200000","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.status.published","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.fetch.task.conversion","value":"more","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"mapreduce.tasktracker.taskmemorymanager.monitoringinterval","value":"5000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.metastore.server.min.threads","value":"200","isFinal":false,"resource":"programatically"},{"key":"ftp.blocksize","value":"67108864","isFinal":false,"resource":"core-default.xml"},{"key":"hadoop.registry.jaas.context","value":"Client","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.nodemanager.log-dirs","value":"${yarn.log.dir}/userlogs","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.security.metastore.authorization.manager","value":"org.apache.hadoop.hive.ql.security.authorization.DefaultHiveMetastoreAuthorizationProvider","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.server.tcp.keepalive","value":"true","isFinal":false,"resource":"programatically"},{"key":"hbase.defaults.for.version.skip","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.vectorized.groupby.checkinterval","value":"4096","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"fs.df.interval","value":"60000","isFinal":false,"resource":"core-default.xml"},{"key":"io.skip.checksum.errors","value":"false","isFinal":false,"resource":"core-default.xml"},{"key":"hadoop.jetty.logs.serve.aliases","value":"true","isFinal":false,"resource":"core-default.xml"},{"key":"hive.exec.dynamic.partition.mode","value":"strict","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.remote-app-log-dir-suffix","value":"logs","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.optimize.bucketingsorting","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.merge.mapredfiles","value":"false","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.client.context","value":"default","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.exec.parallel","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.log.explain.output","value":"false","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.namenode.edits.noeditlogchannelflush","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.hstore.compaction.kv.max","value":"10","isFinal":false,"resource":"hbase-default.xml"},{"key":"io.serializations","value":"org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.reduce.skip.maxgroups","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.ha.fencing.ssh.connect-timeout","value":"30000","isFinal":false,"resource":"core-default.xml"},{"key":"hive.tez.cpu.vcores","value":"-1","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobhistory.client.thread-count","value":"10","isFinal":false,"resource":"mapred-default.xml"},{"key":"hadoop.proxyuser.hdfs.hosts","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"hadoop.security.random.device.file.path","value":"/dev/urandom","isFinal":false,"resource":"core-default.xml"},{"key":"fs.s3a.max.total.tasks","value":"1000","isFinal":false,"resource":"core-default.xml"},{"key":"hive.binary.record.max.length","value":"1000","isFinal":false,"resource":"programatically"},{"key":"hive.multi.insert.move.tasks.share.dependencies","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.optimize.index.filter.compact.minsize","value":"5368709120","isFinal":false,"resource":"programatically"},{"key":"net.topology.script.file.name","value":"/etc/hadoop/conf.cloudera.yarn/topology.py","isFinal":false,"resource":"core-site.xml"},{"key":"mapreduce.job.speculative.speculative-cap-total-tasks","value":"0.01","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.compactor.abortedtxn.threshold","value":"1000","isFinal":false,"resource":"programatically"},{"key":"dfs.datanode.bp-ready.timeout","value":"20","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.client-write-packet-size","value":"65536","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.journalnode.https-address","value":"0.0.0.0:8481","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.namenode.enable.retrycache","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.auto.convert.sortmerge.join.bigtable.selection.policy","value":"org.apache.hadoop.hive.ql.optimizer.AvgPartitionSizeBasedBigTableSelectorForAutoSMJ","isFinal":false,"resource":"programatically"},{"key":"hbase.regionserver.optionalcacheflushinterval","value":"3600000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.udtf.auto.progress","value":"false","isFinal":false,"resource":"programatically"},{"key":"dfs.journalnode.rpc-address","value":"0.0.0.0:8485","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.exec.orc.encoding.strategy","value":"SPEED","isFinal":false,"resource":"programatically"},{"key":"hive.stats.fetch.column.stats","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"yarn.resourcemanager.zk-num-retries","value":"1000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.exec.reducers.bytes.per.reducer","value":"67108864","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.reorder.nway.joins","value":"true","isFinal":false,"resource":"programatically"},{"key":"yarn.app.mapreduce.am.container.log.limit.kb","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.tasktracker.map.tasks.maximum","value":"2","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.io.rcfile.tolerate.corruptions","value":"false","isFinal":false,"resource":"programatically"},{"key":"hbase.ipc.server.callqueue.read.ratio","value":"0","isFinal":false,"resource":"hbase-default.xml"},{"key":"hadoop.security.crypto.cipher.suite","value":"AES/CTR/NoPadding","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.resourcemanager.fs.state-store.retry-policy-spec","value":"2000, 500","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.encrypt.data.transfer.cipher.key.bitlength","value":"256","isFinal":false,"resource":"hdfs-site.xml"},{"key":"yarn.ipc.rpc.class","value":"org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.dynamic.jars.dir","value":"/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/hbase-hive/hbase/lib","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.compat","value":"0.12","isFinal":false,"resource":"programatically"},{"key":"file.replication","value":"1","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.datanode.drop.cache.behind.writes","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"spark.master","value":"yarn-cluster","isFinal":false,"resource":"programatically"},{"key":"dfs.client.failover.max.attempts","value":"15","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.index.compact.query.max.entries","value":"10000000","isFinal":false,"resource":"programatically"},{"key":"hbase.thrift.minWorkerThreads","value":"16","isFinal":false,"resource":"hbase-default.xml"},{"key":"rpc.metrics.quantile.enable","value":"false","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.master.port","value":"60000","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb","value":"0","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.jobname.length","value":"50","isFinal":false,"resource":"programatically"},{"key":"hive.mapjoin.bucket.cache.size","value":"100","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.support.allow.format","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"fs.AbstractFileSystem.file.impl","value":"org.apache.hadoop.fs.local.LocalFs","isFinal":false,"resource":"core-default.xml"},{"key":"io.file.buffer.size","value":"65536","isFinal":false,"resource":"core-site.xml"},{"key":"io.native.lib.available","value":"true","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.rest.filter.classes","value":"org.apache.hadoop.hbase.rest.filter.GzipFilter","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.server2.authentication.kerberos.keytab","value":"hive.keytab","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.limit.pushdown.memory.usage","value":"0.4","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.client.mmap.cache.size","value":"256","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.namenode.delegation.key.update-interval","value":"86400000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.user.group.static.mapping.overrides","value":"dr.who=;","isFinal":false,"resource":"core-default.xml"},{"key":"hive.metastore.metrics.enabled","value":"false","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.ha.automatic-failover.enabled","value":"true","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.region.replica.replication.enabled","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.snapshot.master.timeout.millis","value":"300000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.script.operator.truncate.env","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.hashtable.key.count.adjustment","value":"1.0","isFinal":false,"resource":"programatically"},{"key":"hive.exec.rcfile.use.explicit.header","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.server2.global.init.file.location","value":"/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2","isFinal":false,"resource":"programatically"},{"key":"mapreduce.job.end-notification.retry.attempts","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.ipc.server.callqueue.handler.factor","value":"0.1","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.exec.stagingdir","value":".hive-staging","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.schema.verification.record.version","value":"true","isFinal":false,"resource":"programatically"},{"key":"dfs.client.https.need-auth","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.resourcemanager.system-metrics-publisher.enabled","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.client.localityCheck.threadPoolSize","value":"2","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.server2.async.exec.threads","value":"100","isFinal":false,"resource":"programatically"},{"key":"hive.optimize.skewjoin.compiletime","value":"false","isFinal":false,"resource":"programatically"},{"key":"dfs.client.https.keystore.resource","value":"ssl-client.xml","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.namenode.checkpoint.txns","value":"1000000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.timeline-service.http-authentication.type","value":"simple","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.metastore.server.max.threads","value":"1000","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobhistory.loadedjobs.cache.size","value":"5","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.nodemanager.resource.percentage-physical-cpu-limit","value":"100","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.nodemanager.recovery.dir","value":"/tmp/hadoop-hive/yarn-nm-recovery","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.name.dir","value":"file:///dfs/nn","isFinal":false,"resource":"hdfs-site.xml"},{"key":"hive.merge.sparkfiles","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.metastore.try.direct.sql.ddl","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.service.metrics.file.location","value":"/var/log/hive/metrics-hiveserver2/metrics.log","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.server2.idle.session.check.operation","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.input.fileinputformat.split.minsize.per.rack","value":"1","isFinal":false,"resource":"programatically"},{"key":"mapreduce.cluster.acls.enabled","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.client.progressmonitor.pollinterval","value":"1000","isFinal":false,"resource":"mapred-default.xml"},{"key":"file.client-write-packet-size","value":"65536","isFinal":false,"resource":"core-default.xml"},{"key":"hadoop.security.group.mapping.ldap.search.attr.group.name","value":"cn","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.namenode.invalidate.work.pct.per.iteration","value":"0.32f","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.datanode.dns.interface","value":"default","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.server.thread.wakefrequency","value":"10000","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.nodemanager.resource.cpu-vcores","value":"8","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.exec.infer.bucket.sort.num.buckets.power.two","value":"false","isFinal":false,"resource":"programatically"},{"key":"javax.jdo.option.DetachAllOnCommit","value":"true","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.system-metrics-publisher.dispatcher.pool-size","value":"10","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.secondary.https-address","value":"0.0.0.0:50091","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.exec.compress.output","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.server2.idle.session.timeout_check_operation","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"yarn.timeline-service.client.retry-interval-ms","value":"1000","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.shuffle.port","value":"13562","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.resourcemanager.container.liveness-monitor.interval-ms","value":"600000","isFinal":false,"resource":"yarn-site.xml"},{"key":"hbase.zookeeper.property.clientPort","value":"2181","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.exim.uri.scheme.whitelist","value":"hdfs,pfile","isFinal":false,"resource":"programatically"},{"key":"hive.lock.manager","value":"org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager","isFinal":false,"resource":"programatically"},{"key":"hive.display.partition.cols.separately","value":"true","isFinal":false,"resource":"programatically"},{"key":"hbase.hregion.memstore.mslab.enabled","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"hadoop.proxyuser.mapred.hosts","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"yarn.scheduler.maximum-allocation-mb","value":"4105","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.lock.mapred.only.operation","value":"false","isFinal":false,"resource":"programatically"},{"key":"hbase.regionserver.catalog.timeout","value":"600000","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.job.speculative.minimum-allowed-tasks","value":"10","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.master.catalog.timeout","value":"600000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.hbase.generatehfiles","value":"false","isFinal":false,"resource":"programatically"},{"key":"hbase.regionserver.storefile.refresh.period","value":"0","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.tez.input.format","value":"org.apache.hadoop.hive.ql.io.HiveInputFormat","isFinal":false,"resource":"programatically"},{"key":"mapreduce.tasktracker.taskcontroller","value":"org.apache.hadoop.mapred.DefaultTaskController","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.jobhistory.datestring.cache.size","value":"200000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hadoop.proxyuser.hdfs.groups","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"yarn.resourcemanager.admin.client.thread-count","value":"1","isFinal":false,"resource":"yarn-site.xml"},{"key":"yarn.timeline-service.leveldb-timeline-store.path","value":"/tmp/hadoop-hive/yarn/timeline","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.job.reducer.preempt.delay.sec","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"s3native.client-write-packet-size","value":"65536","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.regionserver.thrift.compact","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.http.staticuser.user","value":"dr.stack","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.nodemanager.localizer.client.thread-count","value":"5","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.task.userlog.limit.kb","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.jobhistory.minicluster.fixed.ports","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.regionserver.hlog.writer.impl","value":"org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.job.userlog.retain.hours","value":"24","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.client.keyvalue.maxsize","value":"10485760","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.conf.restricted.list","value":"hive.security.authenticator.manager,hive.security.authorization.manager,hive.users.in.admin.role","isFinal":false,"resource":"programatically"},{"key":"mapreduce.job.committer.task.cleanup.needed","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.mapjoin.check.memory.rows","value":"100000","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.fs-limits.max-blocks-per-file","value":"1048576","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.client.application-client-protocol.poll-interval-ms","value":"200","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.exec.orc.default.stripe.size","value":"67108864","isFinal":false,"resource":"programatically"},{"key":"hive.decode.partition.name","value":"false","isFinal":false,"resource":"programatically"},{"key":"hadoop.registry.secure","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.parquet.timestamp.skip.conversion","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.outerjoin.supports.filters","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.added.jars.path","value":"","isFinal":false,"resource":"programatically"},{"key":"hive.groupby.orderby.position.alias","value":"false","isFinal":false,"resource":"programatically"},{"key":"hbase.server.versionfile.writeattempts","value":"3","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.resourcemanager.scheduler.class","value":"org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.server2.logging.operation.level","value":"EXECUTION","isFinal":false,"resource":"programatically"},{"key":"hadoop.security.auth_to_local","value":"DEFAULT","isFinal":false,"resource":"core-site.xml"},{"key":"hbase.metrics.exposeOperationTimes","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.heartbeat.interval","value":"3","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.mob.sweep.tool.compaction.ratio","value":"0.5f","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.server2.thrift.bind.host","value":"","isFinal":false,"resource":"programatically"},{"key":"mapreduce.task.profile.params","value":"-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.nodemanager.address","value":"0.0.0.0:0","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.fs-limits.max-xattr-size","value":"16384","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.map.java.opts","value":"-Djava.net.preferIPv4Stack=true","isFinal":false,"resource":"mapred-site.xml"},{"key":"mapreduce.shuffle.connection-keep-alive.enable","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.thrift.htablepool.size.max","value":"1000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.master.hfilecleaner.plugins","value":"org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.regionserver.info.port","value":"60030","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.stats.deserialization.factor","value":"1.0","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.localizer.cache.cleanup.interval-ms","value":"600000","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.resourcemanager.amliveliness-monitor.interval-ms","value":"1000","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.metastore.thrift.framed.transport.enabled","value":"false","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.write.stale.datanode.ratio","value":"0.5f","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.server2.authentication.ldap.groupClassKey","value":"groupOfNames","isFinal":false,"resource":"programatically"},{"key":"hive.exec.script.maxerrsize","value":"100000","isFinal":false,"resource":"programatically"},{"key":"hive.stats.key.prefix.reserve.length","value":"24","isFinal":false,"resource":"programatically"},{"key":"ha.failover-controller.cli-check.rpc-timeout.ms","value":"20000","isFinal":false,"resource":"core-default.xml"},{"key":"hive.index.compact.file.ignore.hdfs","value":"false","isFinal":false,"resource":"programatically"},{"key":"fs.s3a.threads.keepalivetime","value":"60","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.local.clientfactory.class.name","value":"org.apache.hadoop.mapred.LocalClientFactory","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.optimize.sort.dynamic.partition","value":"false","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hbase.regionserver.handler.abort.on.error.percent","value":"0.5","isFinal":false,"resource":"hbase-default.xml"},{"key":"hadoop.work.around.non.threadsafe.getpwuid","value":"false","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.jobtracker.taskcache.levels","value":"2","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.security.metastore.authorization.auth.reads","value":"true","isFinal":false,"resource":"programatically"},{"key":"spark.executor.cores","value":"4","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.server2.thrift.sasl.qop","value":"auth","isFinal":false,"resource":"programatically"},{"key":"hbase.hstore.blockingStoreFiles","value":"10","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.zookeeper.session.timeout","value":"1200000ms","isFinal":false,"resource":"programatically"},{"key":"hadoop.proxyuser.HTTP.groups","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"hive.server2.thrift.max.message.size","value":"104857600","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobtracker.staging.root.dir","value":"/tmp/hadoop-hive/mapred/staging","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.ipc.client.fallback-to-simple-auth-allowed","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.rpc.shortoperation.timeout","value":"10000","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.timeline-service.leveldb-timeline-store.start-time-write-cache-size","value":"10000","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.tasktracker.healthchecker.interval","value":"60000","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.webhdfs.ugi.expire.after.access","value":"600000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.namenode.list.cache.directives.num.responses","value":"100","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.blockreport.initialDelay","value":"0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.job.speculative.retry-after-no-speculate","value":"1000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.in.test","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.exec.rowoffset","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.optimize.index.filter.compact.maxsize","value":"-1","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobhistory.intermediate-done-dir","value":"/user/history/done_intermediate","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.map.cpu.vcores","value":"1","isFinal":false,"resource":"mapred-site.xml"},{"key":"datanucleus.plugin.pluginRegistryBundleCheck","value":"LOG","isFinal":false,"resource":"programatically"},{"key":"hadoop.proxyuser.HTTP.hosts","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"yarn.timeline-service.leveldb-timeline-store.read-cache-size","value":"104857600","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.blockreport.split.threshold","value":"1000000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.jobtracker.restart.recover","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.mob.file.compaction.chore.period","value":"604800000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hadoop.registry.zk.connection.timeout.ms","value":"15000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.enforce.bucketmapjoin","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.server2.max.start.attempts","value":"30","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.resource.checked.volumes.minimum","value":"1","isFinal":false,"resource":"hdfs-default.xml"},{"key":"ftp.replication","value":"3","isFinal":false,"resource":"core-default.xml"},{"key":"io.compression.codec.bzip2.library","value":"system-native","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.encrypt.data.transfer","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.reduce.shuffle.retry-delay.max.ms","value":"60000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.spark.client.rpc.threads","value":"8","isFinal":false,"resource":"programatically"},{"key":"mapreduce.workflow.id","value":"hive_hive_20170329092121_1a5984e3-7f54-47a7-972d-3aeb3697b613","isFinal":false,"resource":"programatically"},{"key":"hive.query.string","value":"select name, val1,val2 from sample_data.test_hos_sample2 group by name, val1, val2","isFinal":false,"resource":"programatically"},{"key":"hbase.client.max.total.tasks","value":"100","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.http.filter.initializers","value":"org.apache.hadoop.hbase.http.lib.StaticUserWebFilter","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.server2.thrift.max.worker.threads","value":"100","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.added.jars","value":"file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-hadoop-compat.jar;file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/htrace-core.jar;file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/htrace-core-3.2.0-incubating.jar;file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/htrace-core4-4.0.1-incubating.jar;file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-server.jar;file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-client.jar;file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-hadoop2-compat.jar;file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hive-exec-1.1.0-cdh5.7.1.jar;file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-protocol.jar;file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hbase-common.jar;file:/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/1490804498794-0/hive-hbase-handler-1.1.0-cdh5.7.1.jar","isFinal":false,"resource":"programatically"},{"key":"hive.exec.concatenate.check.index","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.vectorized.groupby.maxentries","value":"1000000","isFinal":false,"resource":"programatically"},{"key":"mapreduce.task.timeout","value":"600000","isFinal":false,"resource":"mapred-site.xml"},{"key":"hbase.mob.file.compaction.mergeable.threshold","value":"201326592","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.optimize.constant.propagation","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.disallow.incompatible.col.type.changes","value":"false","isFinal":false,"resource":"programatically"},{"key":"fs.s3n.multipart.uploads.enabled","value":"false","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.jobhistory.recovery.store.class","value":"org.apache.hadoop.mapreduce.v2.hs.HistoryServerFileSystemStateStoreService","isFinal":false,"resource":"mapred-default.xml"},{"key":"hadoop.security.groups.cache.warn.after.ms","value":"5000","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.nodemanager.localizer.fetch.thread-count","value":"4","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.reduce.shuffle.input.buffer.percent","value":"0.70","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.datanode.data.dir","value":"file:///tmp/hadoop-hive/dfs/data","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hfile.block.bloom.cacheonwrite","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.namenode.accesstime.precision","value":"3600000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.namenode.avoid.write.stale.datanode","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.nodemanager.container-executor.class","value":"org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.server2.use.SSL","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobtracker.heartbeats.in.second","value":"100","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.exec.script.allow.partial.consumption","value":"false","isFinal":false,"resource":"programatically"},{"key":"dfs.client.write.exclude.nodes.cache.expiry.interval.millis","value":"600000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.security.visibility.mutations.checkauths","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.server.scanner.max.result.size","value":"104857600","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.master.loadbalancer.class","value":"org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer","isFinal":false,"resource":"hbase-default.xml"},{"key":"datanucleus.connectionPoolingType","value":"BONECP","isFinal":false,"resource":"programatically"},{"key":"hive.server.tcp.keepalive","value":"true","isFinal":false,"resource":"programatically"},{"key":"dfs.datanode.use.datanode.hostname","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.security.authorization.sqlstd.confwhitelist","value":"hive\\.auto\\..*|hive\\.cbo\\..*|hive\\.convert\\..*|hive\\.exec\\.dynamic\\.partition.*|hive\\.exec\\..*\\.dynamic\\.partitions\\..*|hive\\.exec\\.compress\\..*|hive\\.exec\\.infer\\..*|hive\\.exec\\.mode.local\\..*|hive\\.exec\\.orc\\..*|hive\\.fetch.task\\..*|hive\\.hbase\\..*|hive\\.index\\..*|hive\\.index\\..*|hive\\.intermediate\\..*|hive\\.join\\..*|hive\\.limit\\..*|hive\\.mapjoin\\..*|hive\\.merge\\..*|hive\\.optimize\\..*|hive\\.orc\\..*|hive\\.outerjoin\\..*|hive\\.ppd\\..*|hive\\.prewarm\\..*|hive\\.skewjoin\\..*|hive\\.smbjoin\\..*|hive\\.stats\\..*|hive\\.tez\\..*|hive\\.vectorized\\..*|mapred\\.map\\..*|mapred\\.reduce\\..*|mapred\\.output\\.compression\\.codec|mapreduce\\.job\\.reduce\\.slowstart\\.completedmaps|mapreduce\\.job\\.queuename|mapreduce\\.input\\.fileinputformat\\.split\\.minsize|mapreduce\\.map\\..*|mapreduce\\.reduce\\..*|tez\\.am\\..*|tez\\.task\\..*|tez\\.runtime\\..*|hive\\.exec\\.reducers\\.bytes\\.per\\.reducer|hive\\.client\\.stats\\.counters|hive\\.exec\\.default\\.partition\\.name|hive\\.exec\\.drop\\.ignorenonexistent|hive\\.counters\\.group\\.name|hive\\.enforce\\.bucketing|hive\\.enforce\\.bucketmapjoin|hive\\.enforce\\.sorting|hive\\.enforce\\.sortmergebucketmapjoin|hive\\.cache\\.expr\\.evaluation|hive\\.groupby\\.skewindata|hive\\.hashtable\\.loadfactor|hive\\.hashtable\\.initialCapacity|hive\\.ignore\\.mapjoin\\.hint|hive\\.limit\\.row\\.max\\.size|hive\\.mapred\\.mode|hive\\.map\\.aggr|hive\\.compute\\.query\\.using\\.stats|hive\\.exec\\.rowoffset|hive\\.variable\\.substitute|hive\\.variable\\.substitute\\.depth|hive\\.autogen\\.columnalias\\.prefix\\.includefuncname|hive\\.autogen\\.columnalias\\.prefix\\.label|hive\\.exec\\.check\\.crossproducts|hive\\.compat|hive\\.exec\\.concatenate\\.check\\.index|hive\\.display\\.partition\\.cols\\.separately|hive\\.error\\.on\\.empty\\.partition|hive\\.execution\\.engine|hive\\.exim\\.uri\\.scheme\\.whitelist|hive\\.file\\.max\\.footer|hive\\.mapred\\.supports\\.subdirectories|hive\\.insert\\.into\\.multilevel\\.dirs|hive\\.localize\\.resource\\.num\\.wait\\.attempts|hive\\.multi\\.insert\\.move\\.tasks\\.share\\.dependencies|hive\\.support\\.quoted\\.identifiers|hive\\.resultset\\.use\\.unique\\.column\\.names|hive\\.analyze\\.stmt\\.collect\\.partlevel\\.stats|hive\\.exec\\.job\\.debug\\.capture\\.stacktraces|hive\\.exec\\.job\\.debug\\.timeout|hive\\.exec\\.max\\.created\\.files|hive\\.exec\\.reducers\\.max|hive\\.output\\.file\\.extension|hive\\.exec\\.show\\.job\\.failure\\.debug\\.info|hive\\.exec\\.tasklog\\.debug\\.timeout|hive\\.query\\.id","isFinal":false,"resource":"programatically"},{"key":"hive.server2.tez.sessions.per.default.queue","value":"1","isFinal":false,"resource":"programatically"},{"key":"file.blocksize","value":"67108864","isFinal":false,"resource":"core-default.xml"},{"key":"ipc.client.kill.max","value":"10","isFinal":false,"resource":"core-default.xml"},{"key":"hive.metastore.schema.verification","value":"false","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.nodemanager.minimum.version","value":"NONE","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.list.cache.pools.num.responses","value":"100","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.service.metrics.class","value":"org.apache.hadoop.hive.common.metrics.metrics2.CodahaleMetrics","isFinal":false,"resource":"programatically"},{"key":"dfs.datanode.cache.revocation.polling.ms","value":"500","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.metastore.batch.retrieve.max","value":"300","isFinal":false,"resource":"programatically"},{"key":"hive.querylog.location","value":"/tmp/hive","isFinal":false,"resource":"programatically"},{"key":"yarn.scheduler.fair.assignmultiple","value":"false","isFinal":false,"resource":"yarn-site.xml"},{"key":"hadoop.http.logs.enabled","value":"true","isFinal":false,"resource":"core-default.xml"},{"key":"hive.txn.valid.txns","value":"9223372036854775807:","isFinal":false,"resource":"programatically"},{"key":"dfs.client.read.shortcircuit.streams.cache.size","value":"256","isFinal":false,"resource":"hdfs-default.xml"},{"key":"io.mapfile.bloom.size","value":"1048576","isFinal":false,"resource":"core-default.xml"},{"key":"hive.support.quoted.identifiers","value":"column","isFinal":false,"resource":"programatically"},{"key":"hive.exec.orc.dictionary.key.size.threshold","value":"0.8","isFinal":false,"resource":"programatically"},{"key":"mapreduce.task.exit.timeout","value":"60000","isFinal":false,"resource":"mapred-default.xml"},{"key":"net.topology.impl","value":"org.apache.hadoop.net.NetworkTopology","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.namenode.kerberos.principal.pattern","value":"*","isFinal":false,"resource":"hdfs-default.xml"},{"key":"fs.trash.checkpoint.interval","value":"0","isFinal":false,"resource":"core-default.xml"},{"key":"s3.replication","value":"3","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.app.mapreduce.client.max-retries","value":"3","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.job.maps","value":"2","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.coordinated.state.manager.class","value":"org.apache.hadoop.hbase.coordination.ZkCoordinatedStateManager","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.timeline-service.leveldb-timeline-store.start-time-read-cache-size","value":"10000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.server2.zookeeper.namespace","value":"hiveserver2","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.linux-container-executor.resources-handler.class","value":"org.apache.hadoop.yarn.server.nodemanager.util.DefaultLCEResourcesHandler","isFinal":false,"resource":"yarn-default.xml"},{"key":"datanucleus.validateTables","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.reduce.maxattempts","value":"4","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.job.acl-view-job","value":" ","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.app.mapreduce.am.admin.user.env","value":"LD_LIBRARY_PATH=$HADOOP_COMMON_HOME/lib/native:$JAVA_LIBRARY_PATH","isFinal":false,"resource":"mapred-site.xml"},{"key":"dfs.namenode.checkpoint.dir","value":"file:///tmp/hadoop-hive/dfs/namesecondary","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.lazysimple.extended_boolean_literal","value":"false","isFinal":false,"resource":"programatically"},{"key":"hadoop.http.authentication.type","value":"simple","isFinal":false,"resource":"core-default.xml"},{"key":"hadoop.security.java.secure.random.algorithm","value":"SHA1PRNG","isFinal":false,"resource":"core-default.xml"},{"key":"hive.stats.autogather","value":"true","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.resource.du.reserved","value":"104857600","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.metastore.initial.metadata.count.enabled","value":"true","isFinal":false,"resource":"programatically"},{"key":"spark.executor.memory","value":"456340275","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"yarn.nodemanager.disk-health-checker.min-healthy-disks","value":"0.25","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.nodemanager.localizer.address","value":"0.0.0.0:8040","isFinal":false,"resource":"yarn-default.xml"},{"key":"fs.AbstractFileSystem.viewfs.impl","value":"org.apache.hadoop.fs.viewfs.ViewFs","isFinal":false,"resource":"core-default.xml"},{"key":"hive.metastore.warehouse.dir","value":"/user/hive/warehouse","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"mapreduce.job.map.output.collector.class","value":"org.apache.hadoop.mapred.MapTask$MapOutputBuffer","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.exec.orc.skip.corrupt.data","value":"false","isFinal":false,"resource":"programatically"},{"key":"yarn.timeline-service.ttl-ms","value":"604800000","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.blocksize","value":"134217728","isFinal":false,"resource":"hdfs-site.xml"},{"key":"tfile.io.chunk.size","value":"1048576","isFinal":false,"resource":"core-default.xml"},{"key":"hive.entity.separator","value":"@","isFinal":false,"resource":"programatically"},{"key":"hfile.index.block.max.size","value":"131072","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.task.combine.progress.records","value":"10000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.exec.local.scratchdir","value":"/tmp/hive","isFinal":false,"resource":"programatically"},{"key":"fs.ftp.host.port","value":"21","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.job.committer.setup.cleanup.needed","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.timeline-service.hostname","value":"0.0.0.0","isFinal":false,"resource":"yarn-default.xml"},{"key":"hfile.format.version","value":"2","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.limit.row.max.size","value":"100000","isFinal":false,"resource":"programatically"},{"key":"javax.jdo.option.Multithreaded","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.server2.session.check.interval","value":"900000","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hbase.mob.sweep.tool.compaction.mergeable.size","value":"134217728","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.downloaded.resources.dir","value":"/tmp/12f47c70-bb11-4231-b832-205077c49b7f_resources","isFinal":false,"resource":"programatically"},{"key":"hadoop.proxyuser.yarn.hosts","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"mapreduce.jobhistory.keytab","value":"/etc/security/keytab/jhs.service.keytab","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.zookeeper.connection.basesleeptime","value":"1000ms","isFinal":false,"resource":"programatically"},{"key":"ha.health-monitor.connect-retry-interval.ms","value":"1000","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.namenode.max.objects","value":"0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.exec.infer.bucket.sort","value":"false","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.max.full.block.report.leases","value":"6","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.ignore.mapjoin.hint","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.archive.intermediate.archived","value":"_INTERMEDIATE_ARCHIVED","isFinal":false,"resource":"programatically"},{"key":"nfs.wtmax","value":"1048576","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.client.scanner.timeout.period","value":"60000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.zookeeper.client.port","value":"2181","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.client.block.write.retries","value":"3","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.acl.enable","value":"true","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.metastore.orm.retrieveMapNullsAsEmptyStrings","value":"false","isFinal":false,"resource":"programatically"},{"key":"fs.AbstractFileSystem.hdfs.impl","value":"org.apache.hadoop.fs.Hdfs","isFinal":false,"resource":"core-default.xml"},{"key":"hive.service.metrics.reporter","value":"JSON_FILE, JMX","isFinal":false,"resource":"programatically"},{"key":"hive.server2.webui.spnego.keytab","value":"hive.keytab","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.compactor.worker.threads","value":"0","isFinal":false,"resource":"programatically"},{"key":"hive.analyze.stmt.collect.partlevel.stats","value":"true","isFinal":false,"resource":"programatically"},{"key":"dfs.block.scanner.volume.bytes.per.second","value":"1048576","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.namenode.fs-limits.max-component-length","value":"255","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.map.aggr.hash.percentmemory","value":"0.5","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"mapreduce.job.complete.cancel.delegation.tokens","value":"true","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.io.rcfile.record.buffer.size","value":"4194304","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.recovery.enabled","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.resourcemanager.nodemanagers.heartbeat-interval-ms","value":"1000","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.map.output.compress.codec","value":"org.apache.hadoop.io.compress.SnappyCodec","isFinal":false,"resource":"mapred-site.xml"},{"key":"hive.server2.enable.doAs","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"fs.AbstractFileSystem.har.impl","value":"org.apache.hadoop.fs.HarFs","isFinal":false,"resource":"core-default.xml"},{"key":"hive.hmshandler.retry.attempts","value":"10","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.process-kill-wait.ms","value":"2000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.defaults.for.version","value":"1.2.0-cdh5.7.1","isFinal":false,"resource":"hbase-default.xml"},{"key":"ha.zookeeper.parent-znode","value":"/hadoop-ha","isFinal":false,"resource":"core-default.xml"},{"key":"hive.server2.authentication.ldap.groupMembershipKey","value":"member","isFinal":false,"resource":"programatically"},{"key":"hbase.rest.support.proxyuser","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.smbjoin.cache.rows","value":"10000","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.hbase.wal.enabled","value":"true","isFinal":false,"resource":"programatically"},{"key":"yarn.admin.acl","value":"*","isFinal":false,"resource":"yarn-site.xml"},{"key":"hbase.zookeeper.property.initLimit","value":"10","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.auth.key.update.interval","value":"86400000","isFinal":false,"resource":"hbase-default.xml"},{"key":"s3native.blocksize","value":"67108864","isFinal":false,"resource":"core-default.xml"},{"key":"hive.server2.logging.operation.log.location","value":"/tmp/hive/operation_logs","isFinal":false,"resource":"programatically"},{"key":"fs.s3a.threads.max","value":"256","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.resourcemanager.state-store.max-completed-applications","value":"10000","isFinal":false,"resource":"yarn-default.xml"},{"key":"ipc.client.idlethreshold","value":"4000","isFinal":false,"resource":"core-default.xml"},{"key":"_hive.local.session.path","value":"/tmp/hive/12f47c70-bb11-4231-b832-205077c49b7f","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.thrift.compact.protocol.enabled","value":"false","isFinal":false,"resource":"programatically"},{"key":"zookeeper.znode.acl.parent","value":"acl","isFinal":false,"resource":"hbase-default.xml"},{"key":"ftp.bytes-per-checksum","value":"512","isFinal":false,"resource":"core-default.xml"},{"key":"hive.start.cleanup.scratchdir","value":"false","isFinal":false,"resource":"programatically"},{"key":"hadoop.proxyuser.mapred.groups","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"hbase.rest.port","value":"8080","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.server2.support.dynamic.service.discovery","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.vectorized.groupby.flush.percent","value":"0.1","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.exec.drop.ignorenonexistent","value":"true","isFinal":false,"resource":"programatically"},{"key":"ipc.client.connection.maxidletime","value":"10000","isFinal":false,"resource":"core-default.xml"},{"key":"hive.merge.smallfiles.avgsize","value":"16777216","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"spark.dynamicAllocation.enabled","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.metastore.connect.retries","value":"3","isFinal":false,"resource":"programatically"},{"key":"hadoop.common.configuration.version","value":"0.23.0","isFinal":false,"resource":"core-default.xml"},{"key":"hive.orc.row.index.stride.dictionary.check","value":"true","isFinal":false,"resource":"programatically"},{"key":"mapreduce.ifile.readahead.bytes","value":"4194304","isFinal":false,"resource":"mapred-default.xml"},{"key":"io.map.index.interval","value":"128","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.timeline-service.leveldb-timeline-store.ttl-interval-ms","value":"300000","isFinal":false,"resource":"yarn-default.xml"},{"key":"javax.jdo.option.ConnectionURL","value":"jdbc:derby:;databaseName=metastore_db;create=true","isFinal":false,"resource":"programatically"},{"key":"hive.exec.show.job.failure.debug.info","value":"true","isFinal":false,"resource":"programatically"},{"key":"hbase.master.info.port","value":"60010","isFinal":false,"resource":"hbase-default.xml"},{"key":"tfile.fs.output.buffer.size","value":"262144","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.mob.file.compactor.class","value":"org.apache.hadoop.hbase.mob.filecompactions.PartitionedMobFileCompactor","isFinal":false,"resource":"hbase-default.xml"},{"key":"hadoop.security.group.mapping.ldap.search.attr.member","value":"member","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.nodemanager.health-checker.script.timeout-ms","value":"1200000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.server2.tez.initialize.default.sessions","value":"false","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.handler.count","value":"10","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.security.authenticator.manager","value":"org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator","isFinal":false,"resource":"programatically"},{"key":"hive.tez.max.partition.factor","value":"2.0","isFinal":false,"resource":"programatically"},{"key":"hive.join.emit.interval","value":"1000","isFinal":false,"resource":"programatically"},{"key":"hive.server2.thrift.port","value":"10000","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.namenode.fs-limits.min-block-size","value":"1048576","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.datanode.handler.count","value":"10","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.mapjoin.followby.gby.localtask.max.memory.usage","value":"0.55","isFinal":false,"resource":"programatically"},{"key":"hive.sample.seednumber","value":"0","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.connect.retry-interval.ms","value":"30000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.optimize.ppd.storage","value":"true","isFinal":false,"resource":"programatically"},{"key":"dfs.encrypt.data.transfer.algorithm","value":"3des","isFinal":false,"resource":"hdfs-site.xml"},{"key":"hbase.bulkload.retries.number","value":"10","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.resourcemanager.hostname","value":"0.0.0.0","isFinal":false,"resource":"yarn-default.xml"},{"key":"nfs.dump.dir","value":"/tmp/.hdfs-nfs","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.spark.client.future.timeout","value":"60s","isFinal":false,"resource":"programatically"},{"key":"hive.server2.webui.use.spnego","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.script.auto.progress","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.exec.parallel.thread.number","value":"8","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.retrycache.heap.percent","value":"0.03f","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.namenode.xattrs.enabled","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.jobhistory.webapp.address","value":":19888","isFinal":false,"resource":"mapred-site.xml"},{"key":"hive.optimize.index.autoupdate","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.job.speculative.slowtaskthreshold","value":"1.0","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.resourcemanager.address","value":":8032","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.exec.submitviachild","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.map.aggr.hash.force.flush.memory.threshold","value":"0.9","isFinal":false,"resource":"programatically"},{"key":"datanucleus.fixedDatastore","value":"false","isFinal":false,"resource":"programatically"},{"key":"fs.s3a.connection.timeout","value":"200000","isFinal":false,"resource":"core-default.xml"},{"key":"hive.in.tez.test","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.orc.compute.splits.num.threads","value":"10","isFinal":false,"resource":"programatically"},{"key":"dfs.block.access.token.enable","value":"true","isFinal":false,"resource":"hdfs-site.xml"},{"key":"yarn.resourcemanager.am-rm-tokens.master-key-rolling-interval-secs","value":"86400","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.metastore.sasl.enabled","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"mapreduce.map.sort.spill.percent","value":"0.8","isFinal":false,"resource":"mapred-site.xml"},{"key":"mapreduce.job.end-notification.max.attempts","value":"5","isFinal":true,"resource":"mapred-default.xml"},{"key":"dfs.namenode.safemode.extension","value":"30000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.script.serde","value":"org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe","isFinal":false,"resource":"programatically"},{"key":"hive.heartbeat.interval","value":"1000","isFinal":false,"resource":"programatically"},{"key":"hive.mapred.local.mem","value":"0","isFinal":false,"resource":"programatically"},{"key":"yarn.timeline-service.store-class","value":"org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore","isFinal":false,"resource":"yarn-default.xml"},{"key":"javax.jdo.option.ConnectionDriverName","value":"org.apache.derby.jdbc.EmbeddedDriver","isFinal":false,"resource":"programatically"},{"key":"mapreduce.task.profile.reduces","value":"0-2","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.namenode.edits.journal-plugin.qjournal","value":"org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.tez.dynamic.partition.pruning.max.data.size","value":"104857600","isFinal":false,"resource":"programatically"},{"key":"hbase.zookeeper.leaderport","value":"3888","isFinal":false,"resource":"hbase-default.xml"},{"key":"ha.failover-controller.graceful-fence.connection.retries","value":"1","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.job.jvm.numtasks","value":"1","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.zookeeper.dns.interface","value":"default","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.optimize.index.filter","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.exec.orc.default.compress","value":"ZLIB","isFinal":false,"resource":"programatically"},{"key":"hive.mapjoin.localtask.max.memory.usage","value":"0.9","isFinal":false,"resource":"programatically"},{"key":"yarn.scheduler.fair.user-as-default-queue","value":"true","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.exec.orc.default.block.size","value":"268435456","isFinal":false,"resource":"programatically"},{"key":"dfs.image.compress","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.hstore.compactionThreshold","value":"3","isFinal":false,"resource":"hbase-default.xml"},{"key":"fs.s3n.multipart.copy.block.size","value":"5368709120","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.am.liveness-monitor.expiry-interval-ms","value":"600000","isFinal":false,"resource":"yarn-site.xml"},{"key":"hbase.balancer.period","value":"300000","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.job.ubertask.maxreduces","value":"1","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.namenode.safemode.min.datanodes","value":"0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"fs.s3a.attempts.maximum","value":"20","isFinal":false,"resource":"core-default.xml"},{"key":"parquet.memory.pool.ratio","value":"0.5","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobhistory.move.interval-ms","value":"180000","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.tasktracker.outofband.heartbeat","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.metastore.token.signature","value":"HiveServer2ImpersonationToken","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.uris","value":"thrift://:9083","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"fs.s3.maxRetries","value":"4","isFinal":false,"resource":"core-default.xml"},{"key":"fs.s3a.multipart.size","value":"104857600","isFinal":false,"resource":"core-default.xml"},{"key":"hive.compactor.initiator.on","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.mapjoin.smalltable.filesize","value":"25000000","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.client.connect.retry.delay","value":"1s","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage","value":"90.0","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.rest.readonly","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.shuffle.ssl.enabled","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.namenode.backup.address","value":"0.0.0.0:50100","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.nodemanager.linux-container-executor.nonsecure-mode.local-user","value":"nobody","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.checkpoint.check.period","value":"60","isFinal":false,"resource":"hdfs-default.xml"},{"key":"nfs.allow.insecure.ports","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.namenode.decommission.nodes.per.interval","value":"5","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.cache.expr.evaluation","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.ssl.protocol.blacklist","value":"SSLv2,SSLv3","isFinal":false,"resource":"programatically"},{"key":"hbase.regionserver.regionSplitLimit","value":"1000","isFinal":false,"resource":"hbase-default.xml"},{"key":"net.topology.node.switch.mapping.impl","value":"org.apache.hadoop.net.ScriptBasedMapping","isFinal":false,"resource":"core-default.xml"},{"key":"hive.exec.max.created.files","value":"100000","isFinal":false,"resource":"programatically"},{"key":"fs.swift.impl","value":"org.apache.hadoop.fs.swift.snative.SwiftNativeFileSystem","isFinal":false,"resource":"core-default.xml"},{"key":"hive.exec.scratchdir","value":"/tmp/hive","isFinal":false,"resource":"programatically"},{"key":"mapreduce.workflow.node.name","value":"Stage-1","isFinal":false,"resource":"programatically"},{"key":"datanucleus.rdbms.useLegacyNativeValueStrategy","value":"true","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.edit.log.autoroll.multiplier.threshold","value":"2.0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.nodemanager.container-metrics.unregister-delay-ms","value":"10000","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.webhdfs.user.provider.user.pattern","value":"^[A-Za-z_][A-Za-z0-9._-]*[$]?$","isFinal":false,"resource":"hdfs-default.xml"},{"key":"fs.defaultFS","value":"hdfs://:8020","isFinal":false,"resource":"core-site.xml"},{"key":"mapreduce.reduce.merge.inmem.threshold","value":"1000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.enforce.sorting","value":"false","isFinal":false,"resource":"programatically"},{"key":"dfs.datanode.available-space-volume-choosing-policy.balanced-space-preference-fraction","value":"0.75f","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.security.metastore.authenticator.manager","value":"org.apache.hadoop.hive.ql.security.HadoopDefaultMetastoreAuthenticator","isFinal":false,"resource":"programatically"},{"key":"io.map.index.skip","value":"0","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.secondary.namenode.kerberos.internal.spnego.principal","value":"${dfs.web.authentication.kerberos.principal}","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.local.dir","value":"/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/hbase-hive/local/","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.rpc.query.plan","value":"false","isFinal":false,"resource":"programatically"},{"key":"yarn.app.mapreduce.am.resource.mb","value":"1024","isFinal":false,"resource":"mapred-site.xml"},{"key":"hive.serdes.using.metastore.for.schema","value":"org.apache.hadoop.hive.ql.io.orc.OrcSerde,org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe,org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe,org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe,org.apache.hadoop.hive.serde2.MetadataTypedColumnsetSerDe,org.apache.hadoop.hive.serde2.columnar.LazyBinaryColumnarSerDe,org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe,org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe","isFinal":false,"resource":"programatically"},{"key":"hive.session.history.enabled","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.ppd.recognizetransivity","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.exec.tasklog.debug.timeout","value":"20000","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.disk-health-checker.interval-ms","value":"120000","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.reduce.memory.mb","value":"0","isFinal":false,"resource":"mapred-site.xml"},{"key":"mapreduce.job.maxtaskfailures.per.tracker","value":"3","isFinal":false,"resource":"mapred-default.xml"},{"key":"hadoop.security.crypto.buffer.size","value":"8192","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.scheduler.minimum-allocation-vcores","value":"1","isFinal":false,"resource":"yarn-site.xml"},{"key":"yarn.resourcemanager.keytab","value":"/etc/krb5.keytab","isFinal":false,"resource":"yarn-default.xml"},{"key":"hadoop.proxyuser.httpfs.groups","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"yarn.nodemanager.linux-container-executor.cgroups.hierarchy","value":"/hadoop-yarn","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.server2.thrift.http.worker.keepalive.time","value":"60s","isFinal":false,"resource":"programatically"},{"key":"hive.server2.table.type.mapping","value":"CLASSIC","isFinal":false,"resource":"programatically"},{"key":"hive.exec.job.debug.timeout","value":"30000","isFinal":false,"resource":"programatically"},{"key":"hive.exec.rcfile.use.sync.cache","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.optimize.correlation","value":"false","isFinal":false,"resource":"programatically"},{"key":"io.compression.codecs","value":"org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec,org.apache.hadoop.io.compress.DeflateCodec,org.apache.hadoop.io.compress.SnappyCodec,org.apache.hadoop.io.compress.Lz4Codec","isFinal":false,"resource":"core-site.xml"},{"key":"mapreduce.job.split.metainfo.maxsize","value":"10000000","isFinal":false,"resource":"mapred-site.xml"},{"key":"hive.exec.mode.local.auto","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.skewjoin.mapjoin.min.split","value":"33554432","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.logaggregation.threadpool-size-max","value":"100","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.client.use.legacy.blockreader","value":"false","isFinal":false,"resource":"hdfs-site.xml"},{"key":"hive.tez.min.partition.factor","value":"0.25","isFinal":false,"resource":"programatically"},{"key":"mapreduce.reduce.shuffle.read.timeout","value":"180000","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.app.mapreduce.task.container.log.backups","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.stats.gather.num.threads","value":"10","isFinal":false,"resource":"programatically"},{"key":"hive.entity.capture.transform","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.exec.orc.default.block.padding","value":"true","isFinal":false,"resource":"programatically"},{"key":"ipc.client.connect.max.retries","value":"10","isFinal":false,"resource":"core-default.xml"},{"key":"fs.s3.buffer.dir","value":"/tmp/hadoop-hive/s3","isFinal":false,"resource":"core-default.xml"},{"key":"hive.server2.thrift.http.min.worker.threads","value":"5","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.store.class","value":"org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.index.compact.query.max.size","value":"10737418240","isFinal":false,"resource":"programatically"},{"key":"hbase.hstore.flusher.count","value":"2","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.auto.convert.join.noconditionaltask","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.exec.perf.logger","value":"org.apache.hadoop.hive.ql.log.PerfLogger","isFinal":false,"resource":"programatically"},{"key":"hive.server2.thrift.min.worker.threads","value":"5","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.datanode.max.transfer.threads","value":"4096","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.metastore.rawstore.impl","value":"org.apache.hadoop.hive.metastore.ObjectStore","isFinal":false,"resource":"programatically"},{"key":"mapreduce.input.fileinputformat.input.dir.recursive","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.tez.dynamic.partition.pruning","value":"true","isFinal":false,"resource":"programatically"},{"key":"hadoop.http.authentication.token.validity","value":"36000","isFinal":false,"resource":"core-default.xml"},{"key":"hive.optimize.bucketmapjoin","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobtracker.instrumentation","value":"org.apache.hadoop.mapred.JobTrackerMetricsInst","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.namenode.secondary.http-address","value":"0.0.0.0:50090","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.fuse.timer.period","value":"5","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.client.failover-proxy-provider","value":"org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.ipc.client.tcpnodelay","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.nodemanager.resourcemanager.minimum.version","value":"NONE","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.map.skip.maxrecords","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.compactor.delta.num.threshold","value":"10","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.top.num.users","value":"10","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.application.classpath","value":"$HADOOP_CLIENT_CONF_DIR,$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*,$HADOOP_HDFS_HOME/*,$HADOOP_HDFS_HOME/lib/*,$HADOOP_YARN_HOME/*,$HADOOP_YARN_HOME/lib/*","isFinal":false,"resource":"yarn-site.xml"},{"key":"hbase.hstore.bytes.per.checksum","value":"16384","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.master.mob.ttl.cleaner.period","value":"86400000","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.resourcemanager.configuration.provider-class","value":"org.apache.hadoop.yarn.LocalConfigurationProvider","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.hregion.majorcompaction","value":"604800000","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.tasktracker.indexcache.mb","value":"10","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.localize.resource.num.wait.attempts","value":"5","isFinal":false,"resource":"programatically"},{"key":"hadoop.tmp.dir","value":"/tmp/hadoop-hive","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.webhdfs.enabled","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"datanucleus.autoStartMechanismMode","value":"checked","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.webapp.https.address","value":":8090","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.enforce.sortmergebucketmapjoin","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.limit.optimize.limit.file","value":"10","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.avoid.read.stale.datanode","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.cluster.local.dir","value":"/tmp/hadoop-hive/mapred/local","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.jobhistory.move.thread-count","value":"3","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.status.multicast.address.port","value":"16100","isFinal":false,"resource":"hbase-default.xml"},{"key":"fs.s3a.multipart.threshold","value":"2147483647","isFinal":false,"resource":"core-default.xml"},{"key":"hive.cli.prompt","value":"hive","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.cache.pinobjtypes","value":"Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order","isFinal":false,"resource":"programatically"},{"key":"hbase.zookeeper.property.dataDir","value":"/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/hbase-hive/zookeeper","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.snapshot.restore.failsafe.name","value":"hbase-failsafe-{snapshot.name}-{restore.timestamp}","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.hmshandler.force.reload.conf","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.fs.handler.class","value":"org.apache.hadoop.hive.metastore.HiveMetaStoreFsImpl","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.checkpoint.period","value":"3600","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.spark.job.monitor.timeout","value":"60s","isFinal":false,"resource":"programatically"},{"key":"hadoop.security.kms.client.encrypted.key.cache.low-watermark","value":"0.3f","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.replication","value":"3","isFinal":false,"resource":"hdfs-site.xml"},{"key":"dfs.namenode.datanode.registration.ip-hostname-check","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.job.reducer.unconditional-preempt.delay.sec","value":"300","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.datanode.shared.file.descriptor.paths","value":"/dev/shm,/tmp","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.scheduler.increment-allocation-mb","value":"512","isFinal":false,"resource":"yarn-site.xml"},{"key":"mapreduce.task.tmp.dir","value":"./tmp","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.metastore.execute.setugi","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hadoop.security.instrumentation.requires.admin","value":"false","isFinal":false,"resource":"core-site.xml"},{"key":"dfs.namenode.startup.delay.block.deletion.sec","value":"0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.resourcemanager.resource-tracker.client.thread-count","value":"50","isFinal":false,"resource":"yarn-site.xml"},{"key":"hbase.ipc.server.callqueue.scan.ratio","value":"0","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.stats.reliable","value":"false","isFinal":false,"resource":"programatically"},{"key":"ha.failover-controller.new-active.rpc-timeout.ms","value":"60000","isFinal":false,"resource":"core-default.xml"},{"key":"hive.support.concurrency","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"yarn.app.mapreduce.am.job.task.listener.thread-count","value":"30","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.scheduler.maximum-allocation-vcores","value":"8","isFinal":false,"resource":"yarn-site.xml"},{"key":"net.topology.script.number.args","value":"100","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.tasktracker.healthchecker.script.timeout","value":"600000","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.reduce.cpu.vcores","value":"1","isFinal":false,"resource":"mapred-site.xml"},{"key":"ftp.stream-buffer-size","value":"4096","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.client.nodemanager-connect.max-wait-ms","value":"900000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hadoop.rpc.socket.factory.class.default","value":"org.apache.hadoop.net.StandardSocketFactory","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.snapshot.region.timeout","value":"300000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hadoop.security.dns.log-slow-lookups.threshold.ms","value":"1000","isFinal":false,"resource":"core-default.xml"},{"key":"hadoop.proxyuser.oozie.groups","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"ha.zookeeper.acl","value":"world:anyone:rwcda","isFinal":false,"resource":"core-default.xml"},{"key":"hive.server2.idle.session.timeout","value":"43200000","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hbase.rs.cacheblocksonwrite","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.hstore.checksum.algorithm","value":"CRC32C","isFinal":false,"resource":"hbase-default.xml"},{"key":"ipc.client.connect.retry.interval","value":"1000","isFinal":false,"resource":"core-default.xml"},{"key":"hive.mapjoin.optimized.hashtable.wbsize","value":"10485760","isFinal":false,"resource":"programatically"},{"key":"mapreduce.reduce.speculative","value":"true","isFinal":false,"resource":"mapred-site.xml"},{"key":"hive.transform.escape.input","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.reduce.shuffle.merge.percent","value":"0.66","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.namenode.name.dir.restore","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.regionserver.info.port.auto","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"datanucleus.validateColumns","value":"false","isFinal":false,"resource":"programatically"},{"key":"_hive.hdfs.session.path","value":"/tmp/hive/hive/12f47c70-bb11-4231-b832-205077c49b7f","isFinal":false,"resource":"programatically"},{"key":"hbase.coprocessor.abortonerror","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.job.ubertask.enable","value":"false","isFinal":false,"resource":"mapred-site.xml"},{"key":"hadoop.http.authentication.signature.secret.file","value":"/var/lib/hive/hadoop-http-auth-signature-secret","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.namenode.top.enabled","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.status.publisher.class","value":"org.apache.hadoop.hbase.master.ClusterStatusPublisher$MulticastPublisher","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.hregion.preclose.flush.size","value":"5242880","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.exec.orc.default.buffer.size","value":"262144","isFinal":false,"resource":"programatically"},{"key":"dfs.bytes-per-checksum","value":"512","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.compactor.check.interval","value":"300s","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.fs-limits.max-xattrs-per-inode","value":"32","isFinal":false,"resource":"hdfs-default.xml"},{"key":"spark.yarn.driver.memoryOverhead","value":"102","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.image.compression.codec","value":"org.apache.hadoop.io.compress.DefaultCodec","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.jobhistory.principal","value":"mapred/_HOST@EXAMPLE.COM","isFinal":false,"resource":"mapred-site.xml"},{"key":"hive.metastore.direct.sql.batch.size","value":"0","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobtracker.persist.jobstatus.active","value":"true","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.compute.query.using.stats","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.querylog.enable.plan.progress","value":"true","isFinal":false,"resource":"programatically"},{"key":"hbase.status.listener.class","value":"org.apache.hadoop.hbase.client.ClusterStatusListener$MulticastListener","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.merge.mapfiles","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hadoop.policy.file","value":"hbase-policy.xml","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.stats.fetch.partition.stats","value":"true","isFinal":false,"resource":"programatically"},{"key":"dfs.ha.zkfc.nn.http.timeout.ms","value":"20000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.client.use.datanode.hostname","value":"false","isFinal":false,"resource":"hdfs-site.xml"},{"key":"hive.security.command.whitelist","value":"set,reset,dfs,add,list,delete,reload,compile","isFinal":false,"resource":"programatically"},{"key":"yarn.timeline-service.webapp.https.address","value":"0.0.0.0:8190","isFinal":false,"resource":"yarn-default.xml"},{"key":"tfile.fs.input.buffer.size","value":"262144","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.storage.policy.enabled","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.ssl.keystores.factory.class","value":"org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory","isFinal":true,"resource":"core-site.xml"},{"key":"yarn.nodemanager.admin-env","value":"MALLOC_ARENA_MAX=$MALLOC_ARENA_MAX","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.resourcemanager.am.max-attempts","value":"2","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.txn.timeout","value":"300s","isFinal":false,"resource":"programatically"},{"key":"mapreduce.job.emit-timeline-data","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.jobhistory.cleaner.enable","value":"true","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.scratch.dir.permission","value":"700","isFinal":false,"resource":"programatically"},{"key":"ha.failover-controller.graceful-fence.rpc-timeout.ms","value":"5000","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.datanode.balance.bandwidthPerSec","value":"1048576","isFinal":false,"resource":"hdfs-default.xml"},{"key":"io.storefile.bloom.block.size","value":"131072","isFinal":false,"resource":"hbase-default.xml"},{"key":"io.mapfile.bloom.error.rate","value":"0.005","isFinal":false,"resource":"core-default.xml"},{"key":"hfile.block.index.cacheonwrite","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.client.block.write.replace-datanode-on-failure.enable","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.client.mmap.cache.timeout.ms","value":"3600000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.merge.rcfile.block.level","value":"true","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.blocks.per.postponedblocks.rescan","value":"10000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.http.authentication.kerberos.principal","value":"HTTP/_HOST@LOCALHOST","isFinal":false,"resource":"core-default.xml"},{"key":"hive.server2.webui.max.threads","value":"50","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"yarn.app.mapreduce.am.command-opts","value":"-Djava.net.preferIPv4Stack=true -Xmx825955249","isFinal":false,"resource":"mapred-site.xml"},{"key":"hive.hadoop.supports.splittable.combineinputformat","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.zookeeper.clean.extra.nodes","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.stats.collect.tablekeys","value":"false","isFinal":false,"resource":"programatically"},{"key":"hbase.zookeeper.useMulti","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.namenode.checkpoint.max-retries","value":"3","isFinal":false,"resource":"hdfs-default.xml"},{"key":"javax.jdo.option.ConnectionUserName","value":"APP","isFinal":false,"resource":"programatically"},{"key":"hive.added.files.path","value":"","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.path.based.cache.retry.interval.ms","value":"30000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.query.result.fileformat","value":"TextFile","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobtracker.maxtasks.perjob","value":"-1","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.stats.collect.scancols","value":"true","isFinal":false,"resource":"programatically"},{"key":"hbase.regions.slop","value":"0.2","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.image.transfer-bootstrap-standby.bandwidthPerSec","value":"0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.registry.system.acls","value":"sasl:yarn@, sasl:mapred@, sasl:mapred@hdfs@","isFinal":false,"resource":"yarn-default.xml"},{"key":"s3native.stream-buffer-size","value":"4096","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.task.profile.reduce.params","value":"-agentlib:hprof=cpu=samples,heap=sites,force=n,thread=y,verbose=n,file=%s","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.input.fileinputformat.split.minsize.per.node","value":"1","isFinal":false,"resource":"programatically"},{"key":"dfs.permissions.enabled","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.server2.allow.user.substitution","value":"true","isFinal":false,"resource":"programatically"},{"key":"ha.health-monitor.check-interval.ms","value":"1000","isFinal":false,"resource":"core-default.xml"},{"key":"hadoop.proxyuser.yarn.groups","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"hive.compactor.delta.pct.threshold","value":"0.1","isFinal":false,"resource":"programatically"},{"key":"hive.exec.max.dynamic.partitions.pernode","value":"100","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.recovery.enabled","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.audit.loggers","value":"default","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.nodemanager.health-checker.interval-ms","value":"600000","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.acls.enabled","value":"false","isFinal":false,"resource":"hdfs-site.xml"},{"key":"hive.stats.ndv.error","value":"20.0","isFinal":false,"resource":"programatically"},{"key":"mapreduce.job.acl-modify-job","value":" ","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.resourcemanager.work-preserving-recovery.enabled","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.timeline-service.handler-thread-count","value":"10","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.optimize.skewjoin","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.merge.size.per.task","value":"268435456","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"yarn.app.mapreduce.am.scheduler.heartbeat.interval-ms","value":"1000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.client.scanner.max.result.size","value":"2097152","isFinal":false,"resource":"hbase-default.xml"},{"key":"hadoop.proxyuser.hive.hosts","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"hive.auto.convert.join.use.nonstaged","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.localize.resource.wait.interval","value":"5000ms","isFinal":false,"resource":"programatically"},{"key":"hive.optimize.distinct.rewrite","value":"true","isFinal":false,"resource":"programatically"},{"key":"mapreduce.shuffle.transfer.buffer.size","value":"131072","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.encrypt.data.transfer.cipher.suites","value":"AES/CTR/NoPadding","isFinal":false,"resource":"hdfs-site.xml"},{"key":"hive.plan.serialization.format","value":"kryo","isFinal":false,"resource":"programatically"},{"key":"hbase.hregion.max.filesize","value":"10737418240","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.namenode.list.encryption.zones.num.responses","value":"100","isFinal":false,"resource":"hdfs-default.xml"},{"key":"zookeeper.znode.rootserver","value":"root-region-server","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.app.mapreduce.am.job.committer.cancel-timeout","value":"60000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.table.lock.enable","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.regionserver.info.bindAddress","value":"0.0.0.0","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.nodemanager.hostname","value":"0.0.0.0","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.rework.mapredwork","value":"false","isFinal":false,"resource":"programatically"},{"key":"yarn.log-aggregation.retain-check-interval-seconds","value":"-1","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.optimize.sampling.orderby","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.merge.orcfile.stripe.level","value":"true","isFinal":false,"resource":"programatically"},{"key":"hbase.rootdir","value":"/yarn/nm/usercache/hive/appcache/application_1490661058002_0011/container_1490661058002_0011_01_000001/tmp/hbase-hive/hbase","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.exec.orc.compression.strategy","value":"SPEED","isFinal":false,"resource":"programatically"},{"key":"fs.har.impl.disable.cache","value":"true","isFinal":false,"resource":"core-default.xml"},{"key":"spark.dynamicAllocation.maxExecutors","value":"2147483647","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.stats.max.variable.length","value":"100","isFinal":false,"resource":"programatically"},{"key":"yarn.timeline-service.http-authentication.simple.anonymous.allowed","value":"true","isFinal":false,"resource":"yarn-default.xml"},{"key":"hadoop.security.group.mapping.ldap.search.filter.group","value":"(objectClass=group)","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.regionserver.handler.count","value":"30","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.mapred.supports.subdirectories","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobtracker.persist.jobstatus.dir","value":"/jobtracker/jobsInfo","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.exec.script.trust","value":"false","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users","value":"true","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.app.mapreduce.am.resource.cpu-vcores","value":"1","isFinal":false,"resource":"mapred-site.xml"},{"key":"hive.cluster.delegation.token.store.class","value":"org.apache.hadoop.hive.thrift.MemoryTokenStore","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hadoop.proxyuser.oozie.hosts","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"hive.vectorized.execution.enabled","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"yarn.resourcemanager.delayed.delegation-token.removal-interval-ms","value":"30000","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.nodemanager.vmem-pmem-ratio","value":"2.1","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.rest.threads.min","value":"2","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.nodemanager.localizer.cache.target-size-mb","value":"10240","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.stats.key.prefix.max.length","value":"150","isFinal":false,"resource":"programatically"},{"key":"hive.cbo.enable","value":"false","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.optimize.reducededuplication","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.exec.orc.zerocopy","value":"false","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.scheduler.monitor.enable","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.default.rcfile.serde","value":"org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe","isFinal":false,"resource":"programatically"},{"key":"hive.auto.convert.join","value":"false","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.client.domain.socket.data.traffic","value":"false","isFinal":false,"resource":"hdfs-site.xml"},{"key":"fs.s3a.threads.core","value":"15","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.client.retries.number","value":"35","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.job.name","value":"select name, val1,val2 from sample_d...val2(Stage-1)","isFinal":false,"resource":"programatically"},{"key":"mapreduce.tasktracker.http.threads","value":"40","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.zookeeper.property.maxClientCnxns","value":"300","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.resourcemanager.zk-state-store.parent-path","value":"/rmstore","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.datanode.block-pinning.enabled","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.metastore.failure.retries","value":"1","isFinal":false,"resource":"programatically"},{"key":"mapreduce.map.speculative","value":"false","isFinal":false,"resource":"mapred-site.xml"},{"key":"hadoop.proxyuser.hue.groups","value":"*","isFinal":false,"resource":"core-site.xml"},{"key":"yarn.resourcemanager.webapp.delegation-token-auth-filter.enabled","value":"true","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.reduce.shuffle.fetch.retry.interval-ms","value":"1000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.server2.webui.spnego.principal","value":"HTTP/@EXAMPLE.COM","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.hwi.listen.host","value":"0.0.0.0","isFinal":false,"resource":"programatically"},{"key":"dfs.cachereport.intervalMsec","value":"10000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.orc.cache.stripe.details.size","value":"10000","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.batch.retrieve.table.partition.max","value":"1000","isFinal":false,"resource":"programatically"},{"key":"yarn.log-aggregation.retain-seconds","value":"-1","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.metastore.client.socket.timeout","value":"300","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"yarn.nodemanager.webapp.address","value":"0.0.0.0:8042","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.snapshot.restore.take.failsafe.snapshot","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.namenode.replication.interval","value":"3","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.nodemanager.local-dirs","value":"/tmp/hadoop-hive/nm-local-dir","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.regionserver.port","value":"60020","isFinal":false,"resource":"hbase-default.xml"},{"key":"nfs.mountd.port","value":"4242","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.resultset.use.unique.column.names","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.server2.webui.host","value":"0.0.0.0","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hadoop.registry.zk.retry.interval.ms","value":"1000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hadoop.security.uid.cache.secs","value":"14400","isFinal":false,"resource":"core-default.xml"},{"key":"hive.server2.webui.max.historic.queries","value":"25","isFinal":false,"resource":"programatically"},{"key":"hive.variable.substitute.depth","value":"40","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.resource.check.interval","value":"5000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.datanode.fsdatasetcache.max.threads.per.volume","value":"4","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.client.max.perregion.tasks","value":"1","isFinal":false,"resource":"hbase-default.xml"},{"key":"javax.jdo.PersistenceManagerFactoryClass","value":"org.datanucleus.api.jdo.JDOPersistenceManagerFactory","isFinal":false,"resource":"programatically"},{"key":"hive.fetch.output.serde","value":"org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe","isFinal":false,"resource":"programatically"},{"key":"hbase.regionserver.hlog.reader.impl","value":"org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.hashtable.loadfactor","value":"0.75","isFinal":false,"resource":"programatically"},{"key":"hive.auto.convert.join.noconditionaltask.size","value":"2562964180","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hbase.regionserver.thrift.framed","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.hregion.percolumnfamilyflush.size.lower.bound","value":"16777216","isFinal":false,"resource":"hbase-default.xml"},{"key":"fs.s3n.multipart.uploads.block.size","value":"67108864","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.master.infoserver.redirect","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.server2.thrift.exponential.backoff.slot.length","value":"100ms","isFinal":false,"resource":"programatically"},{"key":"hive.exec.compress.intermediate","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.exec.check.crossproducts","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.optimize.listbucketing","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.task.exit.timeout.check-interval-ms","value":"20000","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.reduce.shuffle.connect.timeout","value":"180000","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.am.max-attempts","value":"2","isFinal":false,"resource":"mapred-site.xml"},{"key":"dfs.datanode.http.address","value":"0.0.0.0:50075","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.security.authorization","value":"true","isFinal":false,"resource":"core-site.xml"},{"key":"hive.stats.map.num.entries","value":"10","isFinal":false,"resource":"programatically"},{"key":"mapreduce.task.merge.progress.records","value":"10000","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.optimize.sampling.orderby.percent","value":"0.1","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.event.clean.freq","value":"0s","isFinal":false,"resource":"programatically"},{"key":"dfs.image.transfer.timeout","value":"60000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.ifile.readahead","value":"true","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.task.skip.start.attempts","value":"2","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.resourcemanager.work-preserving-recovery.scheduling-wait-ms","value":"10000","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.resourcemanager.nm.liveness-monitor.interval-ms","value":"1000","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.io.rcfile.column.number.conf","value":"0","isFinal":false,"resource":"programatically"},{"key":"hive.limit.optimize.fetch.max","value":"50000","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.ha.enabled","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.exec.copyfile.maxsize","value":"33554432","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hbase.mob.cache.evict.period","value":"3600","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.input.fileinputformat.split.minsize","value":"1","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.txn.max.open.batch","value":"1000","isFinal":false,"resource":"programatically"},{"key":"hbase.rest.threads.max","value":"100","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.timeline-service.ttl-enable","value":"true","isFinal":false,"resource":"yarn-default.xml"},{"key":"hadoop.bin.path","value":"/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hadoop/bin/hadoop","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.top.windows.minutes","value":"1,5,25","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.coprocessor.enabled","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.namenode.backup.http-address","value":"0.0.0.0:50105","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.auto.convert.sortmerge.join","value":"false","isFinal":false,"resource":"programatically"},{"key":"hbase.config.read.zookeeper.config","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.namenode.delegation.token.max-lifetime","value":"604800000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.map.maxattempts","value":"4","isFinal":false,"resource":"mapred-default.xml"},{"key":"hfile.block.cache.size","value":"0.4","isFinal":false,"resource":"hbase-default.xml"},{"key":"datanucleus.cache.level2","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.groupby.skewindata","value":"false","isFinal":false,"resource":"programatically"},{"key":"dfs.image.transfer.bandwidthPerSec","value":"0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.compactor.cleaner.run.interval","value":"5000ms","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.max.extra.edits.segments.retained","value":"10000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.client.mmap.enabled","value":"true","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.fileformat.check","value":"true","isFinal":false,"resource":"programatically"},{"key":"hbase.hregion.memstore.block.multiplier","value":"4","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.job.ubertask.maxmaps","value":"9","isFinal":false,"resource":"mapred-default.xml"},{"key":"fs.client.resolve.remote.symlinks","value":"true","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.stream-buffer-size","value":"4096","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.client.block.write.replace-datanode-on-failure.policy","value":"DEFAULT","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.tez.smb.number.waves","value":"0.5","isFinal":false,"resource":"programatically"},{"key":"io.seqfile.lazydecompress","value":"true","isFinal":false,"resource":"core-default.xml"},{"key":"hive.server2.transport.mode","value":"binary","isFinal":false,"resource":"programatically"},{"key":"hbase.data.umask","value":"000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hadoop.security.group.mapping.ldap.ssl","value":"false","isFinal":false,"resource":"core-default.xml"},{"key":"hive.aux.jars.path","value":"file:///opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hive/lib/hive-hbase-handler-1.1.0-cdh5.7.1.jar,file:///opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hbase/hbase-hadoop-compat.jar,file:///opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hbase/hbase-common.jar,file:///opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hbase/hbase-client.jar,file:///opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hbase/lib/htrace-core4-4.0.1-incubating.jar,file:///opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hbase/lib/htrace-core-3.2.0-incubating.jar,file:///opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hbase/lib/htrace-core.jar,file:///opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hbase/hbase-hadoop2-compat.jar,file:///opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hbase/hbase-protocol.jar,file:///opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hbase/hbase-server.jar","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.hwi.war.file","value":"${env:HWI_WAR_FILE}","isFinal":false,"resource":"programatically"},{"key":"mapreduce.task.files.preserve.failedtasks","value":"false","isFinal":false,"resource":"mapred-default.xml"},{"key":"fs.s3a.paging.maximum","value":"5000","isFinal":false,"resource":"core-default.xml"},{"key":"s3native.bytes-per-checksum","value":"512","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.job.reduce.shuffle.consumer.plugin.class","value":"org.apache.hadoop.mapreduce.task.reduce.Shuffle","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.journalnode.http-address","value":"0.0.0.0:8480","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.timeline-service.enabled","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.spark.client.secret.bits","value":"256","isFinal":false,"resource":"programatically"},{"key":"hive.hbase.snapshot.restoredir","value":"/tmp","isFinal":false,"resource":"programatically"},{"key":"hbase.regionserver.dns.nameserver","value":"default","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.server2.thrift.http.port","value":"10001","isFinal":false,"resource":"programatically"},{"key":"hbase.bulkload.staging.dir","value":"/user/hive/hbase-staging","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.user.home.dir.prefix","value":"/user","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.nodemanager.keytab","value":"/etc/krb5.keytab","isFinal":false,"resource":"yarn-default.xml"},{"key":"hadoop.http.staticuser.user","value":"dr.who","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.ha.automatic-failover.enabled","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.regionserver.logroll.errors.tolerated","value":"2","isFinal":false,"resource":"hbase-default.xml"},{"key":"datanucleus.identifierFactory","value":"datanucleus1","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobhistory.http.policy","value":"HTTP_ONLY","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.jobtracker.persist.jobstatus.hours","value":"1","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.blockreport.intervalMsec","value":"21600000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.hashtable.initialCapacity","value":"100000","isFinal":false,"resource":"programatically"},{"key":"io.seqfile.compress.blocksize","value":"1000000","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.client.failover.connection.retries.on.timeouts","value":"0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.resourcemanager.admin.address","value":":8033","isFinal":false,"resource":"yarn-site.xml"},{"key":"hbase.regionserver.thrift.framed.max_frame_size_in_mb","value":"2","isFinal":false,"resource":"hbase-default.xml"},{"key":"ha.zookeeper.session-timeout.ms","value":"5000","isFinal":false,"resource":"core-default.xml"},{"key":"hadoop.registry.rm.enabled","value":"false","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.replication.max","value":"512","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.nodemanager.container-manager.thread-count","value":"20","isFinal":false,"resource":"yarn-default.xml"},{"key":"hadoop.security.groups.negative-cache.secs","value":"30","isFinal":false,"resource":"core-default.xml"},{"key":"fs.s3a.impl","value":"org.apache.hadoop.fs.s3a.S3AFileSystem","isFinal":false,"resource":"core-default.xml"},{"key":"hadoop.registry.zk.retry.times","value":"5","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.stats.jdbcdriver","value":"org.apache.derby.jdbc.EmbeddedDriver","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.event.expiry.duration","value":"0s","isFinal":false,"resource":"programatically"},{"key":"hive.merge.tezfiles","value":"false","isFinal":false,"resource":"programatically"},{"key":"file.stream-buffer-size","value":"4096","isFinal":false,"resource":"core-default.xml"},{"key":"hadoop.security.group.mapping","value":"org.apache.hadoop.security.ShellBasedUnixGroupsMapping","isFinal":false,"resource":"core-site.xml"},{"key":"hbase.fs.tmp.dir","value":"/user/hive/hbase-staging","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.default.chunk.view.size","value":"32768","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.jobhistory.recovery.store.fs.uri","value":"/tmp/hadoop-hive/mapred/history/recoverystore","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.resourcemanager.scheduler.monitor.policies","value":"org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.timeline-service.keytab","value":"/etc/krb5.keytab","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.zookeeper.quorum","value":"localhost","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.zookeeper.namespace","value":"hive_zookeeper_namespace_hive","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.optimize.ppd","value":"true","isFinal":false,"resource":"programatically"},{"key":"mapreduce.reduce.input.buffer.percent","value":"0.0","isFinal":false,"resource":"mapred-default.xml"},{"key":"zookeeper.znode.parent","value":"/hbase","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.jobhistory.address","value":":10020","isFinal":false,"resource":"mapred-site.xml"},{"key":"io.seqfile.sorter.recordlimit","value":"1000000","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.namenode.num.checkpoints.retained","value":"2","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.datanode.kerberos.principal","value":"hdfs/_HOST@EXAMPLE.COM","isFinal":false,"resource":"hdfs-site.xml"},{"key":"mapreduce.tasktracker.local.dir.minspacestart","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.job.max.split.locations","value":"10","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.workflow.name","value":"select name, val1,val2 from sample_data.test_hos_sample2 group by name, val1, val2","isFinal":false,"resource":"programatically"},{"key":"mapreduce.reduce.log.level","value":"INFO","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.client.max.perserver.tasks","value":"5","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.timeline-service.webapp.address","value":"0.0.0.0:8188","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.snapshot.enabled","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"output.formatter","value":"org.apache.hadoop.hive.ql.exec.FetchFormatter$ThriftFormatter","isFinal":false,"resource":"programatically"},{"key":"hive.autogen.columnalias.prefix.includefuncname","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.stats.jdbc.timeout","value":"30s","isFinal":false,"resource":"programatically"},{"key":"hbase.lease.recovery.timeout","value":"900000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.column.max.version","value":"1","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.resourcemanager.zk-retry-interval-ms","value":"1000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.optimize.null.scan","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.stats.tmp.loc","value":"hdfs://:8020/tmp/hive/hive/12f47c70-bb11-4231-b832-205077c49b7f/hive_2017-03-29_09-21-22_164_7860513608405045206-47/-mr-10000/.hive-staging_hive_2017-03-29_09-21-22_164_7860513608405045206-47/-ext-10002","isFinal":false,"resource":"programatically"},{"key":"dfs.client.read.shortcircuit.streams.cache.expiry.ms","value":"300000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.security.dns.log-slow-lookups.enabled","value":"false","isFinal":false,"resource":"core-default.xml"},{"key":"spark.dynamicAllocation.minExecutors","value":"1","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hadoop.security.crypto.codec.classes.aes.ctr.nopadding","value":"org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec,org.apache.hadoop.crypto.JceAesCtrCryptoCodec","isFinal":false,"resource":"core-default.xml"},{"key":"hive.default.serde","value":"org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe","isFinal":false,"resource":"programatically"},{"key":"hive.querylog.plan.progress.interval","value":"60000ms","isFinal":false,"resource":"programatically"},{"key":"hbase.security.authentication","value":"simple","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.auto.progress.timeout","value":"0s","isFinal":false,"resource":"programatically"},{"key":"mapreduce.job.end-notification.retry.interval","value":"1000","isFinal":false,"resource":"mapred-default.xml"},{"key":"yarn.nodemanager.remote-app-log-dir","value":"/tmp/logs","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.scheduler.increment-allocation-vcores","value":"1","isFinal":false,"resource":"yarn-site.xml"},{"key":"hive.input.format","value":"org.apache.hadoop.hive.ql.io.CombineHiveInputFormat","isFinal":false,"resource":"programatically"},{"key":"hive.server.read.socket.timeout","value":"10s","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobtracker.tasktracker.maxblacklists","value":"4","isFinal":false,"resource":"mapred-default.xml"},{"key":"hadoop.security.group.mapping.ldap.directory.search.timeout","value":"10000","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.namenode.decommission.interval","value":"30","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.am.blacklisting.enabled","value":"true","isFinal":false,"resource":"yarn-default.xml"},{"key":"yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs","value":"86400","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.typecheck.on.insert","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.entity.capture.input.URI","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.insert.into.external.tables","value":"true","isFinal":false,"resource":"programatically"},{"key":"yarn.nodemanager.delete.debug-delay-sec","value":"0","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.namenode.https-address","value":":50470","isFinal":false,"resource":"hdfs-site.xml"},{"key":"hive.stats.collect.rawdatasize","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.service.metrics.file.frequency","value":"30000","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"mapreduce.tasktracker.local.dir.minspacekill","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.enforce.bucketing","value":"false","isFinal":false,"resource":"programatically"},{"key":"hbase.regionserver.msginterval","value":"3000","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.nodemanager.log-aggregation.compression-type","value":"none","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.https.server.keystore.resource","value":"ssl-server.xml","isFinal":false,"resource":"hdfs-default.xml"},{"key":"yarn.am.blacklisting.disable-failure-threshold","value":"0.8f","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.tasktracker.http.address","value":"0.0.0.0:50060","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.auto.convert.sortmerge.join.to.mapjoin","value":"false","isFinal":false,"resource":"programatically"},{"key":"ipc.client.connect.timeout","value":"20000","isFinal":false,"resource":"core-default.xml"},{"key":"hive.insert.into.multilevel.dirs","value":"false","isFinal":false,"resource":"programatically"},{"key":"startcode","value":"1490669429563","isFinal":false,"resource":"programatically"},{"key":"datanucleus.transactionIsolation","value":"read-committed","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.path.based.cache.block.map.allocation.percent","value":"0.25","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.metadata.move.exported.metadata.to.trash","value":"true","isFinal":false,"resource":"programatically"},{"key":"output.protocol","value":"6","isFinal":false,"resource":"programatically"},{"key":"dfs.https.port","value":"50470","isFinal":false,"resource":"hdfs-site.xml"},{"key":"mapreduce.cluster.temp.dir","value":"/tmp/hadoop-hive/mapred/temp","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.output.fileoutputformat.compress","value":"false","isFinal":false,"resource":"mapred-site.xml"},{"key":"yarn.client.failover-retries-on-socket-timeouts","value":"0","isFinal":false,"resource":"yarn-default.xml"},{"key":"fs.s3a.buffer.dir","value":"/tmp/hadoop-hive/s3a","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.client.block.write.replace-datanode-on-failure.best-effort","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.fetch.task.aggr","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.tez.dynamic.partition.pruning.max.event.size","value":"1048576","isFinal":false,"resource":"programatically"},{"key":"hive.optimize.reducededuplication.min.reducer","value":"4","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hadoop.http.authentication.kerberos.keytab","value":"/var/lib/hive/hadoop.keytab","isFinal":false,"resource":"core-default.xml"},{"key":"hive.server2.metrics.enabled","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"ipc.ping.interval","value":"60000","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.master.normalizer.class","value":"org.apache.hadoop.hbase.master.normalizer.SimpleRegionNormalizer","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.server2.thrift.http.max.idle.time","value":"1800s","isFinal":false,"resource":"programatically"},{"key":"hive.test.mode","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobhistory.admin.address","value":":10033","isFinal":false,"resource":"mapred-site.xml"},{"key":"yarn.nodemanager.pmem-check-enabled","value":"true","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.user.install.directory","value":"hdfs:///user/","isFinal":false,"resource":"programatically"},{"key":"hive.exec.max.dynamic.partitions","value":"1000","isFinal":false,"resource":"programatically"},{"key":"yarn.bin.path","value":"/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hadoop/bin/yarn","isFinal":false,"resource":"programatically"},{"key":"fs.s3a.fast.upload","value":"false","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.reduce.java.opts","value":"-Djava.net.preferIPv4Stack=true","isFinal":false,"resource":"mapred-site.xml"},{"key":"yarn.nodemanager.docker-container-executor.exec-name","value":"/usr/bin/docker","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.storescanner.parallel.seek.enable","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.datanode.available-space-volume-choosing-policy.balanced-space-threshold","value":"10737418240","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.ppd.remove.duplicatefilters","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.session.id","value":"12f47c70-bb11-4231-b832-205077c49b7f","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobtracker.handler.count","value":"10","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.namenode.servicerpc-address","value":":8022","isFinal":false,"resource":"hdfs-site.xml"},{"key":"dfs.client.cached.conn.retry","value":"3","isFinal":false,"resource":"hdfs-default.xml"},{"key":"fs.s3a.fast.buffer.size","value":"1048576","isFinal":false,"resource":"core-default.xml"},{"key":"hive.optimize.union.remove","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.test.authz.sstd.hs2.mode","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobtracker.jobhistory.block.size","value":"3145728","isFinal":false,"resource":"mapred-default.xml"},{"key":"javax.jdo.option.ConnectionPassword","value":"mine","isFinal":false,"resource":"programatically"},{"key":"fs.s3.sleepTimeSeconds","value":"10","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.mob.file.cache.size","value":"1000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.added.archives.path","value":"","isFinal":false,"resource":"programatically"},{"key":"dfs.datanode.du.reserved","value":"0","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.datanode.address","value":"0.0.0.0:50010","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hadoop.registry.zk.retry.ceiling.ms","value":"60000","isFinal":false,"resource":"yarn-default.xml"},{"key":"hive.spark.client.server.connect.timeout","value":"90000ms","isFinal":false,"resource":"programatically"},{"key":"hive.lock.numretries","value":"100","isFinal":false,"resource":"programatically"},{"key":"dfs.namenode.num.extra.edits.retained","value":"1000000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.security.authorization.task.factory","value":"org.apache.hadoop.hive.ql.parse.authorization.RestrictedHiveAuthorizationTaskFactoryImpl","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobhistory.admin.acl","value":"*","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.datanode.drop.cache.behind.reads","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"ipc.client.ping","value":"true","isFinal":false,"resource":"core-default.xml"},{"key":"hive.error.on.empty.partition","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.mapper.cannot.span.multiple.partitions","value":"false","isFinal":false,"resource":"programatically"},{"key":"hbase.lease.recovery.dfs.timeout","value":"64000","isFinal":false,"resource":"hbase-default.xml"},{"key":"datanucleus.validateConstraints","value":"false","isFinal":false,"resource":"programatically"},{"key":"dfs.datanode.directoryscan.interval","value":"21600","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.exec.reducers.max","value":"1099","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hbase.mob.cache.evict.remain.ratio","value":"0.5f","isFinal":false,"resource":"hbase-default.xml"},{"key":"mapreduce.input.fileinputformat.split.maxsize","value":"256000000","isFinal":false,"resource":"programatically"},{"key":"hive.metastore.archive.intermediate.extracted","value":"_INTERMEDIATE_EXTRACTED","isFinal":false,"resource":"programatically"},{"key":"hbase.storescanner.parallel.seek.threads","value":"10","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.script.operator.id.env.var","value":"HIVE_SCRIPT_OPERATOR_ID","isFinal":false,"resource":"programatically"},{"key":"yarn.resourcemanager.ha.automatic-failover.zk-base-path","value":"/yarn-leader-election","isFinal":false,"resource":"yarn-default.xml"},{"key":"hbase.coprocessor.user.enabled","value":"true","isFinal":false,"resource":"hbase-default.xml"},{"key":"s3native.replication","value":"3","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.namenode.retrycache.expirytime.millis","value":"600000","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.spark.client.rpc.max.size","value":"52428800","isFinal":false,"resource":"programatically"},{"key":"hbase.table.max.rowsize","value":"1073741824","isFinal":false,"resource":"hbase-default.xml"},{"key":"fs.s3a.connection.maximum","value":"15","isFinal":false,"resource":"core-default.xml"},{"key":"hive.limit.optimize.enable","value":"false","isFinal":false,"resource":"programatically"},{"key":"hive.session.silent","value":"false","isFinal":false,"resource":"programatically"},{"key":"mapreduce.jobhistory.webapp.https.address","value":":19890","isFinal":false,"resource":"mapred-site.xml"},{"key":"hbase.mob.delfile.max.count","value":"3","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.app.mapreduce.client.job.max-retries","value":"0","isFinal":false,"resource":"mapred-default.xml"},{"key":"hive.metastore.expression.proxy","value":"org.apache.hadoop.hive.ql.optimizer.ppr.PartitionExpressionForMetastore","isFinal":false,"resource":"programatically"},{"key":"hive.stats.dbclass","value":"fs","isFinal":false,"resource":"programatically"},{"key":"hive.tez.log.level","value":"INFO","isFinal":false,"resource":"programatically"},{"key":"hive.server2.thrift.worker.keepalive.time","value":"60s","isFinal":false,"resource":"programatically"},{"key":"mapreduce.job.hdfs-servers","value":"hdfs://:8020","isFinal":false,"resource":"yarn-default.xml"},{"key":"mapreduce.job.speculative.speculative-cap-running-tasks","value":"0.1","isFinal":false,"resource":"mapred-default.xml"},{"key":"fs.s3a.multipart.purge.age","value":"86400","isFinal":false,"resource":"core-default.xml"},{"key":"dfs.client.use.legacy.blockreader.local","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.jobtracker.jobhistory.lru.cache.size","value":"5","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.ipc.server.fallback-to-simple-auth-allowed","value":"false","isFinal":false,"resource":"hbase-default.xml"},{"key":"dfs.datanode.sync.behind.writes","value":"false","isFinal":false,"resource":"hdfs-default.xml"},{"key":"dfs.client.failover.sleep.base.millis","value":"500","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.reduce.shuffle.fetch.retry.timeout-ms","value":"30000","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.datanode.data.dir.perm","value":"700","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.autogen.columnalias.prefix.label","value":"_c","isFinal":false,"resource":"programatically"},{"key":"hive.mapjoin.optimized.hashtable","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.lock.sleep.between.retries","value":"60s","isFinal":false,"resource":"programatically"},{"key":"mapreduce.fileoutputcommitter.algorithm.version","value":"1","isFinal":false,"resource":"mapred-default.xml"},{"key":"dfs.client.datanode-restart.timeout","value":"30","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.exec.submit.local.task.via.child","value":"true","isFinal":false,"resource":"programatically"},{"key":"hadoop.hdfs.configuration.version","value":"1","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hbase.dfs.client.read.shortcircuit.buffer.size","value":"131072","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.stats.retries.max","value":"0","isFinal":false,"resource":"programatically"},{"key":"ipc.server.listen.queue.size","value":"128","isFinal":false,"resource":"core-default.xml"},{"key":"mapreduce.shuffle.ssl.file.buffer.size","value":"65536","isFinal":false,"resource":"mapred-default.xml"},{"key":"fs.s3a.multipart.purge","value":"false","isFinal":false,"resource":"core-default.xml"},{"key":"hbase.zookeeper.property.syncLimit","value":"5","isFinal":false,"resource":"hbase-default.xml"},{"key":"hbase.cells.scanned.per.heartbeat.check","value":"10000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.prewarm.numcontainers","value":"10","isFinal":false,"resource":"programatically"},{"key":"dfs.datanode.hdfs-blocks-metadata.enabled","value":"true","isFinal":false,"resource":"hdfs-site.xml"},{"key":"hive.explain.dependency.append.tasktype","value":"false","isFinal":false,"resource":"programatically"},{"key":"hbase.thrift.maxQueuedRequests","value":"1000","isFinal":false,"resource":"hbase-default.xml"},{"key":"hive.server2.async.exec.shutdown.timeout","value":"10s","isFinal":false,"resource":"programatically"},{"key":"hive.server2.idle.operation.timeout","value":"21600000","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.namenode.fs-limits.max-directory-items","value":"1048576","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.optimize.sampling.orderby.number","value":"1000","isFinal":false,"resource":"programatically"},{"key":"rpc.engine.org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolPB","value":"org.apache.hadoop.ipc.ProtobufRpcEngine","isFinal":false,"resource":"programatically"},{"key":"hbase.thrift.maxWorkerThreads","value":"1000","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.nodemanager.log.retain-seconds","value":"10800","isFinal":false,"resource":"yarn-default.xml"},{"key":"dfs.image.transfer.chunksize","value":"65536","isFinal":false,"resource":"hdfs-default.xml"},{"key":"hive.optimize.bucketmapjoin.sortedmerge","value":"false","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"hive.map.aggr","value":"true","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.namenode.kerberos.principal","value":"hdfs/_HOST@EXAMPLE.COM","isFinal":false,"resource":"hdfs-site.xml"},{"key":"fs.du.interval","value":"600000","isFinal":false,"resource":"core-default.xml"},{"key":"hive.fetch.task.conversion.threshold","value":"1073741824","isFinal":false,"resource":"file:/var/run/cloudera-scm-agent/process/124-hive-HIVESERVER2/hive-site.xml"},{"key":"dfs.client.file-block-storage-locations.num-threads","value":"10","isFinal":false,"resource":"hdfs-default.xml"},{"key":"mapreduce.reduce.markreset.buffer.percent","value":"0.0","isFinal":false,"resource":"mapred-default.xml"},{"key":"mapreduce.shuffle.connection-keep-alive.timeout","value":"5","isFinal":false,"resource":"mapred-default.xml"},{"key":"hbase.rpc.timeout","value":"60000","isFinal":false,"resource":"hbase-default.xml"},{"key":"yarn.scheduler.fair.sizebasedweight","value":"false","isFinal":false,"resource":"yarn-site.xml"},{"key":"hadoop.security.kms.client.encrypted.key.cache.size","value":"500","isFinal":false,"resource":"core-default.xml"},{"key":"hive.server2.map.fair.scheduler.queue","value":"true","isFinal":false,"resource":"programatically"},{"key":"hive.txn.manager","value":"org.apache.hadoop.hive.ql.lockmgr.DummyTxnManager","isFinal":false,"resource":"programatically"},{"key":"hadoop.registry.zk.root","value":"/registry","isFinal":false,"resource":"yarn-default.xml"},{"key":"s3.stream-buffer-size","value":"4096","isFinal":false,"resource":"core-default.xml"},{"key":"yarn.app.mapreduce.client.job.retry-interval","value":"2000","isFinal":false,"resource":"mapred-default.xml"}]} 17/03/29 09:21:49 INFO log.PerfLogger: 17/03/29 09:21:49 INFO log.PerfLogger: 17/03/29 09:21:49 INFO Configuration.deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap 17/03/29 09:21:49 INFO exec.Utilities: Processing alias test_hos_sample2 17/03/29 09:21:49 INFO exec.Utilities: Adding input file hdfs://:8020/user/hive/warehouse/sample_data.db/test_hos_sample2 17/03/29 09:21:49 INFO log.PerfLogger: 17/03/29 09:21:49 INFO exec.Utilities: Serializing MapWork via kryo 17/03/29 09:21:49 INFO log.PerfLogger: 17/03/29 09:21:50 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 710.2 KB, free 710.2 KB) 17/03/29 09:21:50 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 53.6 KB, free 763.8 KB) 17/03/29 09:21:50 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on 172.31.115.94:50262 (size: 53.6 KB, free: 442.5 MB) 17/03/29 09:21:50 INFO spark.SparkContext: Created broadcast 0 from hadoopRDD at SparkPlanGenerator.java:190 17/03/29 09:21:50 INFO log.PerfLogger: 17/03/29 09:21:50 INFO log.PerfLogger: 17/03/29 09:21:50 INFO log.PerfLogger: 17/03/29 09:21:50 INFO exec.Utilities: Serializing ReduceWork via kryo 17/03/29 09:21:50 INFO log.PerfLogger: 17/03/29 09:21:50 INFO log.PerfLogger: 17/03/29 09:21:50 INFO log.PerfLogger: 17/03/29 09:21:50 INFO log.PerfLogger: 17/03/29 09:21:50 INFO spark.SparkPlan: !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Spark Plan !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Reduce 1 <-- ( Shuffle 4 ( Partitions 4, GroupBy, Cache off ) <-- ( MapTran 2 ) <-- ( MapInput 3 (cache off) ) !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Spark Plan !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! 17/03/29 09:21:50 INFO log.PerfLogger: 17/03/29 09:21:50 INFO log.PerfLogger: 17/03/29 09:21:50 INFO exec.Utilities: PLAN PATH = hdfs://:8020/tmp/hive/hive/12f47c70-bb11-4231-b832-205077c49b7f/hive_2017-03-29_09-21-22_164_7860513608405045206-48/-mr-10003/5e7c97bd-5641-45ab-b81f-af2e243e7184/map.xml 17/03/29 09:21:50 INFO exec.Utilities: ***************non-local mode*************** 17/03/29 09:21:50 INFO exec.Utilities: local path = hdfs://:8020/tmp/hive/hive/12f47c70-bb11-4231-b832-205077c49b7f/hive_2017-03-29_09-21-22_164_7860513608405045206-48/-mr-10003/5e7c97bd-5641-45ab-b81f-af2e243e7184/map.xml 17/03/29 09:21:50 INFO exec.Utilities: Open file to read in plan: hdfs://:8020/tmp/hive/hive/12f47c70-bb11-4231-b832-205077c49b7f/hive_2017-03-29_09-21-22_164_7860513608405045206-48/-mr-10003/5e7c97bd-5641-45ab-b81f-af2e243e7184/map.xml 17/03/29 09:21:50 INFO log.PerfLogger: 17/03/29 09:21:50 INFO exec.Utilities: Deserializing MapWork via kryo 17/03/29 09:21:50 INFO log.PerfLogger: 17/03/29 09:21:50 INFO io.CombineHiveInputFormat: Total number of paths: 1, launching 1 threads to check non-combinable ones. 17/03/29 09:21:51 INFO io.CombineHiveInputFormat: CombineHiveInputSplit creating pool for hdfs://:8020/user/hive/warehouse/sample_data.db/test_hos_sample2; using filter path hdfs://:8020/user/hive/warehouse/sample_data.db/test_hos_sample2 17/03/29 09:21:51 INFO input.FileInputFormat: Total input paths to process : 1 17/03/29 09:21:51 INFO input.CombineFileInputFormat: DEBUG: Terminated node allocation with : CompletedNodes: 3, size left: 0 17/03/29 09:21:51 INFO io.CombineHiveInputFormat: number of splits 1 17/03/29 09:21:51 INFO io.CombineHiveInputFormat: Number of all splits 1 17/03/29 09:21:51 INFO log.PerfLogger: 17/03/29 09:21:51 INFO scheduler.DAGScheduler: Registering RDD 1 (mapPartitionsToPair at MapTran.java:32) 17/03/29 09:21:51 INFO scheduler.DAGScheduler: Got job 0 (foreachAsync at RemoteHiveSparkClient.java:330) with 4 output partitions 17/03/29 09:21:51 INFO scheduler.DAGScheduler: Final stage: ResultStage 1 (foreachAsync at RemoteHiveSparkClient.java:330) 17/03/29 09:21:51 INFO scheduler.DAGScheduler: Parents of final stage: List(ShuffleMapStage 0) 17/03/29 09:21:51 INFO scheduler.DAGScheduler: Missing parents: List(ShuffleMapStage 0) 17/03/29 09:21:51 INFO scheduler.DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[1] at mapPartitionsToPair at MapTran.java:32), which has no missing parents 17/03/29 09:21:51 INFO storage.MemoryStore: Block broadcast_1 stored as values in memory (estimated size 177.3 KB, free 941.1 KB) 17/03/29 09:21:51 INFO storage.MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 57.0 KB, free 998.1 KB) 17/03/29 09:21:51 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on 172.31.115.94:50262 (size: 57.0 KB, free: 442.4 MB) 17/03/29 09:21:51 INFO spark.SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1006 17/03/29 09:21:51 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[1] at mapPartitionsToPair at MapTran.java:32) 17/03/29 09:21:51 INFO cluster.YarnClusterScheduler: Adding task set 0.0 with 1 tasks 17/03/29 09:21:51 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, , partition 0,RACK_LOCAL, 3937 bytes) 17/03/29 09:21:52 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on :32989 (size: 57.0 KB, free: 225.1 MB) 17/03/29 09:21:53 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on :32989 (size: 53.6 KB, free: 225.1 MB) 17/03/29 09:21:54 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 3252 ms on (1/1) 17/03/29 09:21:54 INFO cluster.YarnClusterScheduler: Removed TaskSet 0.0, whose tasks have all completed, from pool 17/03/29 09:21:54 INFO scheduler.DAGScheduler: ShuffleMapStage 0 (mapPartitionsToPair at MapTran.java:32) finished in 3.261 s 17/03/29 09:21:54 INFO scheduler.DAGScheduler: looking for newly runnable stages 17/03/29 09:21:54 INFO scheduler.DAGScheduler: running: Set() 17/03/29 09:21:54 INFO scheduler.DAGScheduler: waiting: Set(ResultStage 1) 17/03/29 09:21:54 INFO scheduler.DAGScheduler: failed: Set() 17/03/29 09:21:54 INFO scheduler.DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[4] at mapPartitionsToPair at ReduceTran.java:32), which has no missing parents 17/03/29 09:21:54 INFO storage.MemoryStore: Block broadcast_2 stored as values in memory (estimated size 348.4 KB, free 1346.5 KB) 17/03/29 09:21:54 INFO storage.MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 109.7 KB, free 1456.2 KB) 17/03/29 09:21:54 INFO storage.BlockManagerInfo: Added broadcast_2_piece0 in memory on 172.31.115.94:50262 (size: 109.7 KB, free: 442.3 MB) 17/03/29 09:21:54 INFO spark.SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1006 17/03/29 09:21:54 INFO scheduler.DAGScheduler: Submitting 4 missing tasks from ResultStage 1 (MapPartitionsRDD[4] at mapPartitionsToPair at ReduceTran.java:32) 17/03/29 09:21:54 INFO cluster.YarnClusterScheduler: Adding task set 1.0 with 4 tasks 17/03/29 09:21:54 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, , partition 0,NODE_LOCAL, 3494 bytes) 17/03/29 09:21:54 INFO scheduler.TaskSetManager: Starting task 1.0 in stage 1.0 (TID 2, , partition 1,NODE_LOCAL, 3494 bytes) 17/03/29 09:21:54 INFO scheduler.TaskSetManager: Starting task 2.0 in stage 1.0 (TID 3, , partition 2,NODE_LOCAL, 3494 bytes) 17/03/29 09:21:54 INFO scheduler.TaskSetManager: Starting task 3.0 in stage 1.0 (TID 4, , partition 3,NODE_LOCAL, 3494 bytes) 17/03/29 09:21:54 INFO storage.BlockManagerInfo: Added broadcast_2_piece0 in memory on :32989 (size: 109.7 KB, free: 225.0 MB) 17/03/29 09:21:54 INFO spark.MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to :53256 17/03/29 09:21:54 INFO spark.MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 162 bytes 17/03/29 09:21:55 INFO scheduler.TaskSetManager: Finished task 3.0 in stage 1.0 (TID 4) in 550 ms on (1/4) 17/03/29 09:21:55 INFO scheduler.TaskSetManager: Finished task 2.0 in stage 1.0 (TID 3) in 552 ms on (2/4) 17/03/29 09:21:55 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 559 ms on (3/4) 17/03/29 09:21:55 INFO scheduler.TaskSetManager: Finished task 1.0 in stage 1.0 (TID 2) in 561 ms on (4/4) 17/03/29 09:21:55 INFO cluster.YarnClusterScheduler: Removed TaskSet 1.0, whose tasks have all completed, from pool 17/03/29 09:21:55 INFO scheduler.DAGScheduler: ResultStage 1 (foreachAsync at RemoteHiveSparkClient.java:330) finished in 0.565 s