SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-45689292/apache-hive-3.1.3000.7.2.18.0-369-bin/lib/log4j-slf4j-impl-2.18.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-45689292/hadoop-3.1.1.7.2.18.0-369/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-45689292/apache-hive-3.1.3000.7.2.18.0-369-bin/lib/log4j-slf4j-impl-2.18.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-45689292/hadoop-3.1.1.7.2.18.0-369/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] !connect jdbc:hive2://localhost:11050/default;auth=none ubuntu [passwd stripped] Connecting to jdbc:hive2://localhost:11050/default;auth=none Connected to: Apache Hive (version 3.1.3000.7.2.18.0-369) Driver: Hive JDBC (version 3.1.3000.7.2.18.0-369) Transaction isolation: TRANSACTION_REPEATABLE_READ 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.043 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.004 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.lineitem SELECT * FROM tpch.lineitem; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20231213153252_79fde0d9-dee6-41c1-9d58-2ac6e780b38e): INSERT OVERWRITE TABLE tpch_orc_def.lineitem SELECT * FROM tpch.lineitem INFO : No Stats for tpch@lineitem, Columns: l_returnflag, l_receiptdate, l_tax, l_shipmode, l_suppkey, l_shipdate, l_commitdate, l_partkey, l_orderkey, l_quantity, l_linestatus, l_comment, l_extendedprice, l_linenumber, l_discount, l_shipinstruct INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:lineitem.l_orderkey, type:bigint, comment:null), FieldSchema(name:lineitem.l_partkey, type:bigint, comment:null), FieldSchema(name:lineitem.l_suppkey, type:bigint, comment:null), FieldSchema(name:lineitem.l_linenumber, type:int, comment:null), FieldSchema(name:lineitem.l_quantity, type:decimal(12,2), comment:null), FieldSchema(name:lineitem.l_extendedprice, type:decimal(12,2), comment:null), FieldSchema(name:lineitem.l_discount, type:decimal(12,2), comment:null), FieldSchema(name:lineitem.l_tax, type:decimal(12,2), comment:null), FieldSchema(name:lineitem.l_returnflag, type:string, comment:null), FieldSchema(name:lineitem.l_linestatus, type:string, comment:null), FieldSchema(name:lineitem.l_shipdate, type:string, comment:null), FieldSchema(name:lineitem.l_commitdate, type:string, comment:null), FieldSchema(name:lineitem.l_receiptdate, type:string, comment:null), FieldSchema(name:lineitem.l_shipinstruct, type:string, comment:null), FieldSchema(name:lineitem.l_shipmode, type:string, comment:null), FieldSchema(name:lineitem.l_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231213153252_79fde0d9-dee6-41c1-9d58-2ac6e780b38e); Time taken: 0.134 seconds INFO : Executing command(queryId=ubuntu_20231213153252_79fde0d9-dee6-41c1-9d58-2ac6e780b38e): INSERT OVERWRITE TABLE tpch_orc_def.lineitem SELECT * FROM tpch.lineitem INFO : Query ID = ubuntu_20231213153252_79fde0d9-dee6-41c1-9d58-2ac6e780b38e INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231213153252_79fde0d9-dee6-41c1-9d58-2ac6e780b38e INFO : Tez session hasn't been created yet. Opening session printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs INFO : Dag name: INSERT OVERWRITE TABLE tpch_...tpch.lineitem (Stage-1) INFO : HS2 Host: [ip-172-31-56-242], Query ID: [ubuntu_20231213153252_79fde0d9-dee6-41c1-9d58-2ac6e780b38e], Dag ID: [dag_1702481390235_0008_1], DAG Session ID: [application_1702481390235_0008] INFO : Status: Running (Executing on YARN cluster with App id application_1702481390235_0008) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITIALIZING -1 0 0 -1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 0.39 s ---------------------------------------------------------------------------------------------- going to print operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 4 0 1 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 5.40 s ---------------------------------------------------------------------------------------------- printed operations logs going to print operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 4 0 2 2 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 10.40 s ---------------------------------------------------------------------------------------------- printed operations logs going to print operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 4 0 2 2 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 15.40 s ---------------------------------------------------------------------------------------------- printed operations logs going to print operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 4 0 2 2 0 0 printed operations logs ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 20.40 s ---------------------------------------------------------------------------------------------- going to print operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 4 0 3 1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 25.40 s ---------------------------------------------------------------------------------------------- printed operations logs going to print operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 4 0 4 0 0 0 printed operations logs ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 30.40 s ---------------------------------------------------------------------------------------------- going to print operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ..... container RUNNING 4 2 2 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=============>>-------------] 50% ELAPSED TIME: 35.41 s ---------------------------------------------------------------------------------------------- printed operations logs going to print operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 4 4 0 0 0 0 INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. ---------------------------------------------------------------------------------------------- INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://localhost:20500/test-warehouse/tpch.lineitem_orc_def/.hive-staging_hive_2023-12-13_15-32-52_907_7659977370545522090-14/-ext-10000 from hdfs://localhost:20500/test-warehouse/tpch.lineitem_orc_def/.hive-staging_hive_2023-12-13_15-32-52_907_7659977370545522090-14/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.lineitem from hdfs://localhost:20500/test-warehouse/tpch.lineitem_orc_def/.hive-staging_hive_2023-12-13_15-32-52_907_7659977370545522090-14/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231213153252_79fde0d9-dee6-41c1-9d58-2ac6e780b38e); Time taken: 143.608 seconds INFO : OK printed operations logs VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 39.01 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 4 4 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 39.01 s ---------------------------------------------------------------------------------------------- 6,001,215 rows affected (144.504 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.part SELECT * FROM tpch.part; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20231213153516_a00e0165-3bd4-4aae-85cb-3a56d482034e): INSERT OVERWRITE TABLE tpch_orc_def.part SELECT * FROM tpch.part INFO : No Stats for tpch@part, Columns: p_partkey, p_container, p_name, p_comment, p_brand, p_type, p_retailprice, p_mfgr, p_size INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:part.p_partkey, type:bigint, comment:null), FieldSchema(name:part.p_name, type:string, comment:null), FieldSchema(name:part.p_mfgr, type:string, comment:null), FieldSchema(name:part.p_brand, type:string, comment:null), FieldSchema(name:part.p_type, type:string, comment:null), FieldSchema(name:part.p_size, type:int, comment:null), FieldSchema(name:part.p_container, type:string, comment:null), FieldSchema(name:part.p_retailprice, type:decimal(12,2), comment:null), FieldSchema(name:part.p_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231213153516_a00e0165-3bd4-4aae-85cb-3a56d482034e); Time taken: 0.182 seconds INFO : Executing command(queryId=ubuntu_20231213153516_a00e0165-3bd4-4aae-85cb-3a56d482034e): INSERT OVERWRITE TABLE tpch_orc_def.part SELECT * FROM tpch.part INFO : Query ID = ubuntu_20231213153516_a00e0165-3bd4-4aae-85cb-3a56d482034e INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231213153516_a00e0165-3bd4-4aae-85cb-3a56d482034e INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_orc_...tpch.part (Stage-1) INFO : HS2 Host: [ip-172-31-56-242], Query ID: [ubuntu_20231213153516_a00e0165-3bd4-4aae-85cb-3a56d482034e], Dag ID: [dag_1702481390235_0008_2], DAG Session ID: [application_1702481390235_0008] INFO : Status: Running (Executing on YARN cluster with App id application_1702481390235_0008) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.42 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://localhost:20500/test-warehouse/tpch.part_orc_def/.hive-staging_hive_2023-12-13_15-35-16_909_7989544935774830122-14/-ext-10000 from hdfs://localhost:20500/test-warehouse/tpch.part_orc_def/.hive-staging_hive_2023-12-13_15-35-16_909_7989544935774830122-14/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.part from hdfs://localhost:20500/test-warehouse/tpch.part_orc_def/.hive-staging_hive_2023-12-13_15-35-16_909_7989544935774830122-14/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231213153516_a00e0165-3bd4-4aae-85cb-3a56d482034e); Time taken: 1.464 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.43 s ---------------------------------------------------------------------------------------------- 200,000 rows affected (1.684 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.partsupp SELECT * FROM tpch.partsupp; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20231213153518_92490b05-27e5-4b3e-9910-8520e47604b7): INSERT OVERWRITE TABLE tpch_orc_def.partsupp SELECT * FROM tpch.partsupp INFO : No Stats for tpch@partsupp, Columns: ps_suppkey, ps_availqty, ps_comment, ps_partkey, ps_supplycost INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:partsupp.ps_partkey, type:bigint, comment:null), FieldSchema(name:partsupp.ps_suppkey, type:bigint, comment:null), FieldSchema(name:partsupp.ps_availqty, type:int, comment:null), FieldSchema(name:partsupp.ps_supplycost, type:decimal(12,2), comment:null), FieldSchema(name:partsupp.ps_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231213153518_92490b05-27e5-4b3e-9910-8520e47604b7); Time taken: 0.18 seconds INFO : Executing command(queryId=ubuntu_20231213153518_92490b05-27e5-4b3e-9910-8520e47604b7): INSERT OVERWRITE TABLE tpch_orc_def.partsupp SELECT * FROM tpch.partsupp INFO : Query ID = ubuntu_20231213153518_92490b05-27e5-4b3e-9910-8520e47604b7 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231213153518_92490b05-27e5-4b3e-9910-8520e47604b7 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_...tpch.partsupp (Stage-1) INFO : HS2 Host: [ip-172-31-56-242], Query ID: [ubuntu_20231213153518_92490b05-27e5-4b3e-9910-8520e47604b7], Dag ID: [dag_1702481390235_0008_3], DAG Session ID: [application_1702481390235_0008] INFO : Status: Running (Executing on YARN cluster with App id application_1702481390235_0008) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 2 0 2 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 1.41 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ..... container RUNNING 2 1 1 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=============>>-------------] 50% ELAPSED TIME: 1.91 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge container INITIALIZING -1 0 0 -1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 0.03 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.53 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.76 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is filtered out by condition resolver. INFO : Stage-3 is selected by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Launching Job 3 out of 3 INFO : Starting task [Stage-3:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231213153518_92490b05-27e5-4b3e-9910-8520e47604b7 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_...tpch.partsupp (Stage-3) INFO : HS2 Host: [ip-172-31-56-242], Query ID: [ubuntu_20231213153518_92490b05-27e5-4b3e-9910-8520e47604b7], Dag ID: [dag_1702481390235_0008_4], DAG Session ID: [application_1702481390235_0008] INFO : Status: Running (Executing on YARN cluster with App id application_1702481390235_0008) INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.partsupp from hdfs://localhost:20500/test-warehouse/tpch.partsupp_orc_def/.hive-staging_hive_2023-12-13_15-35-18_700_4808187032099602227-14/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231213153518_92490b05-27e5-4b3e-9910-8520e47604b7); Time taken: 3.187 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.76 s ---------------------------------------------------------------------------------------------- No rows affected (3.421 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.supplier SELECT * FROM tpch.supplier; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20231213153522_2fbeeb0e-df47-41a6-871b-2764b73915d2): INSERT OVERWRITE TABLE tpch_orc_def.supplier SELECT * FROM tpch.supplier INFO : No Stats for tpch@supplier, Columns: s_comment, s_phone, s_nationkey, s_name, s_address, s_acctbal, s_suppkey INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:supplier.s_suppkey, type:bigint, comment:null), FieldSchema(name:supplier.s_name, type:string, comment:null), FieldSchema(name:supplier.s_address, type:string, comment:null), FieldSchema(name:supplier.s_nationkey, type:smallint, comment:null), FieldSchema(name:supplier.s_phone, type:string, comment:null), FieldSchema(name:supplier.s_acctbal, type:decimal(12,2), comment:null), FieldSchema(name:supplier.s_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231213153522_2fbeeb0e-df47-41a6-871b-2764b73915d2); Time taken: 0.094 seconds INFO : Executing command(queryId=ubuntu_20231213153522_2fbeeb0e-df47-41a6-871b-2764b73915d2): INSERT OVERWRITE TABLE tpch_orc_def.supplier SELECT * FROM tpch.supplier INFO : Query ID = ubuntu_20231213153522_2fbeeb0e-df47-41a6-871b-2764b73915d2 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231213153522_2fbeeb0e-df47-41a6-871b-2764b73915d2 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_...tpch.supplier (Stage-1) INFO : HS2 Host: [ip-172-31-56-242], Query ID: [ubuntu_20231213153522_2fbeeb0e-df47-41a6-871b-2764b73915d2], Dag ID: [dag_1702481390235_0008_5], DAG Session ID: [application_1702481390235_0008] INFO : Status: Running (Executing on YARN cluster with App id application_1702481390235_0008) INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://localhost:20500/test-warehouse/tpch.supplier_orc_def/.hive-staging_hive_2023-12-13_15-35-22_249_2512643628977397819-14/-ext-10000 from hdfs://localhost:20500/test-warehouse/tpch.supplier_orc_def/.hive-staging_hive_2023-12-13_15-35-22_249_2512643628977397819-14/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.supplier from hdfs://localhost:20500/test-warehouse/tpch.supplier_orc_def/.hive-staging_hive_2023-12-13_15-35-22_249_2512643628977397819-14/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231213153522_2fbeeb0e-df47-41a6-871b-2764b73915d2); Time taken: 0.789 seconds INFO : OK 10,000 rows affected (0.905 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.nation SELECT * FROM tpch.nation; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20231213153523_8bd92f57-3e92-4ae3-b93a-d22954e51675): INSERT OVERWRITE TABLE tpch_orc_def.nation SELECT * FROM tpch.nation INFO : No Stats for tpch@nation, Columns: n_comment, n_nationkey, n_regionkey, n_name INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:nation.n_nationkey, type:smallint, comment:null), FieldSchema(name:nation.n_name, type:string, comment:null), FieldSchema(name:nation.n_regionkey, type:smallint, comment:null), FieldSchema(name:nation.n_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231213153523_8bd92f57-3e92-4ae3-b93a-d22954e51675); Time taken: 0.072 seconds INFO : Executing command(queryId=ubuntu_20231213153523_8bd92f57-3e92-4ae3-b93a-d22954e51675): INSERT OVERWRITE TABLE tpch_orc_def.nation SELECT * FROM tpch.nation INFO : Query ID = ubuntu_20231213153523_8bd92f57-3e92-4ae3-b93a-d22954e51675 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231213153523_8bd92f57-3e92-4ae3-b93a-d22954e51675 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_or...tpch.nation (Stage-1) INFO : HS2 Host: [ip-172-31-56-242], Query ID: [ubuntu_20231213153523_8bd92f57-3e92-4ae3-b93a-d22954e51675], Dag ID: [dag_1702481390235_0008_6], DAG Session ID: [application_1702481390235_0008] INFO : Status: Running (Executing on YARN cluster with App id application_1702481390235_0008) INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://localhost:20500/test-warehouse/tpch.nation_orc_def/.hive-staging_hive_2023-12-13_15-35-23_280_812683277039157406-14/-ext-10000 from hdfs://localhost:20500/test-warehouse/tpch.nation_orc_def/.hive-staging_hive_2023-12-13_15-35-23_280_812683277039157406-14/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.nation from hdfs://localhost:20500/test-warehouse/tpch.nation_orc_def/.hive-staging_hive_2023-12-13_15-35-23_280_812683277039157406-14/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231213153523_8bd92f57-3e92-4ae3-b93a-d22954e51675); Time taken: 0.548 seconds INFO : OK 25 rows affected (0.672 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.region SELECT * FROM tpch.region; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20231213153524_7027692a-991c-4383-9799-d99017d51b65): INSERT OVERWRITE TABLE tpch_orc_def.region SELECT * FROM tpch.region INFO : No Stats for tpch@region, Columns: r_regionkey, r_comment, r_name INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:region.r_regionkey, type:smallint, comment:null), FieldSchema(name:region.r_name, type:string, comment:null), FieldSchema(name:region.r_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231213153524_7027692a-991c-4383-9799-d99017d51b65); Time taken: 0.176 seconds INFO : Executing command(queryId=ubuntu_20231213153524_7027692a-991c-4383-9799-d99017d51b65): INSERT OVERWRITE TABLE tpch_orc_def.region SELECT * FROM tpch.region INFO : Query ID = ubuntu_20231213153524_7027692a-991c-4383-9799-d99017d51b65 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231213153524_7027692a-991c-4383-9799-d99017d51b65 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_or...tpch.region (Stage-1) INFO : HS2 Host: [ip-172-31-56-242], Query ID: [ubuntu_20231213153524_7027692a-991c-4383-9799-d99017d51b65], Dag ID: [dag_1702481390235_0008_7], DAG Session ID: [application_1702481390235_0008] INFO : Status: Running (Executing on YARN cluster with App id application_1702481390235_0008) INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://localhost:20500/test-warehouse/tpch.region_orc_def/.hive-staging_hive_2023-12-13_15-35-24_098_4901036361593673809-14/-ext-10000 from hdfs://localhost:20500/test-warehouse/tpch.region_orc_def/.hive-staging_hive_2023-12-13_15-35-24_098_4901036361593673809-14/-ext-10002 printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.33 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.region from hdfs://localhost:20500/test-warehouse/tpch.region_orc_def/.hive-staging_hive_2023-12-13_15-35-24_098_4901036361593673809-14/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231213153524_7027692a-991c-4383-9799-d99017d51b65); Time taken: 1.361 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.33 s ---------------------------------------------------------------------------------------------- 5 rows affected (1.572 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.orders SELECT * FROM tpch.orders; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20231213153525_9fab7e4b-9561-448f-83d1-952bfdbe1de9): INSERT OVERWRITE TABLE tpch_orc_def.orders SELECT * FROM tpch.orders INFO : No Stats for tpch@orders, Columns: o_orderstatus, o_clerk, o_orderdate, o_shippriority, o_custkey, o_totalprice, o_orderkey, o_comment, o_orderpriority INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:orders.o_orderkey, type:bigint, comment:null), FieldSchema(name:orders.o_custkey, type:bigint, comment:null), FieldSchema(name:orders.o_orderstatus, type:string, comment:null), FieldSchema(name:orders.o_totalprice, type:decimal(12,2), comment:null), FieldSchema(name:orders.o_orderdate, type:string, comment:null), FieldSchema(name:orders.o_orderpriority, type:string, comment:null), FieldSchema(name:orders.o_clerk, type:string, comment:null), FieldSchema(name:orders.o_shippriority, type:int, comment:null), FieldSchema(name:orders.o_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231213153525_9fab7e4b-9561-448f-83d1-952bfdbe1de9); Time taken: 0.094 seconds INFO : Executing command(queryId=ubuntu_20231213153525_9fab7e4b-9561-448f-83d1-952bfdbe1de9): INSERT OVERWRITE TABLE tpch_orc_def.orders SELECT * FROM tpch.orders INFO : Query ID = ubuntu_20231213153525_9fab7e4b-9561-448f-83d1-952bfdbe1de9 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231213153525_9fab7e4b-9561-448f-83d1-952bfdbe1de9 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_or...tpch.orders (Stage-1) INFO : HS2 Host: [ip-172-31-56-242], Query ID: [ubuntu_20231213153525_9fab7e4b-9561-448f-83d1-952bfdbe1de9], Dag ID: [dag_1702481390235_0008_8], DAG Session ID: [application_1702481390235_0008] INFO : Status: Running (Executing on YARN cluster with App id application_1702481390235_0008) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 3 0 2 1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 1.46 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 3 0 2 1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 1.96 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 3 0 2 1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 2.46 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 3 0 2 1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 2.96 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 3 0 2 1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 3.47 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ...... container RUNNING 3 2 1 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=================>>---------] 66% ELAPSED TIME: 3.97 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ...... container RUNNING 3 2 1 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=================>>---------] 66% ELAPSED TIME: 4.47 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ...... container RUNNING 3 2 1 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=================>>---------] 66% ELAPSED TIME: 4.97 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ...... container RUNNING 3 2 1 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=================>>---------] 66% ELAPSED TIME: 5.47 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ...... container RUNNING 3 2 1 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=================>>---------] 66% ELAPSED TIME: 5.97 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge container INITIALIZING -1 0 0 -1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 0.11 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.61 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.68 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is filtered out by condition resolver. INFO : Stage-3 is selected by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Launching Job 3 out of 3 INFO : Starting task [Stage-3:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231213153525_9fab7e4b-9561-448f-83d1-952bfdbe1de9 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_or...tpch.orders (Stage-3) INFO : HS2 Host: [ip-172-31-56-242], Query ID: [ubuntu_20231213153525_9fab7e4b-9561-448f-83d1-952bfdbe1de9], Dag ID: [dag_1702481390235_0008_9], DAG Session ID: [application_1702481390235_0008] INFO : Status: Running (Executing on YARN cluster with App id application_1702481390235_0008) INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.orders from hdfs://localhost:20500/test-warehouse/tpch.orders_orc_def/.hive-staging_hive_2023-12-13_15-35-25_802_8344911742619599319-14/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231213153525_9fab7e4b-9561-448f-83d1-952bfdbe1de9); Time taken: 7.053 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.68 s ---------------------------------------------------------------------------------------------- No rows affected (7.207 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.customer SELECT * FROM tpch.customer; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20231213153533_4e6cecee-ac95-4626-a00e-7897659c9b59): INSERT OVERWRITE TABLE tpch_orc_def.customer SELECT * FROM tpch.customer INFO : No Stats for tpch@customer, Columns: c_custkey, c_phone, c_acctbal, c_mktsegment, c_address, c_nationkey, c_name, c_comment INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:customer.c_custkey, type:bigint, comment:null), FieldSchema(name:customer.c_name, type:string, comment:null), FieldSchema(name:customer.c_address, type:string, comment:null), FieldSchema(name:customer.c_nationkey, type:smallint, comment:null), FieldSchema(name:customer.c_phone, type:string, comment:null), FieldSchema(name:customer.c_acctbal, type:decimal(12,2), comment:null), FieldSchema(name:customer.c_mktsegment, type:string, comment:null), FieldSchema(name:customer.c_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231213153533_4e6cecee-ac95-4626-a00e-7897659c9b59); Time taken: 0.18 seconds INFO : Executing command(queryId=ubuntu_20231213153533_4e6cecee-ac95-4626-a00e-7897659c9b59): INSERT OVERWRITE TABLE tpch_orc_def.customer SELECT * FROM tpch.customer INFO : Query ID = ubuntu_20231213153533_4e6cecee-ac95-4626-a00e-7897659c9b59 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231213153533_4e6cecee-ac95-4626-a00e-7897659c9b59 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_...tpch.customer (Stage-1) INFO : HS2 Host: [ip-172-31-56-242], Query ID: [ubuntu_20231213153533_4e6cecee-ac95-4626-a00e-7897659c9b59], Dag ID: [dag_1702481390235_0008_10], DAG Session ID: [application_1702481390235_0008] INFO : Status: Running (Executing on YARN cluster with App id application_1702481390235_0008) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.36 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://localhost:20500/test-warehouse/tpch.customer_orc_def/.hive-staging_hive_2023-12-13_15-35-33_109_8524747329329558083-14/-ext-10000 from hdfs://localhost:20500/test-warehouse/tpch.customer_orc_def/.hive-staging_hive_2023-12-13_15-35-33_109_8524747329329558083-14/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.customer from hdfs://localhost:20500/test-warehouse/tpch.customer_orc_def/.hive-staging_hive_2023-12-13_15-35-33_109_8524747329329558083-14/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231213153533_4e6cecee-ac95-4626-a00e-7897659c9b59); Time taken: 1.441 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.36 s ---------------------------------------------------------------------------------------------- 150,000 rows affected (1.656 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> Closing: 0: jdbc:hive2://localhost:11050/default;auth=none