SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-45689292/apache-hive-3.1.3000.7.2.18.0-369-bin/lib/log4j-slf4j-impl-2.18.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-45689292/hadoop-3.1.1.7.2.18.0-369/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-45689292/apache-hive-3.1.3000.7.2.18.0-369-bin/lib/log4j-slf4j-impl-2.18.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-45689292/hadoop-3.1.1.7.2.18.0-369/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] !connect jdbc:hive2://localhost:11050/default;auth=none ubuntu [passwd stripped] Connecting to jdbc:hive2://localhost:11050/default;auth=none Connected to: Apache Hive (version 3.1.3000.7.2.18.0-369) Driver: Hive JDBC (version 3.1.3000.7.2.18.0-369) Transaction isolation: TRANSACTION_REPEATABLE_READ 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.034 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.lineitem SELECT * FROM tpch.lineitem; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20231214100657_51dae94b-d78d-4c27-bcd0-46d693e25e75): INSERT OVERWRITE TABLE tpch_orc_def.lineitem SELECT * FROM tpch.lineitem INFO : No Stats for tpch@lineitem, Columns: l_returnflag, l_receiptdate, l_tax, l_shipmode, l_suppkey, l_shipdate, l_commitdate, l_partkey, l_orderkey, l_quantity, l_linestatus, l_comment, l_extendedprice, l_linenumber, l_discount, l_shipinstruct INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:lineitem.l_orderkey, type:bigint, comment:null), FieldSchema(name:lineitem.l_partkey, type:bigint, comment:null), FieldSchema(name:lineitem.l_suppkey, type:bigint, comment:null), FieldSchema(name:lineitem.l_linenumber, type:int, comment:null), FieldSchema(name:lineitem.l_quantity, type:decimal(12,2), comment:null), FieldSchema(name:lineitem.l_extendedprice, type:decimal(12,2), comment:null), FieldSchema(name:lineitem.l_discount, type:decimal(12,2), comment:null), FieldSchema(name:lineitem.l_tax, type:decimal(12,2), comment:null), FieldSchema(name:lineitem.l_returnflag, type:string, comment:null), FieldSchema(name:lineitem.l_linestatus, type:string, comment:null), FieldSchema(name:lineitem.l_shipdate, type:string, comment:null), FieldSchema(name:lineitem.l_commitdate, type:string, comment:null), FieldSchema(name:lineitem.l_receiptdate, type:string, comment:null), FieldSchema(name:lineitem.l_shipinstruct, type:string, comment:null), FieldSchema(name:lineitem.l_shipmode, type:string, comment:null), FieldSchema(name:lineitem.l_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231214100657_51dae94b-d78d-4c27-bcd0-46d693e25e75); Time taken: 0.142 seconds INFO : Executing command(queryId=ubuntu_20231214100657_51dae94b-d78d-4c27-bcd0-46d693e25e75): INSERT OVERWRITE TABLE tpch_orc_def.lineitem SELECT * FROM tpch.lineitem INFO : Query ID = ubuntu_20231214100657_51dae94b-d78d-4c27-bcd0-46d693e25e75 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231214100657_51dae94b-d78d-4c27-bcd0-46d693e25e75 INFO : Tez session hasn't been created yet. Opening session INFO : Dag name: INSERT OVERWRITE TABLE tpch_...tpch.lineitem (Stage-1) INFO : HS2 Host: [ip-172-31-52-214], Query ID: [ubuntu_20231214100657_51dae94b-d78d-4c27-bcd0-46d693e25e75], Dag ID: [dag_1702548244325_0002_1], DAG Session ID: [application_1702548244325_0002] INFO : Status: Running (Executing on YARN cluster with App id application_1702548244325_0002) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 12 0 0 12 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 1.40 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 12 0 0 12 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 1.90 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 12 0 0 12 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 2.40 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 12 0 0 12 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 2.91 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 12 0 0 12 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 3.41 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 12 0 1 11 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 3.91 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 12 0 1 11 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 4.41 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 12 0 2 10 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 4.92 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 12 0 2 10 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 5.42 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 12 0 3 9 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 5.92 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 12 0 3 9 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 6.43 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 12 0 4 8 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 7.43 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 12 0 5 7 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 8.43 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 12 0 6 6 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 9.43 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 12 1 7 4 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [==>>------------------------] 8% ELAPSED TIME: 10.44 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 . container RUNNING 12 2 8 2 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [====>>----------------------] 16% ELAPSED TIME: 11.44 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 . container RUNNING 12 2 8 2 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [====>>----------------------] 16% ELAPSED TIME: 12.45 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .. container RUNNING 12 3 8 1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [======>>--------------------] 25% ELAPSED TIME: 13.45 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ... container RUNNING 12 4 8 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [========>>------------------] 33% ELAPSED TIME: 14.46 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ..... container RUNNING 12 6 6 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=============>>-------------] 50% ELAPSED TIME: 15.46 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ...... container RUNNING 12 8 4 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=================>>---------] 66% ELAPSED TIME: 16.47 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ........ container RUNNING 12 10 2 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=====================>>-----] 83% ELAPSED TIME: 17.97 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.84 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is filtered out by condition resolver. INFO : Stage-3 is selected by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Launching Job 3 out of 3 INFO : Starting task [Stage-3:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231214100657_51dae94b-d78d-4c27-bcd0-46d693e25e75 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_...tpch.lineitem (Stage-3) INFO : HS2 Host: [ip-172-31-52-214], Query ID: [ubuntu_20231214100657_51dae94b-d78d-4c27-bcd0-46d693e25e75], Dag ID: [dag_1702548244325_0002_2], DAG Session ID: [application_1702548244325_0002] INFO : Status: Running (Executing on YARN cluster with App id application_1702548244325_0002) INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.lineitem from hdfs://localhost:20500/test-warehouse/tpch.lineitem_orc_def/.hive-staging_hive_2023-12-14_10-06-57_713_1719144211451228331-3/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231214100657_51dae94b-d78d-4c27-bcd0-46d693e25e75); Time taken: 23.043 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.85 s ---------------------------------------------------------------------------------------------- No rows affected (23.202 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.part SELECT * FROM tpch.part; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20231214100721_2805a869-5e53-4fc1-a52f-fb90331d40df): INSERT OVERWRITE TABLE tpch_orc_def.part SELECT * FROM tpch.part INFO : No Stats for tpch@part, Columns: p_partkey, p_container, p_name, p_comment, p_brand, p_type, p_retailprice, p_mfgr, p_size INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:part.p_partkey, type:bigint, comment:null), FieldSchema(name:part.p_name, type:string, comment:null), FieldSchema(name:part.p_mfgr, type:string, comment:null), FieldSchema(name:part.p_brand, type:string, comment:null), FieldSchema(name:part.p_type, type:string, comment:null), FieldSchema(name:part.p_size, type:int, comment:null), FieldSchema(name:part.p_container, type:string, comment:null), FieldSchema(name:part.p_retailprice, type:decimal(12,2), comment:null), FieldSchema(name:part.p_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231214100721_2805a869-5e53-4fc1-a52f-fb90331d40df); Time taken: 0.069 seconds INFO : Executing command(queryId=ubuntu_20231214100721_2805a869-5e53-4fc1-a52f-fb90331d40df): INSERT OVERWRITE TABLE tpch_orc_def.part SELECT * FROM tpch.part INFO : Query ID = ubuntu_20231214100721_2805a869-5e53-4fc1-a52f-fb90331d40df INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231214100721_2805a869-5e53-4fc1-a52f-fb90331d40df INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_orc_...tpch.part (Stage-1) INFO : HS2 Host: [ip-172-31-52-214], Query ID: [ubuntu_20231214100721_2805a869-5e53-4fc1-a52f-fb90331d40df], Dag ID: [dag_1702548244325_0002_3], DAG Session ID: [application_1702548244325_0002] INFO : Status: Running (Executing on YARN cluster with App id application_1702548244325_0002) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.17 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://localhost:20500/test-warehouse/tpch.part_orc_def/.hive-staging_hive_2023-12-14_10-07-21_003_5926200135200039348-3/-ext-10000 from hdfs://localhost:20500/test-warehouse/tpch.part_orc_def/.hive-staging_hive_2023-12-14_10-07-21_003_5926200135200039348-3/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.part from hdfs://localhost:20500/test-warehouse/tpch.part_orc_def/.hive-staging_hive_2023-12-14_10-07-21_003_5926200135200039348-3/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231214100721_2805a869-5e53-4fc1-a52f-fb90331d40df); Time taken: 1.21 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.17 s ---------------------------------------------------------------------------------------------- 200,000 rows affected (1.29 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.partsupp SELECT * FROM tpch.partsupp; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20231214100722_4c8f3644-465b-44b1-a327-64769986b529): INSERT OVERWRITE TABLE tpch_orc_def.partsupp SELECT * FROM tpch.partsupp INFO : No Stats for tpch@partsupp, Columns: ps_suppkey, ps_availqty, ps_comment, ps_partkey, ps_supplycost INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:partsupp.ps_partkey, type:bigint, comment:null), FieldSchema(name:partsupp.ps_suppkey, type:bigint, comment:null), FieldSchema(name:partsupp.ps_availqty, type:int, comment:null), FieldSchema(name:partsupp.ps_supplycost, type:decimal(12,2), comment:null), FieldSchema(name:partsupp.ps_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231214100722_4c8f3644-465b-44b1-a327-64769986b529); Time taken: 0.048 seconds INFO : Executing command(queryId=ubuntu_20231214100722_4c8f3644-465b-44b1-a327-64769986b529): INSERT OVERWRITE TABLE tpch_orc_def.partsupp SELECT * FROM tpch.partsupp INFO : Query ID = ubuntu_20231214100722_4c8f3644-465b-44b1-a327-64769986b529 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231214100722_4c8f3644-465b-44b1-a327-64769986b529 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_...tpch.partsupp (Stage-1) INFO : HS2 Host: [ip-172-31-52-214], Query ID: [ubuntu_20231214100722_4c8f3644-465b-44b1-a327-64769986b529], Dag ID: [dag_1702548244325_0002_4], DAG Session ID: [application_1702548244325_0002] INFO : Status: Running (Executing on YARN cluster with App id application_1702548244325_0002) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 2 0 2 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 1.47 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.34 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.57 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is filtered out by condition resolver. INFO : Stage-3 is selected by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Launching Job 3 out of 3 INFO : Starting task [Stage-3:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231214100722_4c8f3644-465b-44b1-a327-64769986b529 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_...tpch.partsupp (Stage-3) INFO : HS2 Host: [ip-172-31-52-214], Query ID: [ubuntu_20231214100722_4c8f3644-465b-44b1-a327-64769986b529], Dag ID: [dag_1702548244325_0002_5], DAG Session ID: [application_1702548244325_0002] INFO : Status: Running (Executing on YARN cluster with App id application_1702548244325_0002) INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.partsupp from hdfs://localhost:20500/test-warehouse/tpch.partsupp_orc_def/.hive-staging_hive_2023-12-14_10-07-22_383_2399993521721841246-3/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231214100722_4c8f3644-465b-44b1-a327-64769986b529); Time taken: 2.207 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.57 s ---------------------------------------------------------------------------------------------- No rows affected (2.298 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.supplier SELECT * FROM tpch.supplier; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20231214100724_4368af8c-b20f-481a-a4e3-ff24c568ad42): INSERT OVERWRITE TABLE tpch_orc_def.supplier SELECT * FROM tpch.supplier INFO : No Stats for tpch@supplier, Columns: s_comment, s_phone, s_nationkey, s_name, s_address, s_acctbal, s_suppkey INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:supplier.s_suppkey, type:bigint, comment:null), FieldSchema(name:supplier.s_name, type:string, comment:null), FieldSchema(name:supplier.s_address, type:string, comment:null), FieldSchema(name:supplier.s_nationkey, type:smallint, comment:null), FieldSchema(name:supplier.s_phone, type:string, comment:null), FieldSchema(name:supplier.s_acctbal, type:decimal(12,2), comment:null), FieldSchema(name:supplier.s_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231214100724_4368af8c-b20f-481a-a4e3-ff24c568ad42); Time taken: 0.096 seconds INFO : Executing command(queryId=ubuntu_20231214100724_4368af8c-b20f-481a-a4e3-ff24c568ad42): INSERT OVERWRITE TABLE tpch_orc_def.supplier SELECT * FROM tpch.supplier INFO : Query ID = ubuntu_20231214100724_4368af8c-b20f-481a-a4e3-ff24c568ad42 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231214100724_4368af8c-b20f-481a-a4e3-ff24c568ad42 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_...tpch.supplier (Stage-1) INFO : HS2 Host: [ip-172-31-52-214], Query ID: [ubuntu_20231214100724_4368af8c-b20f-481a-a4e3-ff24c568ad42], Dag ID: [dag_1702548244325_0002_6], DAG Session ID: [application_1702548244325_0002] INFO : Status: Running (Executing on YARN cluster with App id application_1702548244325_0002) INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://localhost:20500/test-warehouse/tpch.supplier_orc_def/.hive-staging_hive_2023-12-14_10-07-24_792_7338113933004458776-3/-ext-10000 from hdfs://localhost:20500/test-warehouse/tpch.supplier_orc_def/.hive-staging_hive_2023-12-14_10-07-24_792_7338113933004458776-3/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.supplier from hdfs://localhost:20500/test-warehouse/tpch.supplier_orc_def/.hive-staging_hive_2023-12-14_10-07-24_792_7338113933004458776-3/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231214100724_4368af8c-b20f-481a-a4e3-ff24c568ad42); Time taken: 0.716 seconds INFO : OK 10,000 rows affected (0.842 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.003 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.nation SELECT * FROM tpch.nation; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20231214100725_9c0a46cd-a534-4369-b2d5-e72442c72c2d): INSERT OVERWRITE TABLE tpch_orc_def.nation SELECT * FROM tpch.nation INFO : No Stats for tpch@nation, Columns: n_comment, n_nationkey, n_regionkey, n_name INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:nation.n_nationkey, type:smallint, comment:null), FieldSchema(name:nation.n_name, type:string, comment:null), FieldSchema(name:nation.n_regionkey, type:smallint, comment:null), FieldSchema(name:nation.n_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231214100725_9c0a46cd-a534-4369-b2d5-e72442c72c2d); Time taken: 0.132 seconds INFO : Executing command(queryId=ubuntu_20231214100725_9c0a46cd-a534-4369-b2d5-e72442c72c2d): INSERT OVERWRITE TABLE tpch_orc_def.nation SELECT * FROM tpch.nation INFO : Query ID = ubuntu_20231214100725_9c0a46cd-a534-4369-b2d5-e72442c72c2d INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231214100725_9c0a46cd-a534-4369-b2d5-e72442c72c2d INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_or...tpch.nation (Stage-1) INFO : HS2 Host: [ip-172-31-52-214], Query ID: [ubuntu_20231214100725_9c0a46cd-a534-4369-b2d5-e72442c72c2d], Dag ID: [dag_1702548244325_0002_7], DAG Session ID: [application_1702548244325_0002] INFO : Status: Running (Executing on YARN cluster with App id application_1702548244325_0002) INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://localhost:20500/test-warehouse/tpch.nation_orc_def/.hive-staging_hive_2023-12-14_10-07-25_736_2886047015893119048-3/-ext-10000 from hdfs://localhost:20500/test-warehouse/tpch.nation_orc_def/.hive-staging_hive_2023-12-14_10-07-25_736_2886047015893119048-3/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.nation from hdfs://localhost:20500/test-warehouse/tpch.nation_orc_def/.hive-staging_hive_2023-12-14_10-07-25_736_2886047015893119048-3/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231214100725_9c0a46cd-a534-4369-b2d5-e72442c72c2d); Time taken: 0.417 seconds INFO : OK 25 rows affected (0.567 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.region SELECT * FROM tpch.region; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20231214100726_c0c669ae-1ff3-4e21-8aaf-31840d580592): INSERT OVERWRITE TABLE tpch_orc_def.region SELECT * FROM tpch.region INFO : No Stats for tpch@region, Columns: r_regionkey, r_comment, r_name INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:region.r_regionkey, type:smallint, comment:null), FieldSchema(name:region.r_name, type:string, comment:null), FieldSchema(name:region.r_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231214100726_c0c669ae-1ff3-4e21-8aaf-31840d580592); Time taken: 0.052 seconds INFO : Executing command(queryId=ubuntu_20231214100726_c0c669ae-1ff3-4e21-8aaf-31840d580592): INSERT OVERWRITE TABLE tpch_orc_def.region SELECT * FROM tpch.region INFO : Query ID = ubuntu_20231214100726_c0c669ae-1ff3-4e21-8aaf-31840d580592 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231214100726_c0c669ae-1ff3-4e21-8aaf-31840d580592 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_or...tpch.region (Stage-1) INFO : HS2 Host: [ip-172-31-52-214], Query ID: [ubuntu_20231214100726_c0c669ae-1ff3-4e21-8aaf-31840d580592], Dag ID: [dag_1702548244325_0002_8], DAG Session ID: [application_1702548244325_0002] INFO : Status: Running (Executing on YARN cluster with App id application_1702548244325_0002) INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://localhost:20500/test-warehouse/tpch.region_orc_def/.hive-staging_hive_2023-12-14_10-07-26_390_2135324644258043563-3/-ext-10000 from hdfs://localhost:20500/test-warehouse/tpch.region_orc_def/.hive-staging_hive_2023-12-14_10-07-26_390_2135324644258043563-3/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.region from hdfs://localhost:20500/test-warehouse/tpch.region_orc_def/.hive-staging_hive_2023-12-14_10-07-26_390_2135324644258043563-3/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231214100726_c0c669ae-1ff3-4e21-8aaf-31840d580592); Time taken: 0.531 seconds INFO : OK 5 rows affected (0.599 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.orders SELECT * FROM tpch.orders; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20231214100727_b75b4017-05b2-4c15-a14b-9360114e8983): INSERT OVERWRITE TABLE tpch_orc_def.orders SELECT * FROM tpch.orders INFO : No Stats for tpch@orders, Columns: o_orderstatus, o_clerk, o_orderdate, o_shippriority, o_custkey, o_totalprice, o_orderkey, o_comment, o_orderpriority INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:orders.o_orderkey, type:bigint, comment:null), FieldSchema(name:orders.o_custkey, type:bigint, comment:null), FieldSchema(name:orders.o_orderstatus, type:string, comment:null), FieldSchema(name:orders.o_totalprice, type:decimal(12,2), comment:null), FieldSchema(name:orders.o_orderdate, type:string, comment:null), FieldSchema(name:orders.o_orderpriority, type:string, comment:null), FieldSchema(name:orders.o_clerk, type:string, comment:null), FieldSchema(name:orders.o_shippriority, type:int, comment:null), FieldSchema(name:orders.o_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231214100727_b75b4017-05b2-4c15-a14b-9360114e8983); Time taken: 0.064 seconds INFO : Executing command(queryId=ubuntu_20231214100727_b75b4017-05b2-4c15-a14b-9360114e8983): INSERT OVERWRITE TABLE tpch_orc_def.orders SELECT * FROM tpch.orders INFO : Query ID = ubuntu_20231214100727_b75b4017-05b2-4c15-a14b-9360114e8983 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231214100727_b75b4017-05b2-4c15-a14b-9360114e8983 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_or...tpch.orders (Stage-1) INFO : HS2 Host: [ip-172-31-52-214], Query ID: [ubuntu_20231214100727_b75b4017-05b2-4c15-a14b-9360114e8983], Dag ID: [dag_1702548244325_0002_9], DAG Session ID: [application_1702548244325_0002] INFO : Status: Running (Executing on YARN cluster with App id application_1702548244325_0002) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 1.47 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 1.97 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ... container RUNNING 3 1 2 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [========>>------------------] 33% ELAPSED TIME: 2.47 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 3 3 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 2.97 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.49 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.69 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is filtered out by condition resolver. INFO : Stage-3 is selected by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Launching Job 3 out of 3 INFO : Starting task [Stage-3:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231214100727_b75b4017-05b2-4c15-a14b-9360114e8983 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_or...tpch.orders (Stage-3) INFO : HS2 Host: [ip-172-31-52-214], Query ID: [ubuntu_20231214100727_b75b4017-05b2-4c15-a14b-9360114e8983], Dag ID: [dag_1702548244325_0002_10], DAG Session ID: [application_1702548244325_0002] INFO : Status: Running (Executing on YARN cluster with App id application_1702548244325_0002) INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.orders from hdfs://localhost:20500/test-warehouse/tpch.orders_orc_def/.hive-staging_hive_2023-12-14_10-07-27_076_2253035652312579292-3/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231214100727_b75b4017-05b2-4c15-a14b-9360114e8983); Time taken: 3.675 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- File Merge ..... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.69 s ---------------------------------------------------------------------------------------------- No rows affected (3.778 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOCK; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=nonstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pernode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE tpch_orc_def.customer SELECT * FROM tpch.customer; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20231214100730_83f4769f-b318-4559-a571-0ea9c5d9038d): INSERT OVERWRITE TABLE tpch_orc_def.customer SELECT * FROM tpch.customer INFO : No Stats for tpch@customer, Columns: c_custkey, c_phone, c_acctbal, c_mktsegment, c_address, c_nationkey, c_name, c_comment INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:customer.c_custkey, type:bigint, comment:null), FieldSchema(name:customer.c_name, type:string, comment:null), FieldSchema(name:customer.c_address, type:string, comment:null), FieldSchema(name:customer.c_nationkey, type:smallint, comment:null), FieldSchema(name:customer.c_phone, type:string, comment:null), FieldSchema(name:customer.c_acctbal, type:decimal(12,2), comment:null), FieldSchema(name:customer.c_mktsegment, type:string, comment:null), FieldSchema(name:customer.c_comment, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20231214100730_83f4769f-b318-4559-a571-0ea9c5d9038d); Time taken: 0.104 seconds INFO : Executing command(queryId=ubuntu_20231214100730_83f4769f-b318-4559-a571-0ea9c5d9038d): INSERT OVERWRITE TABLE tpch_orc_def.customer SELECT * FROM tpch.customer INFO : Query ID = ubuntu_20231214100730_83f4769f-b318-4559-a571-0ea9c5d9038d INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20231214100730_83f4769f-b318-4559-a571-0ea9c5d9038d INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE tpch_...tpch.customer (Stage-1) INFO : HS2 Host: [ip-172-31-52-214], Query ID: [ubuntu_20231214100730_83f4769f-b318-4559-a571-0ea9c5d9038d], Dag ID: [dag_1702548244325_0002_11], DAG Session ID: [application_1702548244325_0002] INFO : Status: Running (Executing on YARN cluster with App id application_1702548244325_0002) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.33 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://localhost:20500/test-warehouse/tpch.customer_orc_def/.hive-staging_hive_2023-12-14_10-07-30_959_7166162703843393680-3/-ext-10000 from hdfs://localhost:20500/test-warehouse/tpch.customer_orc_def/.hive-staging_hive_2023-12-14_10-07-30_959_7166162703843393680-3/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table tpch_orc_def.customer from hdfs://localhost:20500/test-warehouse/tpch.customer_orc_def/.hive-staging_hive_2023-12-14_10-07-30_959_7166162703843393680-3/-ext-10000 INFO : Completed executing command(queryId=ubuntu_20231214100730_83f4769f-b318-4559-a571-0ea9c5d9038d); Time taken: 1.349 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 1 1 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.34 s ---------------------------------------------------------------------------------------------- 150,000 rows affected (1.506 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> Closing: 0: jdbc:hive2://localhost:11050/default;auth=none