SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-2523282/apache-hive-3.1.3000.7.1.1.0-380-bin/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-2523282/hadoop-3.1.1.7.1.1.0-380/share/hadoop/common/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console. Set system property 'log4j2.debug' to show Log4j2 internal initialization logging. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-2523282/apache-hive-3.1.3000.7.1.1.0-380-bin/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-2523282/hadoop-3.1.1.7.1.1.0-380/share/hadoop/common/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] !connect jdbc:hive2://localhost:11050/default;auth=none ubuntu [passwd stripped] Connecting to jdbc:hive2://localhost:11050/default;auth=none Connected to: Apache Hive (version 3.1.3000.7.1.1.0-380) Driver: Hive JDBC (version 3.1.3000.7.1.1.0-380) Transaction isolation: TRANSACTION_REPEATABLE_READ 0: jdbc:hive2://localhost:11050/default> -- Used for positive/negative testing o f complex types on various file formats. 0: jdbc:hive2://localhost:11050/default> -- In particular, queries on file forma ts for which we do not support complex types 0: jdbc:hive2://localhost:11050/default> -- should fail gracefully. 0: jdbc:hive2://localhost:11050/default> CREATE TABLE IF NOT EXISTS functional_o rc_def.complextypes_fileformat ( . . . . . . . . . . . . . . . . . . . .> id int, . . . . . . . . . . . . . . . . . . . .> s struct, . . . . . . . . . . . . . . . . . . . .> a array, . . . . . . . . . . . . . . . . . . . .> m map) . . . . . . . . . . . . . . . . . . . .> STORED AS ORC; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506011148_70ea19d9-13ad-4ee8-91ff-60107d17ef60): CREATE TABLE IF NOT EXISTS functional_orc_def.complextypes_fileformat ( id int, s struct, a array, m map) STORED AS ORC INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506011148_70ea19d9-13ad-4ee8-91ff-60107d17ef60); Time taken: 0.009 seconds INFO : Executing command(queryId=ubuntu_20200506011148_70ea19d9-13ad-4ee8-91ff-60107d17ef60): CREATE TABLE IF NOT EXISTS functional_orc_def.complextypes_fileformat ( id int, s struct, a array, m map) STORED AS ORC INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506011148_70ea19d9-13ad-4ee8-91ff-60107d17ef60); Time taken: 0.065 seconds INFO : OK No rows affected (0.149 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> CREATE EXTERNAL TABLE IF NOT EXISTS fun ctional_orc_def.nullformat_custom ( . . . . . . . . . . . . . . . . . . . .> id int, . . . . . . . . . . . . . . . . . . . .> a boolean, . . . . . . . . . . . . . . . . . . . .> b string, . . . . . . . . . . . . . . . . . . . .> c int, . . . . . . . . . . . . . . . . . . . .> d double) . . . . . . . . . . . . . . . . . . . .> STORED AS TEXTFILE . . . . . . . . . . . . . . . . . . . .> TBLPROPERTIES("serialization.null.forma t" = "xyz"); going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506011148_ee983f87-95bf-4f6c-b1d1-4d6214e7e25e): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.nullformat_custom ( id int, a boolean, b string, c int, d double) STORED AS TEXTFILE TBLPROPERTIES("serialization.null.format" = "xyz") INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506011148_ee983f87-95bf-4f6c-b1d1-4d6214e7e25e); Time taken: 0.007 seconds INFO : Executing command(queryId=ubuntu_20200506011148_ee983f87-95bf-4f6c-b1d1-4d6214e7e25e): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.nullformat_custom ( id int, a boolean, b string, c int, d double) STORED AS TEXTFILE TBLPROPERTIES("serialization.null.format" = "xyz") INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506011148_ee983f87-95bf-4f6c-b1d1-4d6214e7e25e); Time taken: 0.021 seconds INFO : OK No rows affected (0.053 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> -- Create a table that mixes supported and unsupported scalar types. 0: jdbc:hive2://localhost:11050/default> -- We should be able to read the column values of supported types and 0: jdbc:hive2://localhost:11050/default> -- fail queries that reference columns of unsupported types. 0: jdbc:hive2://localhost:11050/default> CREATE EXTERNAL TABLE IF NOT EXISTS fun ctional_orc_def.unsupported_types ( . . . . . . . . . . . . . . . . . . . .> int_col INT, . . . . . . . . . . . . . . . . . . . .> dec_col DECIMAL, . . . . . . . . . . . . . . . . . . . .> date_col DATE, . . . . . . . . . . . . . . . . . . . .> str_col STRING, . . . . . . . . . . . . . . . . . . . .> bin_col BINARY, . . . . . . . . . . . . . . . . . . . .> bigint_col BIGINT) . . . . . . . . . . . . . . . . . . . .> ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' . . . . . . . . . . . . . . . . . . . .> STORED AS ORC . . . . . . . . . . . . . . . . . . . .> LOCATION '/test-warehouse/unsupported_t ypes_orc_def'; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506011148_b9d9ae99-188d-424c-a4c6-5a09a343a2a0): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.unsupported_types ( int_col INT, dec_col DECIMAL, date_col DATE, str_col STRING, bin_col BINARY, bigint_col BIGINT) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS ORC LOCATION '/test-warehouse/unsupported_types_orc_def' INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506011148_b9d9ae99-188d-424c-a4c6-5a09a343a2a0); Time taken: 0.009 seconds INFO : Executing command(queryId=ubuntu_20200506011148_b9d9ae99-188d-424c-a4c6-5a09a343a2a0): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.unsupported_types ( int_col INT, dec_col DECIMAL, date_col DATE, str_col STRING, bin_col BINARY, bigint_col BIGINT) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS ORC LOCATION '/test-warehouse/unsupported_types_orc_def' INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506011148_b9d9ae99-188d-424c-a4c6-5a09a343a2a0); Time taken: 0.016 seconds INFO : OK No rows affected (0.04 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> CREATE TABLE IF NOT EXISTS functional_o rc_def.full_transactional_table ( . . . . . . . . . . . . . . . . . . . .> col1 int) . . . . . . . . . . . . . . . . . . . .> STORED AS ORC . . . . . . . . . . . . . . . . . . . .> TBLPROPERTIES('transactional'='true'); going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506011148_822c697e-9a55-4903-876a-96cd94706925): CREATE TABLE IF NOT EXISTS functional_orc_def.full_transactional_table ( col1 int) STORED AS ORC TBLPROPERTIES('transactional'='true') INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506011148_822c697e-9a55-4903-876a-96cd94706925); Time taken: 0.007 seconds INFO : Executing command(queryId=ubuntu_20200506011148_822c697e-9a55-4903-876a-96cd94706925): CREATE TABLE IF NOT EXISTS functional_orc_def.full_transactional_table ( col1 int) STORED AS ORC TBLPROPERTIES('transactional'='true') INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506011148_822c697e-9a55-4903-876a-96cd94706925); Time taken: 0.015 seconds INFO : OK No rows affected (0.036 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> CREATE MATERIALIZED VIEW IF NOT EXISTS functional_orc_def.materialized_view . . . . . . . . . . . . . . . . . . . .> AS SELECT * FROM functional_orc_def.i nsert_only_transactional_table; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20200506011148_b24fd9f8-319c-4473-b3fb-7b0394ddbdb9): CREATE MATERIALIZED VIEW IF NOT EXISTS functional_orc_def.materialized_view AS SELECT * FROM functional_orc_def.insert_only_transactional_table INFO : No Stats for functional_orc_def@insert_only_transactional_table, Columns: col1 INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:col1, type:int, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506011148_b24fd9f8-319c-4473-b3fb-7b0394ddbdb9); Time taken: 0.027 seconds INFO : Executing command(queryId=ubuntu_20200506011148_b24fd9f8-319c-4473-b3fb-7b0394ddbdb9): CREATE MATERIALIZED VIEW IF NOT EXISTS functional_orc_def.materialized_view AS SELECT * FROM functional_orc_def.insert_only_transactional_table INFO : Query ID = ubuntu_20200506011148_b24fd9f8-319c-4473-b3fb-7b0394ddbdb9 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20200506011148_b24fd9f8-319c-4473-b3fb-7b0394ddbdb9 INFO : Tez session hasn't been created yet. Opening session printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs printed operations logs going to print operations logs INFO : Dag name: CREATE MATERIALIZED V..._transactional_table (Stage-1) INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://172.18.0.1:20500/test-warehouse/managed/.hive-staging_hive_2020-05-06_01-11-48_856_7939225495640858143-116/-ext-10002 from hdfs://172.18.0.1:20500/test-warehouse/managed/.hive-staging_hive_2020-05-06_01-11-48_856_7939225495640858143-116/-ext-10004 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Moving data to directory hdfs://172.18.0.1:20500/test-warehouse/managed/functional_orc_def.db/materialized_view from hdfs://172.18.0.1:20500/test-warehouse/managed/.hive-staging_hive_2020-05-06_01-11-48_856_7939225495640858143-116/-ext-10002 INFO : Starting task [Stage-8:DDL] in serial mode INFO : Starting task [Stage-9:DDL] in serial mode INFO : No Stats for functional_orc_def@insert_only_transactional_table, Columns: col1 INFO : Completed executing command(queryId=ubuntu_20200506011148_b24fd9f8-319c-4473-b3fb-7b0394ddbdb9); Time taken: 668.782 seconds INFO : OK printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container SUCCEEDED 0 0 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 0.70 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container SUCCEEDED 0 0 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 0.70 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container SUCCEEDED 0 0 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 0.70 s ---------------------------------------------------------------------------------------------- No rows affected (668.83 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> CREATE TABLE IF NOT EXISTS functional_o rc_def.insert_only_transactional_bucketed_table ( . . . . . . . . . . . . . . . . . . . .> col1 int, col2 int) . . . . . . . . . . . . . . . . . . . .> CLUSTERED BY (col1) INTO 5 BUCKETS . . . . . . . . . . . . . . . . . . . .> STORED AS ORC . . . . . . . . . . . . . . . . . . . .> TBLPROPERTIES('transactional'='true', ' transactional_properties'='insert_only'); going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506012257_87c4b7b1-0ed6-476d-a791-db1174d7e31f): CREATE TABLE IF NOT EXISTS functional_orc_def.insert_only_transactional_bucketed_table ( col1 int, col2 int) CLUSTERED BY (col1) INTO 5 BUCKETS STORED AS ORC TBLPROPERTIES('transactional'='true', 'transactional_properties'='insert_only') INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012257_87c4b7b1-0ed6-476d-a791-db1174d7e31f); Time taken: 0.006 seconds INFO : Executing command(queryId=ubuntu_20200506012257_87c4b7b1-0ed6-476d-a791-db1174d7e31f): CREATE TABLE IF NOT EXISTS functional_orc_def.insert_only_transactional_bucketed_table ( col1 int, col2 int) CLUSTERED BY (col1) INTO 5 BUCKETS STORED AS ORC TBLPROPERTIES('transactional'='true', 'transactional_properties'='insert_only') INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506012257_87c4b7b1-0ed6-476d-a791-db1174d7e31f); Time taken: 0.012 seconds INFO : OK No rows affected (0.031 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> CREATE EXTERNAL TABLE IF NOT EXISTS fun ctional_orc_def.bucketed_ext_table ( . . . . . . . . . . . . . . . . . . . .> col1 int, col2 int) . . . . . . . . . . . . . . . . . . . .> CLUSTERED BY (col1) INTO 5 BUCKETS . . . . . . . . . . . . . . . . . . . .> STORED AS TEXTFILE . . . . . . . . . . . . . . . . . . . .> LOCATION '/test-warehouse/functional_or c_defbucketed_ext_table'; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506012257_f716905e-9dbf-4114-b010-1b14c98abb87): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.bucketed_ext_table ( col1 int, col2 int) CLUSTERED BY (col1) INTO 5 BUCKETS STORED AS TEXTFILE LOCATION '/test-warehouse/functional_orc_defbucketed_ext_table' INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012257_f716905e-9dbf-4114-b010-1b14c98abb87); Time taken: 0.006 seconds INFO : Executing command(queryId=ubuntu_20200506012257_f716905e-9dbf-4114-b010-1b14c98abb87): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.bucketed_ext_table ( col1 int, col2 int) CLUSTERED BY (col1) INTO 5 BUCKETS STORED AS TEXTFILE LOCATION '/test-warehouse/functional_orc_defbucketed_ext_table' INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506012257_f716905e-9dbf-4114-b010-1b14c98abb87); Time taken: 0.012 seconds INFO : OK No rows affected (0.029 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> CREATE TABLE IF NOT EXISTS functional_o rc_def.bucketed_table ( . . . . . . . . . . . . . . . . . . . .> col1 int, col2 int) . . . . . . . . . . . . . . . . . . . .> CLUSTERED BY (col1) INTO 5 BUCKETS . . . . . . . . . . . . . . . . . . . .> STORED AS ORC; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506012257_ade26803-cf77-4a9d-a903-bb0fb20a026f): CREATE TABLE IF NOT EXISTS functional_orc_def.bucketed_table ( col1 int, col2 int) CLUSTERED BY (col1) INTO 5 BUCKETS STORED AS ORC INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012257_ade26803-cf77-4a9d-a903-bb0fb20a026f); Time taken: 0.006 seconds INFO : Executing command(queryId=ubuntu_20200506012257_ade26803-cf77-4a9d-a903-bb0fb20a026f): CREATE TABLE IF NOT EXISTS functional_orc_def.bucketed_table ( col1 int, col2 int) CLUSTERED BY (col1) INTO 5 BUCKETS STORED AS ORC INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506012257_ade26803-cf77-4a9d-a903-bb0fb20a026f); Time taken: 0.011 seconds INFO : OK No rows affected (0.028 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> CREATE TABLE functional_orc_def.uncomp_ src_alltypes LIKE functional.alltypes STORED AS ORC; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506012257_067ddfb6-2607-4a93-8256-e2e62e52b7d3): CREATE TABLE functional_orc_def.uncomp_src_alltypes LIKE functional.alltypes STORED AS ORC INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012257_067ddfb6-2607-4a93-8256-e2e62e52b7d3); Time taken: 0.009 seconds INFO : Executing command(queryId=ubuntu_20200506012257_067ddfb6-2607-4a93-8256-e2e62e52b7d3): CREATE TABLE functional_orc_def.uncomp_src_alltypes LIKE functional.alltypes STORED AS ORC INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506012257_067ddfb6-2607-4a93-8256-e2e62e52b7d3); Time taken: 0.019 seconds INFO : OK No rows affected (0.038 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> CREATE TABLE functional_orc_def.uncomp_ src_decimal_tbl LIKE functional.decimal_tbl STORED AS ORC; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506012257_4445ca34-194c-4bac-a089-e69484d1a182): CREATE TABLE functional_orc_def.uncomp_src_decimal_tbl LIKE functional.decimal_tbl STORED AS ORC INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012257_4445ca34-194c-4bac-a089-e69484d1a182); Time taken: 0.01 seconds INFO : Executing command(queryId=ubuntu_20200506012257_4445ca34-194c-4bac-a089-e69484d1a182): CREATE TABLE functional_orc_def.uncomp_src_decimal_tbl LIKE functional.decimal_tbl STORED AS ORC INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506012257_4445ca34-194c-4bac-a089-e69484d1a182); Time taken: 0.017 seconds INFO : OK No rows affected (0.038 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypes partition (year, month) . . . . . . . . . . . . . . . . . . . .> SELECT id, bool_col, tinyint_col, small int_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col , timestamp_col, year, month . . . . . . . . . . . . . . . . . . . .> FROM functional.alltypes; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20200506012257_07e72443-99a9-44f6-8c5f-ec08f214ac72): INSERT OVERWRITE TABLE functional_orc_def.alltypes partition (year, month) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month FROM functional.alltypes INFO : No Stats for functional@alltypes, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012257_07e72443-99a9-44f6-8c5f-ec08f214ac72); Time taken: 0.044 seconds INFO : Executing command(queryId=ubuntu_20200506012257_07e72443-99a9-44f6-8c5f-ec08f214ac72): INSERT OVERWRITE TABLE functional_orc_def.alltypes partition (year, month) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month FROM functional.alltypes INFO : Query ID = ubuntu_20200506012257_07e72443-99a9-44f6-8c5f-ec08f214ac72 INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20200506012257_07e72443-99a9-44f6-8c5f-ec08f214ac72 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE...functional.alltypes (Stage-1) INFO : Status: Running (Executing on YARN cluster with App id application_1588725973781_0033) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 24 0 0 24 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 1.05 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 24 0 0 24 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 1.55 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 24 0 0 24 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 2.05 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 24 0 0 24 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 2.56 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 24 0 0 24 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 3.07 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 24 0 0 24 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 3.57 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 24 0 0 24 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 4.07 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 1 23 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 4.58 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 1 23 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 5.08 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 1 23 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 5.59 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 2 22 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 6.09 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 2 22 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 6.60 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 2 22 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 7.10 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 2 22 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 7.61 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 2 22 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 8.11 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 3 21 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 8.61 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 3 21 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 9.11 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 3 21 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 9.62 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 4 20 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 10.62 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 4 20 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 11.62 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 5 19 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 12.63 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 0 6 18 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [>>--------------------------] 0% ELAPSED TIME: 13.63 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 1 5 18 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=>>-------------------------] 4% ELAPSED TIME: 14.63 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 1 7 16 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=>>-------------------------] 4% ELAPSED TIME: 15.63 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 2 7 15 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [==>>------------------------] 8% ELAPSED TIME: 16.64 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 24 2 8 14 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [==>>------------------------] 8% ELAPSED TIME: 17.64 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 . container RUNNING 24 3 9 12 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [===>>-----------------------] 12% ELAPSED TIME: 18.64 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .. container RUNNING 24 5 8 11 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=====>>---------------------] 20% ELAPSED TIME: 19.65 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .. container RUNNING 24 5 9 10 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=====>>---------------------] 20% ELAPSED TIME: 21.15 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .. container RUNNING 24 6 11 7 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [======>>--------------------] 25% ELAPSED TIME: 22.65 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .. container RUNNING 24 7 11 6 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=======>>-------------------] 29% ELAPSED TIME: 24.16 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ... container RUNNING 24 8 13 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [========>>------------------] 33% ELAPSED TIME: 25.66 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ... container RUNNING 24 8 15 1 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [========>>------------------] 33% ELAPSED TIME: 27.16 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ... container RUNNING 24 9 15 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=========>>-----------------] 37% ELAPSED TIME: 28.66 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .... container RUNNING 24 10 14 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [==========>>----------------] 41% ELAPSED TIME: 30.17 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ..... container RUNNING 24 12 12 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=============>>-------------] 50% ELAPSED TIME: 32.17 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ...... container RUNNING 24 16 8 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=================>>---------] 66% ELAPSED TIME: 34.17 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 24 24 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 35.50 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table functional_orc_def.alltypes partition (year=null, month=null) from hdfs://172.18.0.1:20500/test-warehouse/managed/alltypes_orc_def INFO : INFO : Time taken to load dynamic partitions: 0.635 seconds INFO : Time taken for adding to write entity : 0.0 seconds INFO : Completed executing command(queryId=ubuntu_20200506012257_07e72443-99a9-44f6-8c5f-ec08f214ac72); Time taken: 36.062 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 24 24 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 35.50 s ---------------------------------------------------------------------------------------------- 7,300 rows affected (36.121 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypessmall partition (year, month) . . . . . . . . . . . . . . . . . . . .> SELECT id, bool_col, tinyint_col, small int_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col , timestamp_col, year, month . . . . . . . . . . . . . . . . . . . .> FROM functional.alltypessmall; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20200506012334_46d59e26-e04b-4cc1-b195-84e5ab26d0a7): INSERT OVERWRITE TABLE functional_orc_def.alltypessmall partition (year, month) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month FROM functional.alltypessmall INFO : No Stats for functional@alltypessmall, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012334_46d59e26-e04b-4cc1-b195-84e5ab26d0a7); Time taken: 0.04 seconds INFO : Executing command(queryId=ubuntu_20200506012334_46d59e26-e04b-4cc1-b195-84e5ab26d0a7): INSERT OVERWRITE TABLE functional_orc_def.alltypessmall partition (year, month) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month FROM functional.alltypessmall INFO : Query ID = ubuntu_20200506012334_46d59e26-e04b-4cc1-b195-84e5ab26d0a7 INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20200506012334_46d59e26-e04b-4cc1-b195-84e5ab26d0a7 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABL...tional.alltypessmall (Stage-1) INFO : Status: Running (Executing on YARN cluster with App id application_1588725973781_0033) INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table functional_orc_def.alltypessmall partition (year=null, month=null) from hdfs://172.18.0.1:20500/test-warehouse/managed/alltypessmall_orc_def printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 4 4 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.68 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : INFO : Time taken to load dynamic partitions: 0.164 seconds INFO : Time taken for adding to write entity : 0.0 seconds INFO : Completed executing command(queryId=ubuntu_20200506012334_46d59e26-e04b-4cc1-b195-84e5ab26d0a7); Time taken: 1.222 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 4 4 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.68 s ---------------------------------------------------------------------------------------------- 100 rows affected (1.276 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.01 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypestiny partition (year, month) . . . . . . . . . . . . . . . . . . . .> SELECT id, bool_col, tinyint_col, small int_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col , timestamp_col, year, month . . . . . . . . . . . . . . . . . . . .> FROM functional.alltypestiny; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20200506012335_557376dd-86fd-46de-a389-ec0c3704c8e5): INSERT OVERWRITE TABLE functional_orc_def.alltypestiny partition (year, month) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month FROM functional.alltypestiny INFO : No Stats for functional@alltypestiny, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012335_557376dd-86fd-46de-a389-ec0c3704c8e5); Time taken: 0.048 seconds INFO : Executing command(queryId=ubuntu_20200506012335_557376dd-86fd-46de-a389-ec0c3704c8e5): INSERT OVERWRITE TABLE functional_orc_def.alltypestiny partition (year, month) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month FROM functional.alltypestiny INFO : Query ID = ubuntu_20200506012335_557376dd-86fd-46de-a389-ec0c3704c8e5 INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20200506012335_557376dd-86fd-46de-a389-ec0c3704c8e5 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABL...ctional.alltypestiny (Stage-1) INFO : Status: Running (Executing on YARN cluster with App id application_1588725973781_0033) INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table functional_orc_def.alltypestiny partition (year=null, month=null) from hdfs://172.18.0.1:20500/test-warehouse/managed/alltypestiny_orc_def INFO : printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 4 4 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.70 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Time taken to load dynamic partitions: 0.157 seconds INFO : Time taken for adding to write entity : 0.0 seconds INFO : Completed executing command(queryId=ubuntu_20200506012335_557376dd-86fd-46de-a389-ec0c3704c8e5); Time taken: 1.246 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 4 4 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.70 s ---------------------------------------------------------------------------------------------- 8 rows affected (1.307 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> USE functional_orc_def; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506012336_d84301a0-2b88-4370-8310-77a2bcd1fdaa): USE functional_orc_def INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012336_d84301a0-2b88-4370-8310-77a2bcd1fdaa); Time taken: 0.002 seconds INFO : Executing command(queryId=ubuntu_20200506012336_d84301a0-2b88-4370-8310-77a2bcd1fdaa): USE functional_orc_def INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506012336_d84301a0-2b88-4370-8310-77a2bcd1fdaa); Time taken: 0.002 seconds INFO : OK No rows affected (0.007 seconds) 0: jdbc:hive2://localhost:11050/default> -- Step 4: Stream the data from tmp tex t table to desired format tmp table 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypeserror_tmp PARTITION (year, month) . . . . . . . . . . . . . . . . . . . .> SELECT * FROM functional.alltypeserror_ tmp; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20200506012336_13080b00-639d-42f0-a4cc-2af595046140): INSERT OVERWRITE TABLE functional_orc_def.alltypeserror_tmp PARTITION (year, month) SELECT * FROM functional.alltypeserror_tmp INFO : No Stats for functional@alltypeserror_tmp, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:alltypeserror_tmp.id, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.bool_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.tinyint_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.smallint_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.int_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.bigint_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.float_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.double_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.date_string_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.string_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.timestamp_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.year, type:int, comment:null), FieldSchema(name:alltypeserror_tmp.month, type:int, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012336_13080b00-639d-42f0-a4cc-2af595046140); Time taken: 0.049 seconds INFO : Executing command(queryId=ubuntu_20200506012336_13080b00-639d-42f0-a4cc-2af595046140): INSERT OVERWRITE TABLE functional_orc_def.alltypeserror_tmp PARTITION (year, month) SELECT * FROM functional.alltypeserror_tmp INFO : Query ID = ubuntu_20200506012336_13080b00-639d-42f0-a4cc-2af595046140 INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20200506012336_13080b00-639d-42f0-a4cc-2af595046140 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABL...al.alltypeserror_tmp (Stage-1) INFO : Status: Running (Executing on YARN cluster with App id application_1588725973781_0033) INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://172.18.0.1:20500/test-warehouse/alltypeserror_orc_def/.hive-staging_hive_2020-05-06_01-23-36_770_610082845348405491-116/-ext-10000 from hdfs://172.18.0.1:20500/test-warehouse/alltypeserror_orc_def/.hive-staging_hive_2020-05-06_01-23-36_770_610082845348405491-116/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table functional_orc_def.alltypeserror_tmp partition (year=null, month=null) from hdfs://172.18.0.1:20500/test-warehouse/alltypeserror_orc_def/.hive-staging_hive_2020-05-06_01-23-36_770_610082845348405491-116/-ext-10000 INFO : INFO : Time taken to load dynamic partitions: 0.143 seconds INFO : Time taken for adding to write entity : 0.0 seconds INFO : Completed executing command(queryId=ubuntu_20200506012336_13080b00-639d-42f0-a4cc-2af595046140); Time taken: 1.105 seconds INFO : OK printed operations logs Getting log thread is interrupted, since query is done! ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 3 3 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.50 s ---------------------------------------------------------------------------------------------- 31 rows affected (1.162 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> -- Cleanup the temp table 0: jdbc:hive2://localhost:11050/default> DROP TABLE IF EXISTS functional_orc_def .alltypeserror_tmp; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506012337_2cbf9798-e25b-4258-8544-85076d7ffe7f): DROP TABLE IF EXISTS functional_orc_def.alltypeserror_tmp INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012337_2cbf9798-e25b-4258-8544-85076d7ffe7f); Time taken: 0.009 seconds INFO : Executing command(queryId=ubuntu_20200506012337_2cbf9798-e25b-4258-8544-85076d7ffe7f): DROP TABLE IF EXISTS functional_orc_def.alltypeserror_tmp INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506012337_2cbf9798-e25b-4258-8544-85076d7ffe7f); Time taken: 0.046 seconds INFO : OK No rows affected (0.063 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> USE functional_orc_def; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506012338_e8663401-90d4-45d1-ac20-241c5eb87ccc): USE functional_orc_def INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012338_e8663401-90d4-45d1-ac20-241c5eb87ccc); Time taken: 0.002 seconds INFO : Executing command(queryId=ubuntu_20200506012338_e8663401-90d4-45d1-ac20-241c5eb87ccc): USE functional_orc_def INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506012338_e8663401-90d4-45d1-ac20-241c5eb87ccc); Time taken: 0.002 seconds INFO : OK No rows affected (0.009 seconds) 0: jdbc:hive2://localhost:11050/default> -- Step 4: Stream the data from tmp tex t table to desired format tmp table 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypeserrornonulls_tmp PARTITION (year, month) . . . . . . . . . . . . . . . . . . . .> SELECT * FROM functional.alltypeserrorn onulls_tmp; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20200506012338_3e8de756-9cfd-4bbc-8bcf-f7f4b5034b2d): INSERT OVERWRITE TABLE functional_orc_def.alltypeserrornonulls_tmp PARTITION (year, month) SELECT * FROM functional.alltypeserrornonulls_tmp INFO : No Stats for functional@alltypeserrornonulls_tmp, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:alltypeserrornonulls_tmp.id, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.bool_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.tinyint_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.smallint_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.int_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.bigint_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.float_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.double_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.date_string_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.string_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.timestamp_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.year, type:int, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.month, type:int, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012338_3e8de756-9cfd-4bbc-8bcf-f7f4b5034b2d); Time taken: 0.044 seconds INFO : Executing command(queryId=ubuntu_20200506012338_3e8de756-9cfd-4bbc-8bcf-f7f4b5034b2d): INSERT OVERWRITE TABLE functional_orc_def.alltypeserrornonulls_tmp PARTITION (year, month) SELECT * FROM functional.alltypeserrornonulls_tmp INFO : Query ID = ubuntu_20200506012338_3e8de756-9cfd-4bbc-8bcf-f7f4b5034b2d INFO : Total jobs = 3 INFO : Launching Job 1 out of 3 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20200506012338_3e8de756-9cfd-4bbc-8bcf-f7f4b5034b2d INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABL...ypeserrornonulls_tmp (Stage-1) INFO : Status: Running (Executing on YARN cluster with App id application_1588725973781_0033) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 3 3 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.03 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 3 3 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.04 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-7:CONDITIONAL] in serial mode INFO : Stage-4 is selected by condition resolver. INFO : Stage-3 is filtered out by condition resolver. INFO : Stage-5 is filtered out by condition resolver. INFO : Starting task [Stage-4:MOVE] in serial mode INFO : Moving data to directory hdfs://172.18.0.1:20500/test-warehouse/alltypeserrornonulls_orc_def/.hive-staging_hive_2020-05-06_01-23-38_080_7124734486492646225-116/-ext-10000 from hdfs://172.18.0.1:20500/test-warehouse/alltypeserrornonulls_orc_def/.hive-staging_hive_2020-05-06_01-23-38_080_7124734486492646225-116/-ext-10002 INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table functional_orc_def.alltypeserrornonulls_tmp partition (year=null, month=null) from hdfs://172.18.0.1:20500/test-warehouse/alltypeserrornonulls_orc_def/.hive-staging_hive_2020-05-06_01-23-38_080_7124734486492646225-116/-ext-10000 INFO : INFO : Time taken to load dynamic partitions: 0.429 seconds INFO : Time taken for adding to write entity : 0.0 seconds INFO : Completed executing command(queryId=ubuntu_20200506012338_3e8de756-9cfd-4bbc-8bcf-f7f4b5034b2d); Time taken: 1.585 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 3 3 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.05 s ---------------------------------------------------------------------------------------------- 30 rows affected (1.677 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> -- Cleanup the temp table 0: jdbc:hive2://localhost:11050/default> DROP TABLE IF EXISTS functional_orc_def .alltypeserrornonulls_tmp; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=ubuntu_20200506012339_eb6a7c69-d924-4407-ba36-5d829606b4cf): DROP TABLE IF EXISTS functional_orc_def.alltypeserrornonulls_tmp INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012339_eb6a7c69-d924-4407-ba36-5d829606b4cf); Time taken: 0.014 seconds INFO : Executing command(queryId=ubuntu_20200506012339_eb6a7c69-d924-4407-ba36-5d829606b4cf): DROP TABLE IF EXISTS functional_orc_def.alltypeserrornonulls_tmp INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=ubuntu_20200506012339_eb6a7c69-d924-4407-ba36-5d829606b4cf); Time taken: 0.104 seconds INFO : OK No rows affected (0.157 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; No rows affected (0.028 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K; No rows affected (0.009 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec; No rows affected (0.031 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.014 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.017 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.017 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.01 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.013 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.012 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.012 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypesagg partition (year, month, day) . . . . . . . . . . . . . . . . . . . .> SELECT id, bool_col, tinyint_col, small int_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col , timestamp_col, year, month, day . . . . . . . . . . . . . . . . . . . .> FROM functional.alltypesagg; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20200506012340_24b80eb3-ac65-4e3c-ac50-fc53aa303b96): INSERT OVERWRITE TABLE functional_orc_def.alltypesagg partition (year, month, day) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day FROM functional.alltypesagg INFO : No Stats for functional@alltypesagg, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null), FieldSchema(name:day, type:int, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012340_24b80eb3-ac65-4e3c-ac50-fc53aa303b96); Time taken: 0.122 seconds INFO : Executing command(queryId=ubuntu_20200506012340_24b80eb3-ac65-4e3c-ac50-fc53aa303b96): INSERT OVERWRITE TABLE functional_orc_def.alltypesagg partition (year, month, day) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day FROM functional.alltypesagg INFO : Query ID = ubuntu_20200506012340_24b80eb3-ac65-4e3c-ac50-fc53aa303b96 INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20200506012340_24b80eb3-ac65-4e3c-ac50-fc53aa303b96 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABL...nctional.alltypesagg (Stage-1) INFO : Status: Running (Executing on YARN cluster with App id application_1588725973781_0033) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 . container RUNNING 11 2 7 2 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [====>>----------------------] 18% ELAPSED TIME: 1.03 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ....... container RUNNING 11 8 1 2 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [==================>>--------] 72% ELAPSED TIME: 1.53 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ........ container RUNNING 11 9 0 2 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=====================>>-----] 81% ELAPSED TIME: 2.04 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ........ container RUNNING 11 9 0 2 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=====================>>-----] 81% ELAPSED TIME: 2.54 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ........ container RUNNING 11 9 2 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=====================>>-----] 81% ELAPSED TIME: 3.04 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ........ container RUNNING 11 9 2 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=====================>>-----] 81% ELAPSED TIME: 3.54 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ........ container RUNNING 11 9 2 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=====================>>-----] 81% ELAPSED TIME: 4.04 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ........ container RUNNING 11 9 2 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=====================>>-----] 81% ELAPSED TIME: 4.54 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 ........ container RUNNING 11 9 2 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/01 [=====================>>-----] 81% ELAPSED TIME: 5.05 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 11 11 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 5.40 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table functional_orc_def.alltypesagg partition (year=null, month=null, day=null) from hdfs://172.18.0.1:20500/test-warehouse/managed/alltypesagg_orc_def INFO : INFO : Time taken to load dynamic partitions: 0.291 seconds INFO : Time taken for adding to write entity : 0.0 seconds INFO : Completed executing command(queryId=ubuntu_20200506012340_24b80eb3-ac65-4e3c-ac50-fc53aa303b96); Time taken: 6.108 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 11 11 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 5.40 s ---------------------------------------------------------------------------------------------- 11,000 rows affected (6.263 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypesaggnonulls partition (year, month, day) . . . . . . . . . . . . . . . . . . . .> SELECT id, bool_col, tinyint_col, small int_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col , timestamp_col, year, month, day . . . . . . . . . . . . . . . . . . . .> FROM functional.alltypesaggnonulls; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20200506012346_f184d86d-6f9e-4d5b-a409-af8025bcb2d0): INSERT OVERWRITE TABLE functional_orc_def.alltypesaggnonulls partition (year, month, day) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day FROM functional.alltypesaggnonulls INFO : No Stats for functional@alltypesaggnonulls, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null), FieldSchema(name:day, type:int, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012346_f184d86d-6f9e-4d5b-a409-af8025bcb2d0); Time taken: 0.043 seconds INFO : Executing command(queryId=ubuntu_20200506012346_f184d86d-6f9e-4d5b-a409-af8025bcb2d0): INSERT OVERWRITE TABLE functional_orc_def.alltypesaggnonulls partition (year, month, day) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day FROM functional.alltypesaggnonulls INFO : Query ID = ubuntu_20200506012346_f184d86d-6f9e-4d5b-a409-af8025bcb2d0 INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20200506012346_f184d86d-6f9e-4d5b-a409-af8025bcb2d0 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABL...l.alltypesaggnonulls (Stage-1) INFO : Status: Running (Executing on YARN cluster with App id application_1588725973781_0033) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 10 10 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.01 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 10 10 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.14 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table functional_orc_def.alltypesaggnonulls partition (year=null, month=null, day=null) from hdfs://172.18.0.1:20500/test-warehouse/managed/alltypesaggnonulls_orc_def INFO : INFO : Time taken to load dynamic partitions: 0.262 seconds INFO : Time taken for adding to write entity : 0.0 seconds INFO : Completed executing command(queryId=ubuntu_20200506012346_f184d86d-6f9e-4d5b-a409-af8025bcb2d0); Time taken: 1.676 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 10 10 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 1.14 s ---------------------------------------------------------------------------------------------- 10,000 rows affected (1.732 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.complextypestbl SELECT * FROM functional_parquet.complextypestbl; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20200506012348_62276a41-e82d-43c5-98d5-b3229e95c12c): INSERT OVERWRITE TABLE functional_orc_def.complextypestbl SELECT * FROM functional_parquet.complextypestbl INFO : No Stats for functional_parquet@complextypestbl, Columns: int_array, int_map_array, id, int_array_array, nested_struct, int_map INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:complextypestbl.id, type:bigint, comment:null), FieldSchema(name:complextypestbl.int_array, type:array, comment:null), FieldSchema(name:complextypestbl.int_array_array, type:array>, comment:null), FieldSchema(name:complextypestbl.int_map, type:map, comment:null), FieldSchema(name:complextypestbl.int_map_array, type:array>, comment:null), FieldSchema(name:complextypestbl.nested_struct, type:struct,c:struct>>>,g:map>>>>, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012348_62276a41-e82d-43c5-98d5-b3229e95c12c); Time taken: 0.034 seconds INFO : Executing command(queryId=ubuntu_20200506012348_62276a41-e82d-43c5-98d5-b3229e95c12c): INSERT OVERWRITE TABLE functional_orc_def.complextypestbl SELECT * FROM functional_parquet.complextypestbl INFO : Query ID = ubuntu_20200506012348_62276a41-e82d-43c5-98d5-b3229e95c12c INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20200506012348_62276a41-e82d-43c5-98d5-b3229e95c12c INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABL...quet.complextypestbl (Stage-1) INFO : Status: Running (Executing on YARN cluster with App id application_1588725973781_0033) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.87 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table functional_orc_def.complextypestbl from hdfs://172.18.0.1:20500/test-warehouse/managed/complextypestbl_orc_def INFO : Completed executing command(queryId=ubuntu_20200506012348_62276a41-e82d-43c5-98d5-b3229e95c12c); Time taken: 1.417 seconds INFO : OK ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/01 [==========================>>] 100% ELAPSED TIME: 0.87 s ---------------------------------------------------------------------------------------------- 8 rows affected (1.468 seconds) 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> 0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.001 seconds) 0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat; going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! No rows affected (0.002 seconds) 0: jdbc:hive2://localhost:11050/default> -- This INSERT must run in Hive, becaus e Impala doesn't support inserting into tables 0: jdbc:hive2://localhost:11050/default> -- with complex types. 0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.complextypestbl_medium SELECT c.* FROM functional_parquet.complextypestbl c j oin functional.alltypes sort by id; going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=ubuntu_20200506012349_3c5cedc8-49d6-4e72-b4a5-e06cb82d1707): INSERT OVERWRITE TABLE functional_orc_def.complextypestbl_medium SELECT c.* FROM functional_parquet.complextypestbl c join functional.alltypes sort by id INFO : Warning: Map Join MAPJOIN[9][bigTable=alltypes] in task 'Map 2' is a cross product INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:c.id, type:bigint, comment:null), FieldSchema(name:c.int_array, type:array, comment:null), FieldSchema(name:c.int_array_array, type:array>, comment:null), FieldSchema(name:c.int_map, type:map, comment:null), FieldSchema(name:c.int_map_array, type:array>, comment:null), FieldSchema(name:c.nested_struct, type:struct,c:struct>>>,g:map>>>>, comment:null)], properties:null) INFO : Completed compiling command(queryId=ubuntu_20200506012349_3c5cedc8-49d6-4e72-b4a5-e06cb82d1707); Time taken: 0.063 seconds INFO : Executing command(queryId=ubuntu_20200506012349_3c5cedc8-49d6-4e72-b4a5-e06cb82d1707): INSERT OVERWRITE TABLE functional_orc_def.complextypestbl_medium SELECT c.* FROM functional_parquet.complextypestbl c join functional.alltypes sort by id INFO : Query ID = ubuntu_20200506012349_3c5cedc8-49d6-4e72-b4a5-e06cb82d1707 INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: ubuntu_20200506012349_3c5cedc8-49d6-4e72-b4a5-e06cb82d1707 INFO : Session is already open INFO : Dag name: INSERT OVERWRITE TABLE functional_orc_d...id (Stage-1) INFO : Setting tez.task.scale.memory.reserve-fraction to 0.30000001192092896 INFO : Status: Running (Executing on YARN cluster with App id application_1588725973781_0033) printed operations logs ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 2 0 0 2 0 0 Map 2 container RUNNING 24 0 10 14 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/03 [>>--------------------------] 0% ELAPSED TIME: 1.11 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container INITED 2 0 0 2 0 0 Map 2 container RUNNING 24 0 10 14 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/03 [>>--------------------------] 0% ELAPSED TIME: 1.61 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 2 0 2 0 0 0 Map 2 container RUNNING 24 0 10 14 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/03 [>>--------------------------] 0% ELAPSED TIME: 2.12 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 2 0 2 0 0 0 Map 2 container RUNNING 24 0 10 14 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/03 [>>--------------------------] 0% ELAPSED TIME: 2.62 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 2 0 2 0 0 0 Map 2 container RUNNING 24 0 10 14 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/03 [>>--------------------------] 0% ELAPSED TIME: 3.12 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 2 0 2 0 0 0 Map 2 container RUNNING 24 0 10 14 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/03 [>>--------------------------] 0% ELAPSED TIME: 3.62 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 2 0 2 0 0 0 Map 2 container RUNNING 24 0 10 14 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/03 [>>--------------------------] 0% ELAPSED TIME: 4.12 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 2 0 2 0 0 0 Map 2 container RUNNING 24 0 11 13 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/03 [>>--------------------------] 0% ELAPSED TIME: 4.62 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 container RUNNING 2 0 2 0 0 0 Map 2 container RUNNING 24 0 13 11 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 00/03 [>>--------------------------] 0% ELAPSED TIME: 5.13 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 container RUNNING 24 0 13 11 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=>>-------------------------] 6% ELAPSED TIME: 5.63 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 container RUNNING 24 0 15 9 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=>>-------------------------] 6% ELAPSED TIME: 6.14 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 container RUNNING 24 0 15 9 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=>>-------------------------] 6% ELAPSED TIME: 6.64 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 container RUNNING 24 0 15 9 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=>>-------------------------] 6% ELAPSED TIME: 7.14 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 container RUNNING 24 0 16 8 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=>>-------------------------] 6% ELAPSED TIME: 7.64 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 . container RUNNING 24 4 12 8 0 0 Reducer 3 container INITED 3 0 0 3 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=====>>---------------------] 20% ELAPSED TIME: 8.15 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 .. container RUNNING 24 5 14 5 0 0 Reducer 3 container RUNNING 3 0 1 2 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [======>>--------------------] 24% ELAPSED TIME: 8.65 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ... container RUNNING 24 8 11 5 0 0 Reducer 3 container RUNNING 3 0 1 2 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [========>>------------------] 34% ELAPSED TIME: 9.15 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ..... container RUNNING 24 13 6 5 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=============>>-------------] 51% ELAPSED TIME: 9.66 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ..... container RUNNING 24 13 6 5 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=============>>-------------] 51% ELAPSED TIME: 10.66 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ..... container RUNNING 24 13 6 5 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=============>>-------------] 51% ELAPSED TIME: 11.66 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ...... container RUNNING 24 15 4 5 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [===============>>-----------] 58% ELAPSED TIME: 12.67 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ...... container RUNNING 24 15 6 3 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [===============>>-----------] 58% ELAPSED TIME: 13.68 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ...... container RUNNING 24 15 7 2 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [===============>>-----------] 58% ELAPSED TIME: 14.68 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ...... container RUNNING 24 15 9 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [===============>>-----------] 58% ELAPSED TIME: 15.68 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ...... container RUNNING 24 15 9 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [===============>>-----------] 58% ELAPSED TIME: 16.68 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ...... container RUNNING 24 15 9 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [===============>>-----------] 58% ELAPSED TIME: 17.68 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ...... container RUNNING 24 15 9 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [===============>>-----------] 58% ELAPSED TIME: 18.69 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ...... container RUNNING 24 16 8 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [================>>----------] 62% ELAPSED TIME: 19.69 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ....... container RUNNING 24 18 6 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=================>>---------] 68% ELAPSED TIME: 21.19 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ....... container RUNNING 24 18 6 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=================>>---------] 68% ELAPSED TIME: 22.69 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ....... container RUNNING 24 18 6 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=================>>---------] 68% ELAPSED TIME: 24.19 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ....... container RUNNING 24 19 5 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [==================>>--------] 72% ELAPSED TIME: 25.70 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ....... container RUNNING 24 19 5 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [==================>>--------] 72% ELAPSED TIME: 27.20 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ....... container RUNNING 24 19 5 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [==================>>--------] 72% ELAPSED TIME: 28.70 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ........ container RUNNING 24 21 3 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [====================>>------] 79% ELAPSED TIME: 30.20 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 ......... container RUNNING 24 22 2 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 01/03 [=====================>>-----] 82% ELAPSED TIME: 32.20 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 .......... container SUCCEEDED 24 24 0 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 02/03 [=======================>>---] 89% ELAPSED TIME: 34.21 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 .......... container SUCCEEDED 24 24 0 0 0 0 Reducer 3 container RUNNING 3 0 3 0 0 0 ---------------------------------------------------------------------------------------------- VERTICES: 02/03 [=======================>>---] 89% ELAPSED TIME: 36.22 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 .......... container SUCCEEDED 24 24 0 0 0 0 Reducer 3 .... container RUNNING 3 2 1 0 1 0 ---------------------------------------------------------------------------------------------- VERTICES: 02/03 [=========================>>-] 96% ELAPSED TIME: 38.22 s ---------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------------  VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED ---------------------------------------------------------------------------------------------- Map 1 .......... container SUCCEEDED 2 2 0 0 0 0 Map 2 .......... container SUCCEEDED 24 24 0 0 0 0 Reducer 3 ...... container SUCCEEDED 3 3 0 0 1 0 ---------------------------------------------------------------------------------------------- VERTICES: 03/03 [==========================>>] 100% ELAPSED TIME: 38.28 s ---------------------------------------------------------------------------------------------- Getting log thread is interrupted, since query is done! ERROR : Job Commit failed with exception 'org.apache.hadoop.hive.ql.metadata.HiveException(java.io.EOFException)' org.apache.hadoop.hive.ql.metadata.HiveException: java.io.EOFException at org.apache.hadoop.hive.ql.exec.FileSinkOperator.jobCloseOp(FileSinkOperator.java:1470) at org.apache.hadoop.hive.ql.exec.Operator.jobClose(Operator.java:798) at org.apache.hadoop.hive.ql.exec.Operator.jobClose(Operator.java:803) at org.apache.hadoop.hive.ql.exec.tez.TezTask.close(TezTask.java:620) at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:335) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:213) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105) at org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:359) at org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:330) at org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:246) at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:109) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:721) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:488) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:482) at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:166) at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:225) at org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:87) at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:322) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876) at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:340) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:392) at org.apache.hadoop.hive.ql.exec.Utilities.handleDirectInsertTableFinalPath(Utilities.java:4448) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.jobCloseOp(FileSinkOperator.java:1464) ... 28 more ERROR : FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.tez.TezTask INFO : Completed executing command(queryId=ubuntu_20200506012349_3c5cedc8-49d6-4e72-b4a5-e06cb82d1707); Time taken: 38.896 seconds INFO : OK Error: Error while compiling statement: FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.tez.TezTask (state=08S01,code=3) java.sql.SQLException: Error while compiling statement: FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.tez.TezTask at org.apache.hive.jdbc.HiveStatement.waitForOperationToComplete(HiveStatement.java:401) at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:266) at org.apache.hive.beeline.Commands.executeInternal(Commands.java:1007) at org.apache.hive.beeline.Commands.execute(Commands.java:1217) at org.apache.hive.beeline.Commands.sql(Commands.java:1146) at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1497) at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1355) at org.apache.hive.beeline.BeeLine.executeFile(BeeLine.java:1329) at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1127) at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1082) at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:546) at org.apache.hive.beeline.BeeLine.main(BeeLine.java:528) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:318) at org.apache.hadoop.util.RunJar.main(RunJar.java:232) Closing: 0: jdbc:hive2://localhost:11050/default;auth=none