SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-4493826/apache-hive-3.1.3000.7.2.1.0-287-bin/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-4493826/hadoop-3.1.1.7.2.1.0-287/share/hadoop/common/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console. Set system property 'log4j2.debug' to show Log4j2 internal initialization logging.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-4493826/apache-hive-3.1.3000.7.2.1.0-287-bin/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/ubuntu/Impala/toolchain/cdp_components-4493826/hadoop-3.1.1.7.2.1.0-287/share/hadoop/common/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
!connect jdbc:hive2://localhost:11050/default;auth=none ubuntu [passwd stripped] 
Connecting to jdbc:hive2://localhost:11050/default;auth=none
Connected to: Apache Hive (version 3.1.3000.7.2.1.0-287)
Driver: Hive JDBC (version 3.1.3000.7.2.1.0-287)
Transaction isolation: TRANSACTION_REPEATABLE_READ
0: jdbc:hive2://localhost:11050/default> -- Used for positive/negative testing o f complex types on various file formats.
0: jdbc:hive2://localhost:11050/default> -- In particular, queries on file forma ts for which we do not support complex types
0: jdbc:hive2://localhost:11050/default> -- should fail gracefully.
0: jdbc:hive2://localhost:11050/default> CREATE TABLE IF NOT EXISTS functional_o rc_def.complextypes_fileformat (
. . . . . . . . . . . . . . . . . . . .>   id int,
. . . . . . . . . . . . . . . . . . . .>   s struct<f1:string,f2:int>,
. . . . . . . . . . . . . . . . . . . .>   a array<int>,
. . . . . . . . . . . . . . . . . . . .>   m map<string,bigint>)
. . . . . . . . . . . . . . . . . . . .> STORED AS ORC;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153053_3f17e72a-a929-4733-9bdc-05c0b90012e2): CREATE TABLE IF NOT EXISTS functional_orc_def.complextypes_fileformat (
id int,
s struct<f1:string,f2:int>,
a array<int>,
m map<string,bigint>)
STORED AS ORC
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153053_3f17e72a-a929-4733-9bdc-05c0b90012e2); Time taken: 0.007 seconds
INFO  : Executing command(queryId=ubuntu_20201009153053_3f17e72a-a929-4733-9bdc-05c0b90012e2): CREATE TABLE IF NOT EXISTS functional_orc_def.complextypes_fileformat (
id int,
s struct<f1:string,f2:int>,
a array<int>,
m map<string,bigint>)
STORED AS ORC
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153053_3f17e72a-a929-4733-9bdc-05c0b90012e2); Time taken: 0.018 seconds
INFO  : OK
No rows affected (0.069 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> CREATE EXTERNAL TABLE IF NOT EXISTS fun ctional_orc_def.nullformat_custom (
. . . . . . . . . . . . . . . . . . . .>   id int,
. . . . . . . . . . . . . . . . . . . .>   a boolean,
. . . . . . . . . . . . . . . . . . . .>   b string,
. . . . . . . . . . . . . . . . . . . .>   c int,
. . . . . . . . . . . . . . . . . . . .>   d double)
. . . . . . . . . . . . . . . . . . . .> STORED AS TEXTFILE
. . . . . . . . . . . . . . . . . . . .> TBLPROPERTIES("serialization.null.forma t" = "xyz");
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153053_e186ccdf-0b23-47ec-9212-6db0b0f676a0): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.nullformat_custom (
id int,
a boolean,
b string,
c int,
d double)
STORED AS TEXTFILE
TBLPROPERTIES("serialization.null.format" = "xyz")
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153053_e186ccdf-0b23-47ec-9212-6db0b0f676a0); Time taken: 0.006 seconds
INFO  : Executing command(queryId=ubuntu_20201009153053_e186ccdf-0b23-47ec-9212-6db0b0f676a0): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.nullformat_custom (
id int,
a boolean,
b string,
c int,
d double)
STORED AS TEXTFILE
TBLPROPERTIES("serialization.null.format" = "xyz")
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153053_e186ccdf-0b23-47ec-9212-6db0b0f676a0); Time taken: 0.009 seconds
INFO  : OK
No rows affected (0.032 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> -- Create a table that mixes supported  and unsupported scalar types.
0: jdbc:hive2://localhost:11050/default> -- We should be able to read the column  values of supported types and
0: jdbc:hive2://localhost:11050/default> -- fail queries that reference  columns  of unsupported types.
0: jdbc:hive2://localhost:11050/default> CREATE EXTERNAL TABLE IF NOT EXISTS fun ctional_orc_def.unsupported_types (
. . . . . . . . . . . . . . . . . . . .>   int_col INT,
. . . . . . . . . . . . . . . . . . . .>   dec_col DECIMAL,
. . . . . . . . . . . . . . . . . . . .>   date_col DATE,
. . . . . . . . . . . . . . . . . . . .>   str_col STRING,
. . . . . . . . . . . . . . . . . . . .>   bin_col BINARY,
. . . . . . . . . . . . . . . . . . . .>   bigint_col BIGINT)
. . . . . . . . . . . . . . . . . . . .> ROW FORMAT DELIMITED FIELDS TERMINATED  BY ','
. . . . . . . . . . . . . . . . . . . .> STORED AS ORC
. . . . . . . . . . . . . . . . . . . .> LOCATION '/test-warehouse/unsupported_t ypes_orc_def';
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153053_a1142fac-2a7a-425c-ba39-5c632412ebe8): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.unsupported_types (
int_col INT,
dec_col DECIMAL,
date_col DATE,
str_col STRING,
bin_col BINARY,
bigint_col BIGINT)
ROW FORMAT DELIMITED FIELDS TERMINATED BY ','
STORED AS ORC
LOCATION '/test-warehouse/unsupported_types_orc_def'
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153053_a1142fac-2a7a-425c-ba39-5c632412ebe8); Time taken: 0.005 seconds
INFO  : Executing command(queryId=ubuntu_20201009153053_a1142fac-2a7a-425c-ba39-5c632412ebe8): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.unsupported_types (
int_col INT,
dec_col DECIMAL,
date_col DATE,
str_col STRING,
bin_col BINARY,
bigint_col BIGINT)
ROW FORMAT DELIMITED FIELDS TERMINATED BY ','
STORED AS ORC
LOCATION '/test-warehouse/unsupported_types_orc_def'
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153053_a1142fac-2a7a-425c-ba39-5c632412ebe8); Time taken: 0.013 seconds
INFO  : OK
No rows affected (0.031 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> CREATE TABLE IF NOT EXISTS functional_o rc_def.full_transactional_table (
. . . . . . . . . . . . . . . . . . . .>   col1 int)
. . . . . . . . . . . . . . . . . . . .> STORED AS ORC
. . . . . . . . . . . . . . . . . . . .> TBLPROPERTIES('transactional'='true');
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153053_0e5460eb-bc51-4d8c-b3d9-bee69de99ffa): CREATE TABLE IF NOT EXISTS functional_orc_def.full_transactional_table (
col1 int)
STORED AS ORC
TBLPROPERTIES('transactional'='true')
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153053_0e5460eb-bc51-4d8c-b3d9-bee69de99ffa); Time taken: 0.006 seconds
INFO  : Executing command(queryId=ubuntu_20201009153053_0e5460eb-bc51-4d8c-b3d9-bee69de99ffa): CREATE TABLE IF NOT EXISTS functional_orc_def.full_transactional_table (
col1 int)
STORED AS ORC
TBLPROPERTIES('transactional'='true')
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153053_0e5460eb-bc51-4d8c-b3d9-bee69de99ffa); Time taken: 0.01 seconds
INFO  : OK
No rows affected (0.028 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> CREATE TABLE IF NOT EXISTS functional_o rc_def.insert_only_transactional_bucketed_table (
. . . . . . . . . . . . . . . . . . . .>   col1 int, col2 int)
. . . . . . . . . . . . . . . . . . . .> CLUSTERED BY (col1) INTO 5 BUCKETS
. . . . . . . . . . . . . . . . . . . .> STORED AS ORC
. . . . . . . . . . . . . . . . . . . .> TBLPROPERTIES('transactional'='true', ' transactional_properties'='insert_only');
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153053_f4d200c3-b2e2-4355-9136-0dfba6900b4d): CREATE TABLE IF NOT EXISTS functional_orc_def.insert_only_transactional_bucketed_table (
col1 int, col2 int)
CLUSTERED BY (col1) INTO 5 BUCKETS
STORED AS ORC
TBLPROPERTIES('transactional'='true', 'transactional_properties'='insert_only')
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153053_f4d200c3-b2e2-4355-9136-0dfba6900b4d); Time taken: 0.006 seconds
INFO  : Executing command(queryId=ubuntu_20201009153053_f4d200c3-b2e2-4355-9136-0dfba6900b4d): CREATE TABLE IF NOT EXISTS functional_orc_def.insert_only_transactional_bucketed_table (
col1 int, col2 int)
CLUSTERED BY (col1) INTO 5 BUCKETS
STORED AS ORC
TBLPROPERTIES('transactional'='true', 'transactional_properties'='insert_only')
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153053_f4d200c3-b2e2-4355-9136-0dfba6900b4d); Time taken: 0.013 seconds
INFO  : OK
No rows affected (0.03 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> CREATE EXTERNAL TABLE IF NOT EXISTS fun ctional_orc_def.bucketed_ext_table (
. . . . . . . . . . . . . . . . . . . .>   col1 int, col2 int)
. . . . . . . . . . . . . . . . . . . .> CLUSTERED BY (col1) INTO 5 BUCKETS
. . . . . . . . . . . . . . . . . . . .> STORED AS TEXTFILE
. . . . . . . . . . . . . . . . . . . .> LOCATION '/test-warehouse/functional_or c_defbucketed_ext_table';
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153053_4760be2e-3d73-4b2c-9e82-222f2e877004): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.bucketed_ext_table (
col1 int, col2 int)
CLUSTERED BY (col1) INTO 5 BUCKETS
STORED AS TEXTFILE
LOCATION '/test-warehouse/functional_orc_defbucketed_ext_table'
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153053_4760be2e-3d73-4b2c-9e82-222f2e877004); Time taken: 0.006 seconds
INFO  : Executing command(queryId=ubuntu_20201009153053_4760be2e-3d73-4b2c-9e82-222f2e877004): CREATE EXTERNAL TABLE IF NOT EXISTS functional_orc_def.bucketed_ext_table (
col1 int, col2 int)
CLUSTERED BY (col1) INTO 5 BUCKETS
STORED AS TEXTFILE
LOCATION '/test-warehouse/functional_orc_defbucketed_ext_table'
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153053_4760be2e-3d73-4b2c-9e82-222f2e877004); Time taken: 0.012 seconds
INFO  : OK
No rows affected (0.029 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> CREATE TABLE IF NOT EXISTS functional_o rc_def.bucketed_table (
. . . . . . . . . . . . . . . . . . . .>   col1 int, col2 int)
. . . . . . . . . . . . . . . . . . . .> CLUSTERED BY (col1) INTO 5 BUCKETS
. . . . . . . . . . . . . . . . . . . .> STORED AS ORC;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153053_803a0ed7-e94d-4c28-b575-5f0fa8daaf4a): CREATE TABLE IF NOT EXISTS functional_orc_def.bucketed_table (
col1 int, col2 int)
CLUSTERED BY (col1) INTO 5 BUCKETS
STORED AS ORC
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153053_803a0ed7-e94d-4c28-b575-5f0fa8daaf4a); Time taken: 0.005 seconds
INFO  : Executing command(queryId=ubuntu_20201009153053_803a0ed7-e94d-4c28-b575-5f0fa8daaf4a): CREATE TABLE IF NOT EXISTS functional_orc_def.bucketed_table (
col1 int, col2 int)
CLUSTERED BY (col1) INTO 5 BUCKETS
STORED AS ORC
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153053_803a0ed7-e94d-4c28-b575-5f0fa8daaf4a); Time taken: 0.008 seconds
INFO  : OK
No rows affected (0.024 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> -- The create materialized view command  is moved down so that the database's
0: jdbc:hive2://localhost:11050/default> -- managed directory has been created.  Otherwise the command would fail. This
0: jdbc:hive2://localhost:11050/default> -- is a bug in Hive.
0: jdbc:hive2://localhost:11050/default> CREATE MATERIALIZED VIEW IF NOT EXISTS  functional_orc_def.materialized_view
. . . . . . . . . . . . . . . . . . . .>   AS SELECT * FROM functional_orc_def.i nsert_only_transactional_table;
going to print operations logs
printed operations logs
going to print operations logs
INFO  : Compiling command(queryId=ubuntu_20201009153053_2eacbeec-a304-42e9-aaf5-2073a1d5e5d7): CREATE MATERIALIZED VIEW IF NOT EXISTS functional_orc_def.materialized_view
AS SELECT * FROM functional_orc_def.insert_only_transactional_table
INFO  : No Stats for functional_orc_def@insert_only_transactional_table, Columns: col1
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:col1, type:int, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153053_2eacbeec-a304-42e9-aaf5-2073a1d5e5d7); Time taken: 0.024 seconds
INFO  : Executing command(queryId=ubuntu_20201009153053_2eacbeec-a304-42e9-aaf5-2073a1d5e5d7): CREATE MATERIALIZED VIEW IF NOT EXISTS functional_orc_def.materialized_view
AS SELECT * FROM functional_orc_def.insert_only_transactional_table
INFO  : Query ID = ubuntu_20201009153053_2eacbeec-a304-42e9-aaf5-2073a1d5e5d7
INFO  : Total jobs = 3
INFO  : Launching Job 1 out of 3
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153053_2eacbeec-a304-42e9-aaf5-2073a1d5e5d7
INFO  : Tez session hasn't been created yet. Opening session
printed operations logs
going to print operations logs
printed operations logs
going to print operations logs
INFO  : Dag name: CREATE MATERIALIZED V..._transactional_table (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

INFO  : Starting task [Stage-7:CONDITIONAL] in serial mode
INFO  : Stage-4 is selected by condition resolver.
INFO  : Stage-3 is filtered out by condition resolver.
INFO  : Stage-5 is filtered out by condition resolver.
INFO  : Starting task [Stage-4:MOVE] in serial mode
INFO  : Moving data to directory hdfs://localhost:20500/test-warehouse/.hive-staging_hive_2020-10-09_15-30-53_348_3154285913512386791-16/-ext-10002 from hdfs://localhost:20500/test-warehouse/.hive-staging_hive_2020-10-09_15-30-53_348_3154285913512386791-16/-ext-10004
INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Moving data to directory hdfs://localhost:20500/test-warehouse/managed/functional_orc_def.db/materialized_view from hdfs://localhost:20500/test-warehouse/.hive-staging_hive_2020-10-09_15-30-53_348_3154285913512386791-16/-ext-10002
INFO  : Starting task [Stage-8:DDL] in serial mode
INFO  : Starting task [Stage-9:DDL] in serial mode
INFO  : No Stats for functional_orc_def@insert_only_transactional_table, Columns: col1
INFO  : Completed executing command(queryId=ubuntu_20201009153053_2eacbeec-a304-42e9-aaf5-2073a1d5e5d7); Time taken: 91.74 seconds
INFO  : OK
printed operations logs
[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container     SUCCEEDED      0          0        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/01  [>>--------------------------] 0%    ELAPSED TIME: 0.52 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[7A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container     SUCCEEDED      0          0        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/01  [>>--------------------------] 0%    ELAPSED TIME: 0.52 s     
[22;0m[2K----------------------------------------------------------------------------------------------
Getting log thread is interrupted, since query is done!
[7A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container     SUCCEEDED      0          0        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/01  [>>--------------------------] 0%    ELAPSED TIME: 0.52 s     
[22;0m[2K----------------------------------------------------------------------------------------------
No rows affected (91.783 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> CREATE TABLE functional_orc_def.uncomp_ src_alltypes LIKE functional.alltypes STORED AS ORC;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153225_c18e5fea-7054-4278-be55-550e21e9b9cd): CREATE TABLE functional_orc_def.uncomp_src_alltypes LIKE functional.alltypes STORED AS ORC
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153225_c18e5fea-7054-4278-be55-550e21e9b9cd); Time taken: 0.01 seconds
INFO  : Executing command(queryId=ubuntu_20201009153225_c18e5fea-7054-4278-be55-550e21e9b9cd): CREATE TABLE functional_orc_def.uncomp_src_alltypes LIKE functional.alltypes STORED AS ORC
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153225_c18e5fea-7054-4278-be55-550e21e9b9cd); Time taken: 0.018 seconds
INFO  : OK
No rows affected (0.04 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> CREATE TABLE functional_orc_def.uncomp_ src_decimal_tbl LIKE functional.decimal_tbl STORED AS ORC;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153225_88db6b98-7b21-4043-9e19-cd802f37ec59): CREATE TABLE functional_orc_def.uncomp_src_decimal_tbl LIKE functional.decimal_tbl STORED AS ORC
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153225_88db6b98-7b21-4043-9e19-cd802f37ec59); Time taken: 0.008 seconds
INFO  : Executing command(queryId=ubuntu_20201009153225_88db6b98-7b21-4043-9e19-cd802f37ec59): CREATE TABLE functional_orc_def.uncomp_src_decimal_tbl LIKE functional.decimal_tbl STORED AS ORC
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153225_88db6b98-7b21-4043-9e19-cd802f37ec59); Time taken: 0.014 seconds
INFO  : OK
No rows affected (0.033 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypes partition (year, month)
. . . . . . . . . . . . . . . . . . . .> SELECT id, bool_col, tinyint_col, small int_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col , timestamp_col, year, month
. . . . . . . . . . . . . . . . . . . .> FROM functional.alltypes;
going to print operations logs
printed operations logs
going to print operations logs
INFO  : Compiling command(queryId=ubuntu_20201009153225_231468b3-9a33-42eb-8d08-1b7c3f212f34): INSERT OVERWRITE TABLE functional_orc_def.alltypes partition (year, month)
SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month
FROM functional.alltypes
INFO  : No Stats for functional@alltypes, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153225_231468b3-9a33-42eb-8d08-1b7c3f212f34); Time taken: 0.063 seconds
INFO  : Executing command(queryId=ubuntu_20201009153225_231468b3-9a33-42eb-8d08-1b7c3f212f34): INSERT OVERWRITE TABLE functional_orc_def.alltypes partition (year, month)
SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month
FROM functional.alltypes
INFO  : Query ID = ubuntu_20201009153225_231468b3-9a33-42eb-8d08-1b7c3f212f34
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153225_231468b3-9a33-42eb-8d08-1b7c3f212f34
INFO  : Session is already open
INFO  : Dag name: INSERT OVERWRITE TABLE...functional.alltypes (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

printed operations logs
[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container        INITED     23          0        0       23       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [>>--------------------------] 0%    ELAPSED TIME: 1.43 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container        INITED     23          0        0       23       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [>>--------------------------] 0%    ELAPSED TIME: 1.93 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container        INITED     23          0        0       23       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [>>--------------------------] 0%    ELAPSED TIME: 2.43 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container        INITED     23          0        0       23       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [>>--------------------------] 0%    ELAPSED TIME: 2.93 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container        INITED     23          0        0       23       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [>>--------------------------] 0%    ELAPSED TIME: 3.43 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container        INITED     23          0        0       23       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [>>--------------------------] 0%    ELAPSED TIME: 3.93 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container       RUNNING     23          0        1       22       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [>>--------------------------] 0%    ELAPSED TIME: 4.44 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container       RUNNING     23          0        1       22       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [>>--------------------------] 0%    ELAPSED TIME: 4.94 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container       RUNNING     23          0        2       21       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [>>--------------------------] 0%    ELAPSED TIME: 5.44 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1            container       RUNNING     23          0        1       22       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [>>--------------------------] 0%    ELAPSED TIME: 5.94 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 ..         container       RUNNING     23          6        3       14       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [======>>--------------------] 25%   ELAPSED TIME: 6.44 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 ......     container       RUNNING     23         14        3        6       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [===============>>-----------] 58%   ELAPSED TIME: 6.94 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .........  container       RUNNING     23         21        1        1       0       0  
Reducer 2        container       RUNNING      1          0        1        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [======================>>----] 87%   ELAPSED TIME: 7.45 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .........  container       RUNNING     23         21        2        0       0       0  
Reducer 2        container       RUNNING      1          0        1        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [======================>>----] 87%   ELAPSED TIME: 7.95 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .........  container       RUNNING     23         22        1        0       0       0  
Reducer 2        container       RUNNING      1          0        1        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [=======================>>---] 91%   ELAPSED TIME: 8.45 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .........  container       RUNNING     23         22        1        0       0       0  
Reducer 2        container       RUNNING      1          0        1        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [=======================>>---] 91%   ELAPSED TIME: 8.95 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     23         23        0        0       0       0  
Reducer 2        container       RUNNING      1          0        1        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 01/02  [========================>>--] 95%   ELAPSED TIME: 9.45 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     23         23        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 9.95 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     23         23        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 10.20 s    
[22;0m[2K----------------------------------------------------------------------------------------------
Getting log thread is interrupted, since query is done!
INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.alltypes partition (year=null, month=null) from hdfs://localhost:20500/test-warehouse/managed/alltypes_orc_def
INFO  : 

INFO  : 	 Time taken to load dynamic partitions: 0.419 seconds
INFO  : 	 Time taken for adding to write entity : 0.001 seconds
INFO  : Completed executing command(queryId=ubuntu_20201009153225_231468b3-9a33-42eb-8d08-1b7c3f212f34); Time taken: 10.27 seconds
INFO  : OK
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     23         23        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 10.20 s    
[22;0m[2K----------------------------------------------------------------------------------------------
7,300 rows affected (10.346 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypessmall partition (year, month)
. . . . . . . . . . . . . . . . . . . .> SELECT id, bool_col, tinyint_col, small int_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col , timestamp_col, year, month
. . . . . . . . . . . . . . . . . . . .> FROM functional.alltypessmall;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153235_a3d0454e-326b-4290-b378-11862beac568): INSERT OVERWRITE TABLE functional_orc_def.alltypessmall partition (year, month)
SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month
FROM functional.alltypessmall
INFO  : No Stats for functional@alltypessmall, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153235_a3d0454e-326b-4290-b378-11862beac568); Time taken: 0.035 seconds
INFO  : Executing command(queryId=ubuntu_20201009153235_a3d0454e-326b-4290-b378-11862beac568): INSERT OVERWRITE TABLE functional_orc_def.alltypessmall partition (year, month)
SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month
FROM functional.alltypessmall
INFO  : Query ID = ubuntu_20201009153235_a3d0454e-326b-4290-b378-11862beac568
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153235_a3d0454e-326b-4290-b378-11862beac568
INFO  : Session is already open
INFO  : Dag name: INSERT OVERWRITE TABL...tional.alltypessmall (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.alltypessmall partition (year=null, month=null) from hdfs://localhost:20500/test-warehouse/managed/alltypessmall_orc_def
INFO  : 

INFO  : 	 Time taken to load dynamic partitions: 0.086 seconds
INFO  : 	 Time taken for adding to write entity : 0.001 seconds
INFO  : Completed executing command(queryId=ubuntu_20201009153235_a3d0454e-326b-4290-b378-11862beac568); Time taken: 0.53 seconds
INFO  : OK
100 rows affected (0.576 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.009 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypestiny partition (year, month)
. . . . . . . . . . . . . . . . . . . .> SELECT id, bool_col, tinyint_col, small int_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col , timestamp_col, year, month
. . . . . . . . . . . . . . . . . . . .> FROM functional.alltypestiny;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153236_1173239f-bea2-4685-b42b-9f16af7fec29): INSERT OVERWRITE TABLE functional_orc_def.alltypestiny partition (year, month)
SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month
FROM functional.alltypestiny
INFO  : No Stats for functional@alltypestiny, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153236_1173239f-bea2-4685-b42b-9f16af7fec29); Time taken: 0.035 seconds
INFO  : Executing command(queryId=ubuntu_20201009153236_1173239f-bea2-4685-b42b-9f16af7fec29): INSERT OVERWRITE TABLE functional_orc_def.alltypestiny partition (year, month)
SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month
FROM functional.alltypestiny
INFO  : Query ID = ubuntu_20201009153236_1173239f-bea2-4685-b42b-9f16af7fec29
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153236_1173239f-bea2-4685-b42b-9f16af7fec29
INFO  : Session is already open
INFO  : Dag name: INSERT OVERWRITE TABL...ctional.alltypestiny (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.alltypestiny partition (year=null, month=null) from hdfs://localhost:20500/test-warehouse/managed/alltypestiny_orc_def
INFO  : 

INFO  : 	 Time taken to load dynamic partitions: 0.084 seconds
INFO  : 	 Time taken for adding to write entity : 0.0 seconds
INFO  : Completed executing command(queryId=ubuntu_20201009153236_1173239f-bea2-4685-b42b-9f16af7fec29); Time taken: 0.474 seconds
INFO  : OK
8 rows affected (0.522 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> USE functional_orc_def;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153236_f261e1f9-cd0c-4fd0-9ad3-36fde03c11af): USE functional_orc_def
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153236_f261e1f9-cd0c-4fd0-9ad3-36fde03c11af); Time taken: 0.001 seconds
INFO  : Executing command(queryId=ubuntu_20201009153236_f261e1f9-cd0c-4fd0-9ad3-36fde03c11af): USE functional_orc_def
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153236_f261e1f9-cd0c-4fd0-9ad3-36fde03c11af); Time taken: 0.001 seconds
INFO  : OK
No rows affected (0.006 seconds)
0: jdbc:hive2://localhost:11050/default> -- Step 4: Stream the data from tmp tex t table to desired format tmp table
0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypeserror_tmp PARTITION (year, month)
. . . . . . . . . . . . . . . . . . . .> SELECT * FROM functional.alltypeserror_ tmp;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153236_d4f6264b-60e7-49bc-a775-4ab1af148dcb): INSERT OVERWRITE TABLE functional_orc_def.alltypeserror_tmp PARTITION (year, month)
SELECT * FROM functional.alltypeserror_tmp
INFO  : No Stats for functional@alltypeserror_tmp, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:alltypeserror_tmp.id, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.bool_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.tinyint_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.smallint_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.int_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.bigint_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.float_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.double_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.date_string_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.string_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.timestamp_col, type:string, comment:null), FieldSchema(name:alltypeserror_tmp.year, type:int, comment:null), FieldSchema(name:alltypeserror_tmp.month, type:int, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153236_d4f6264b-60e7-49bc-a775-4ab1af148dcb); Time taken: 0.034 seconds
INFO  : Executing command(queryId=ubuntu_20201009153236_d4f6264b-60e7-49bc-a775-4ab1af148dcb): INSERT OVERWRITE TABLE functional_orc_def.alltypeserror_tmp PARTITION (year, month)
SELECT * FROM functional.alltypeserror_tmp
INFO  : Query ID = ubuntu_20201009153236_d4f6264b-60e7-49bc-a775-4ab1af148dcb
INFO  : Total jobs = 3
INFO  : Launching Job 1 out of 3
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153236_d4f6264b-60e7-49bc-a775-4ab1af148dcb
INFO  : Session is already open
INFO  : Dag name: INSERT OVERWRITE TABL...al.alltypeserror_tmp (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

INFO  : Starting task [Stage-7:CONDITIONAL] in serial mode
INFO  : Stage-4 is selected by condition resolver.
INFO  : Stage-3 is filtered out by condition resolver.
INFO  : Stage-5 is filtered out by condition resolver.
INFO  : Starting task [Stage-4:MOVE] in serial mode
INFO  : Moving data to directory hdfs://localhost:20500/test-warehouse/alltypeserror_orc_def/.hive-staging_hive_2020-10-09_15-32-36_806_4118237371186169817-16/-ext-10000 from hdfs://localhost:20500/test-warehouse/alltypeserror_orc_def/.hive-staging_hive_2020-10-09_15-32-36_806_4118237371186169817-16/-ext-10002
INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.alltypeserror_tmp partition (year=null, month=null) from hdfs://localhost:20500/test-warehouse/alltypeserror_orc_def/.hive-staging_hive_2020-10-09_15-32-36_806_4118237371186169817-16/-ext-10000
INFO  : 

INFO  : 	 Time taken to load dynamic partitions: 0.137 seconds
INFO  : 	 Time taken for adding to write entity : 0.001 seconds
INFO  : Completed executing command(queryId=ubuntu_20201009153236_d4f6264b-60e7-49bc-a775-4ab1af148dcb); Time taken: 0.643 seconds
INFO  : OK
31 rows affected (0.685 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> -- Cleanup the temp table
0: jdbc:hive2://localhost:11050/default> DROP TABLE IF EXISTS functional_orc_def .alltypeserror_tmp;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153237_eb5a8f1d-3830-4c76-9855-739b237ddbf8): DROP TABLE IF EXISTS functional_orc_def.alltypeserror_tmp
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153237_eb5a8f1d-3830-4c76-9855-739b237ddbf8); Time taken: 0.007 seconds
INFO  : Executing command(queryId=ubuntu_20201009153237_eb5a8f1d-3830-4c76-9855-739b237ddbf8): DROP TABLE IF EXISTS functional_orc_def.alltypeserror_tmp
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153237_eb5a8f1d-3830-4c76-9855-739b237ddbf8); Time taken: 0.042 seconds
INFO  : OK
No rows affected (0.057 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.006 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> INSERT INTO TABLE functional_orc_def.al ltypes_promoted SELECT * FROM functional_orc_def.alltypes;
going to print operations logs
printed operations logs
going to print operations logs
INFO  : Compiling command(queryId=ubuntu_20201009153237_25483d5f-be8b-450c-8aef-8eb99c4953a7): INSERT INTO TABLE functional_orc_def.alltypes_promoted SELECT * FROM functional_orc_def.alltypes
INFO  : No Stats for functional_orc_def@alltypes, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:alltypes.id, type:int, comment:null), FieldSchema(name:alltypes.bool_col, type:boolean, comment:null), FieldSchema(name:alltypes.tinyint_col, type:tinyint, comment:null), FieldSchema(name:alltypes.smallint_col, type:smallint, comment:null), FieldSchema(name:alltypes.int_col, type:int, comment:null), FieldSchema(name:alltypes.bigint_col, type:bigint, comment:null), FieldSchema(name:alltypes.float_col, type:float, comment:null), FieldSchema(name:alltypes.double_col, type:double, comment:null), FieldSchema(name:alltypes.date_string_col, type:string, comment:null), FieldSchema(name:alltypes.string_col, type:string, comment:null), FieldSchema(name:alltypes.timestamp_col, type:timestamp, comment:null), FieldSchema(name:alltypes.year, type:int, comment:null), FieldSchema(name:alltypes.month, type:int, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153237_25483d5f-be8b-450c-8aef-8eb99c4953a7); Time taken: 0.054 seconds
INFO  : Executing command(queryId=ubuntu_20201009153237_25483d5f-be8b-450c-8aef-8eb99c4953a7): INSERT INTO TABLE functional_orc_def.alltypes_promoted SELECT * FROM functional_orc_def.alltypes
INFO  : Query ID = ubuntu_20201009153237_25483d5f-be8b-450c-8aef-8eb99c4953a7
INFO  : Total jobs = 3
INFO  : Launching Job 1 out of 3
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153237_25483d5f-be8b-450c-8aef-8eb99c4953a7
INFO  : Session is already open
INFO  : Dag name: INSERT INTO TABLE fun...nal_orc_def.alltypes (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

printed operations logs
[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .........  container       RUNNING     24         23        0        1       0       0  
Reducer 2        container        INITED      1          0        0        1       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 00/02  [=======================>>---] 92%   ELAPSED TIME: 1.45 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     24         24        0        0       0       0  
Reducer 2        container       RUNNING      1          0        1        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 01/02  [========================>>--] 95%   ELAPSED TIME: 1.95 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     24         24        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 2.18 s     
[22;0m[2K----------------------------------------------------------------------------------------------
Getting log thread is interrupted, since query is done!
INFO  : Starting task [Stage-7:CONDITIONAL] in serial mode
INFO  : Stage-4 is selected by condition resolver.
INFO  : Stage-3 is filtered out by condition resolver.
INFO  : Stage-5 is filtered out by condition resolver.
INFO  : Starting task [Stage-4:MOVE] in serial mode
INFO  : Moving data to directory hdfs://localhost:20500/test-warehouse/alltypes_promoted_orc_def/.hive-staging_hive_2020-10-09_15-32-37_591_8632247233033606228-16/-ext-10000 from hdfs://localhost:20500/test-warehouse/alltypes_promoted_orc_def/.hive-staging_hive_2020-10-09_15-32-37_591_8632247233033606228-16/-ext-10002
INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.alltypes_promoted partition (year=null, month=null) from hdfs://localhost:20500/test-warehouse/alltypes_promoted_orc_def/.hive-staging_hive_2020-10-09_15-32-37_591_8632247233033606228-16/-ext-10000
INFO  : 

INFO  : 	 Time taken to load dynamic partitions: 0.102 seconds
INFO  : 	 Time taken for adding to write entity : 0.0 seconds
INFO  : Completed executing command(queryId=ubuntu_20201009153237_25483d5f-be8b-450c-8aef-8eb99c4953a7); Time taken: 2.218 seconds
INFO  : OK
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     24         24        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 2.18 s     
[22;0m[2K----------------------------------------------------------------------------------------------
7,300 rows affected (2.287 seconds)
0: jdbc:hive2://localhost:11050/default> ALTER TABLE functional_orc_def.alltypes _promoted SET tblproperties('EXTERNAL'='FALSE','transactional'='true');
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153239_c7805267-cfb2-4a1f-ade0-efb6c33b9bcd): ALTER TABLE functional_orc_def.alltypes_promoted SET tblproperties('EXTERNAL'='FALSE','transactional'='true')
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153239_c7805267-cfb2-4a1f-ade0-efb6c33b9bcd); Time taken: 0.013 seconds
INFO  : Executing command(queryId=ubuntu_20201009153239_c7805267-cfb2-4a1f-ade0-efb6c33b9bcd): ALTER TABLE functional_orc_def.alltypes_promoted SET tblproperties('EXTERNAL'='FALSE','transactional'='true')
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153239_c7805267-cfb2-4a1f-ade0-efb6c33b9bcd); Time taken: 0.073 seconds
INFO  : OK
No rows affected (0.095 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> USE functional_orc_def;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153240_113ec5cd-4c4a-4754-ad3a-b4f2a7f372cf): USE functional_orc_def
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153240_113ec5cd-4c4a-4754-ad3a-b4f2a7f372cf); Time taken: 0.001 seconds
INFO  : Executing command(queryId=ubuntu_20201009153240_113ec5cd-4c4a-4754-ad3a-b4f2a7f372cf): USE functional_orc_def
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153240_113ec5cd-4c4a-4754-ad3a-b4f2a7f372cf); Time taken: 0.001 seconds
INFO  : OK
No rows affected (0.006 seconds)
0: jdbc:hive2://localhost:11050/default> -- Step 4: Stream the data from tmp tex t table to desired format tmp table
0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypeserrornonulls_tmp PARTITION (year, month)
. . . . . . . . . . . . . . . . . . . .> SELECT * FROM functional.alltypeserrorn onulls_tmp;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153240_21c0cf0f-17dd-4d49-98a0-0d0f0bb524f7): INSERT OVERWRITE TABLE functional_orc_def.alltypeserrornonulls_tmp PARTITION (year, month)
SELECT * FROM functional.alltypeserrornonulls_tmp
INFO  : No Stats for functional@alltypeserrornonulls_tmp, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:alltypeserrornonulls_tmp.id, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.bool_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.tinyint_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.smallint_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.int_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.bigint_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.float_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.double_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.date_string_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.string_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.timestamp_col, type:string, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.year, type:int, comment:null), FieldSchema(name:alltypeserrornonulls_tmp.month, type:int, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153240_21c0cf0f-17dd-4d49-98a0-0d0f0bb524f7); Time taken: 0.033 seconds
INFO  : Executing command(queryId=ubuntu_20201009153240_21c0cf0f-17dd-4d49-98a0-0d0f0bb524f7): INSERT OVERWRITE TABLE functional_orc_def.alltypeserrornonulls_tmp PARTITION (year, month)
SELECT * FROM functional.alltypeserrornonulls_tmp
INFO  : Query ID = ubuntu_20201009153240_21c0cf0f-17dd-4d49-98a0-0d0f0bb524f7
INFO  : Total jobs = 3
INFO  : Launching Job 1 out of 3
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153240_21c0cf0f-17dd-4d49-98a0-0d0f0bb524f7
INFO  : Session is already open
INFO  : Dag name: INSERT OVERWRITE TABL...ypeserrornonulls_tmp (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

INFO  : Starting task [Stage-7:CONDITIONAL] in serial mode
INFO  : Stage-4 is selected by condition resolver.
INFO  : Stage-3 is filtered out by condition resolver.
INFO  : Stage-5 is filtered out by condition resolver.
INFO  : Starting task [Stage-4:MOVE] in serial mode
INFO  : Moving data to directory hdfs://localhost:20500/test-warehouse/alltypeserrornonulls_orc_def/.hive-staging_hive_2020-10-09_15-32-40_012_6830882231651252540-16/-ext-10000 from hdfs://localhost:20500/test-warehouse/alltypeserrornonulls_orc_def/.hive-staging_hive_2020-10-09_15-32-40_012_6830882231651252540-16/-ext-10002
INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.alltypeserrornonulls_tmp partition (year=null, month=null) from hdfs://localhost:20500/test-warehouse/alltypeserrornonulls_orc_def/.hive-staging_hive_2020-10-09_15-32-40_012_6830882231651252540-16/-ext-10000
INFO  : 

INFO  : 	 Time taken to load dynamic partitions: 0.098 seconds
INFO  : 	 Time taken for adding to write entity : 0.001 seconds
INFO  : Completed executing command(queryId=ubuntu_20201009153240_21c0cf0f-17dd-4d49-98a0-0d0f0bb524f7); Time taken: 0.548 seconds
INFO  : OK
30 rows affected (0.589 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> -- Cleanup the temp table
0: jdbc:hive2://localhost:11050/default> DROP TABLE IF EXISTS functional_orc_def .alltypeserrornonulls_tmp;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153240_50adbac1-9d8c-4f86-8586-84e9d3d82757): DROP TABLE IF EXISTS functional_orc_def.alltypeserrornonulls_tmp
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153240_50adbac1-9d8c-4f86-8586-84e9d3d82757); Time taken: 0.007 seconds
INFO  : Executing command(queryId=ubuntu_20201009153240_50adbac1-9d8c-4f86-8586-84e9d3d82757): DROP TABLE IF EXISTS functional_orc_def.alltypeserrornonulls_tmp
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing command(queryId=ubuntu_20201009153240_50adbac1-9d8c-4f86-8586-84e9d3d82757); Time taken: 0.034 seconds
INFO  : OK
No rows affected (0.047 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> INSERT INTO TABLE functional_orc_def.al ltypes_deleted_rows SELECT * FROM functional_orc_def.alltypes;
going to print operations logs
printed operations logs
going to print operations logs
INFO  : Compiling command(queryId=ubuntu_20201009153240_06cb6ff7-5afd-48a3-8788-c37fd5d7b80a): INSERT INTO TABLE functional_orc_def.alltypes_deleted_rows SELECT * FROM functional_orc_def.alltypes
INFO  : No Stats for functional_orc_def@alltypes, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:alltypes.id, type:int, comment:null), FieldSchema(name:alltypes.bool_col, type:boolean, comment:null), FieldSchema(name:alltypes.tinyint_col, type:tinyint, comment:null), FieldSchema(name:alltypes.smallint_col, type:smallint, comment:null), FieldSchema(name:alltypes.int_col, type:int, comment:null), FieldSchema(name:alltypes.bigint_col, type:bigint, comment:null), FieldSchema(name:alltypes.float_col, type:float, comment:null), FieldSchema(name:alltypes.double_col, type:double, comment:null), FieldSchema(name:alltypes.date_string_col, type:string, comment:null), FieldSchema(name:alltypes.string_col, type:string, comment:null), FieldSchema(name:alltypes.timestamp_col, type:timestamp, comment:null), FieldSchema(name:alltypes.year, type:int, comment:null), FieldSchema(name:alltypes.month, type:int, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153240_06cb6ff7-5afd-48a3-8788-c37fd5d7b80a); Time taken: 0.042 seconds
INFO  : Executing command(queryId=ubuntu_20201009153240_06cb6ff7-5afd-48a3-8788-c37fd5d7b80a): INSERT INTO TABLE functional_orc_def.alltypes_deleted_rows SELECT * FROM functional_orc_def.alltypes
INFO  : Query ID = ubuntu_20201009153240_06cb6ff7-5afd-48a3-8788-c37fd5d7b80a
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153240_06cb6ff7-5afd-48a3-8788-c37fd5d7b80a
INFO  : Session is already open
INFO  : Dag name: INSERT INTO TABLE fun...nal_orc_def.alltypes (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

printed operations logs
[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     24         24        0        0       0       0  
Reducer 2        container       RUNNING      1          0        1        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 01/02  [========================>>--] 95%   ELAPSED TIME: 1.45 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     24         24        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 1.96 s     
[22;0m[2K----------------------------------------------------------------------------------------------
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     24         24        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 2.30 s     
[22;0m[2K----------------------------------------------------------------------------------------------
Getting log thread is interrupted, since query is done!
INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.alltypes_deleted_rows partition (year=null, month=null) from hdfs://localhost:20500/test-warehouse/managed/alltypes_deleted_rows_orc_def
INFO  : 

INFO  : 	 Time taken to load dynamic partitions: 0.342 seconds
INFO  : 	 Time taken for adding to write entity : 0.0 seconds
INFO  : Completed executing command(queryId=ubuntu_20201009153240_06cb6ff7-5afd-48a3-8788-c37fd5d7b80a); Time taken: 2.335 seconds
INFO  : OK
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     24         24        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 2.30 s     
[22;0m[2K----------------------------------------------------------------------------------------------
7,300 rows affected (2.391 seconds)
0: jdbc:hive2://localhost:11050/default> DELETE FROM functional_orc_def.alltypes _deleted_rows WHERE month % 2 = 0 and year % 2 = 0 and id % 10 = 0;
going to print operations logs
printed operations logs
going to print operations logs
INFO  : Compiling command(queryId=ubuntu_20201009153243_931806b6-c4b4-44a2-b08d-fd0134032056): DELETE FROM functional_orc_def.alltypes_deleted_rows WHERE month % 2 = 0 and year % 2 = 0 and id % 10 = 0
INFO  : No Stats for functional_orc_def@alltypes_deleted_rows, Columns: id
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:row__id, type:struct<writeid:bigint,bucketid:int,rowid:bigint>, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153243_931806b6-c4b4-44a2-b08d-fd0134032056); Time taken: 0.097 seconds
INFO  : Executing command(queryId=ubuntu_20201009153243_931806b6-c4b4-44a2-b08d-fd0134032056): DELETE FROM functional_orc_def.alltypes_deleted_rows WHERE month % 2 = 0 and year % 2 = 0 and id % 10 = 0
INFO  : Query ID = ubuntu_20201009153243_931806b6-c4b4-44a2-b08d-fd0134032056
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153243_931806b6-c4b4-44a2-b08d-fd0134032056
INFO  : Session is already open
INFO  : Dag name: DELETE FROM functional_orc_def.alltypes_...0 (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

printed operations logs
[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED      6          6        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 1.09 s     
[22;0m[2K----------------------------------------------------------------------------------------------
Getting log thread is interrupted, since query is done!
INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.alltypes_deleted_rows partition (year=null, month=null) from hdfs://localhost:20500/test-warehouse/managed/alltypes_deleted_rows_orc_def/.hive-staging_hive_2020-10-09_15-32-43_085_2154617677139046394-16/-ext-10000
INFO  : 

INFO  : 	 Time taken to load dynamic partitions: 0.119 seconds
INFO  : 	 Time taken for adding to write entity : 0.0 seconds
INFO  : Completed executing command(queryId=ubuntu_20201009153243_931806b6-c4b4-44a2-b08d-fd0134032056); Time taken: 1.123 seconds
INFO  : OK
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED      6          6        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 1.09 s     
[22;0m[2K----------------------------------------------------------------------------------------------
181 rows affected (1.236 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypesagg partition (year, month, day)
. . . . . . . . . . . . . . . . . . . .> SELECT id, bool_col, tinyint_col, small int_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col , timestamp_col, year, month, day
. . . . . . . . . . . . . . . . . . . .> FROM functional.alltypesagg;
going to print operations logs
printed operations logs
going to print operations logs
INFO  : Compiling command(queryId=ubuntu_20201009153244_3c8e2172-9124-4043-b3f5-742c8d771de4): INSERT OVERWRITE TABLE functional_orc_def.alltypesagg partition (year, month, day)
SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day
FROM functional.alltypesagg
INFO  : No Stats for functional@alltypesagg, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null), FieldSchema(name:day, type:int, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153244_3c8e2172-9124-4043-b3f5-742c8d771de4); Time taken: 0.058 seconds
INFO  : Executing command(queryId=ubuntu_20201009153244_3c8e2172-9124-4043-b3f5-742c8d771de4): INSERT OVERWRITE TABLE functional_orc_def.alltypesagg partition (year, month, day)
SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day
FROM functional.alltypesagg
INFO  : Query ID = ubuntu_20201009153244_3c8e2172-9124-4043-b3f5-742c8d771de4
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153244_3c8e2172-9124-4043-b3f5-742c8d771de4
INFO  : Session is already open
INFO  : Dag name: INSERT OVERWRITE TABL...nctional.alltypesagg (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

printed operations logs
[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     11         11        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 1.26 s     
[22;0m[2K----------------------------------------------------------------------------------------------
Getting log thread is interrupted, since query is done!
INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.alltypesagg partition (year=null, month=null, day=null) from hdfs://localhost:20500/test-warehouse/managed/alltypesagg_orc_def
INFO  : 

INFO  : 	 Time taken to load dynamic partitions: 0.184 seconds
INFO  : 	 Time taken for adding to write entity : 0.001 seconds
INFO  : Completed executing command(queryId=ubuntu_20201009153244_3c8e2172-9124-4043-b3f5-742c8d771de4); Time taken: 1.295 seconds
INFO  : OK
[8A[2K----------------------------------------------------------------------------------------------
[2K[36;1m        VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
[22;0m[2K----------------------------------------------------------------------------------------------
[2KMap 1 .......... container     SUCCEEDED     11         11        0        0       0       0  
Reducer 2 ...... container     SUCCEEDED      1          1        0        0       0       0  
[2K----------------------------------------------------------------------------------------------
[2K[31;1mVERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 1.26 s     
[22;0m[2K----------------------------------------------------------------------------------------------
11,000 rows affected (1.37 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.alltypesaggnonulls partition (year, month, day)
. . . . . . . . . . . . . . . . . . . .> SELECT id, bool_col, tinyint_col, small int_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col , timestamp_col, year, month, day
. . . . . . . . . . . . . . . . . . . .> FROM functional.alltypesaggnonulls;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153245_929e4261-2151-46ab-aa76-ded4e717e17d): INSERT OVERWRITE TABLE functional_orc_def.alltypesaggnonulls partition (year, month, day)
SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day
FROM functional.alltypesaggnonulls
INFO  : No Stats for functional@alltypesaggnonulls, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null), FieldSchema(name:day, type:int, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153245_929e4261-2151-46ab-aa76-ded4e717e17d); Time taken: 0.033 seconds
INFO  : Executing command(queryId=ubuntu_20201009153245_929e4261-2151-46ab-aa76-ded4e717e17d): INSERT OVERWRITE TABLE functional_orc_def.alltypesaggnonulls partition (year, month, day)
SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day
FROM functional.alltypesaggnonulls
INFO  : Query ID = ubuntu_20201009153245_929e4261-2151-46ab-aa76-ded4e717e17d
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153245_929e4261-2151-46ab-aa76-ded4e717e17d
INFO  : Session is already open
INFO  : Dag name: INSERT OVERWRITE TABL...l.alltypesaggnonulls (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.alltypesaggnonulls partition (year=null, month=null, day=null) from hdfs://localhost:20500/test-warehouse/managed/alltypesaggnonulls_orc_def
INFO  : 

INFO  : 	 Time taken to load dynamic partitions: 0.179 seconds
INFO  : 	 Time taken for adding to write entity : 0.001 seconds
INFO  : Completed executing command(queryId=ubuntu_20201009153245_929e4261-2151-46ab-aa76-ded4e717e17d); Time taken: 0.918 seconds
INFO  : OK
10,000 rows affected (0.963 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> INSERT OVERWRITE TABLE functional_orc_d ef.complextypestbl SELECT * FROM functional_parquet.complextypestbl;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153246_fb883ee0-9f93-4bac-ad91-4286d6ecb7be): INSERT OVERWRITE TABLE functional_orc_def.complextypestbl SELECT * FROM functional_parquet.complextypestbl
INFO  : No Stats for functional_parquet@complextypestbl, Columns: int_array, int_map_array, id, int_array_array, nested_struct, int_map
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:complextypestbl.id, type:bigint, comment:null), FieldSchema(name:complextypestbl.int_array, type:array<int>, comment:null), FieldSchema(name:complextypestbl.int_array_array, type:array<array<int>>, comment:null), FieldSchema(name:complextypestbl.int_map, type:map<string,int>, comment:null), FieldSchema(name:complextypestbl.int_map_array, type:array<map<string,int>>, comment:null), FieldSchema(name:complextypestbl.nested_struct, type:struct<a:int,b:array<int>,c:struct<d:array<array<struct<e:int,f:string>>>>,g:map<string,struct<h:struct<i:array<double>>>>>, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153246_fb883ee0-9f93-4bac-ad91-4286d6ecb7be); Time taken: 0.044 seconds
INFO  : Executing command(queryId=ubuntu_20201009153246_fb883ee0-9f93-4bac-ad91-4286d6ecb7be): INSERT OVERWRITE TABLE functional_orc_def.complextypestbl SELECT * FROM functional_parquet.complextypestbl
INFO  : Query ID = ubuntu_20201009153246_fb883ee0-9f93-4bac-ad91-4286d6ecb7be
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153246_fb883ee0-9f93-4bac-ad91-4286d6ecb7be
INFO  : Session is already open
INFO  : Dag name: INSERT OVERWRITE TABL...quet.complextypestbl (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.complextypestbl from hdfs://localhost:20500/test-warehouse/managed/complextypestbl_orc_def
INFO  : Completed executing command(queryId=ubuntu_20201009153246_fb883ee0-9f93-4bac-ad91-4286d6ecb7be); Time taken: 0.624 seconds
INFO  : OK
8 rows affected (0.681 seconds)
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> 
0: jdbc:hive2://localhost:11050/default> SET hive.exec.compress.output=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.type=BLOC K;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.output.compression.codec=org .apache.hadoop.io.compress.DefaultCodec;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition.mode=no nstrict;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.dynamic.partition=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions=10 000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.exec.max.dynamic.partitions.pe rnode=10000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> set hive.auto.convert.join=true;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET mapred.max.split.size=256000000;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.002 seconds)
0: jdbc:hive2://localhost:11050/default> SET hive.input.format=org.apache.hadoop .hive.ql.io.HiveInputFormat;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
No rows affected (0.001 seconds)
0: jdbc:hive2://localhost:11050/default> INSERT INTO TABLE functional_orc_def.co mplextypestbl_minor_compacted SELECT * FROM functional_orc_def.complextypestbl w here id = 1;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153247_6dd7e771-ae31-480f-8569-a046ff0c75e1): INSERT INTO TABLE functional_orc_def.complextypestbl_minor_compacted SELECT * FROM functional_orc_def.complextypestbl where id = 1
INFO  : No Stats for functional_orc_def@complextypestbl, Columns: int_array, int_map_array, id, int_array_array, nested_struct, int_map
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:complextypestbl.id, type:bigint, comment:null), FieldSchema(name:complextypestbl.int_array, type:array<int>, comment:null), FieldSchema(name:complextypestbl.int_array_array, type:array<array<int>>, comment:null), FieldSchema(name:complextypestbl.int_map, type:map<string,int>, comment:null), FieldSchema(name:complextypestbl.int_map_array, type:array<map<string,int>>, comment:null), FieldSchema(name:complextypestbl.nested_struct, type:struct<a:int,b:array<int>,c:struct<d:array<array<struct<e:int,f:string>>>>,g:map<string,struct<h:struct<i:array<double>>>>>, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153247_6dd7e771-ae31-480f-8569-a046ff0c75e1); Time taken: 0.034 seconds
INFO  : Executing command(queryId=ubuntu_20201009153247_6dd7e771-ae31-480f-8569-a046ff0c75e1): INSERT INTO TABLE functional_orc_def.complextypestbl_minor_compacted SELECT * FROM functional_orc_def.complextypestbl where id = 1
INFO  : Query ID = ubuntu_20201009153247_6dd7e771-ae31-480f-8569-a046ff0c75e1
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153247_6dd7e771-ae31-480f-8569-a046ff0c75e1
INFO  : Session is already open
INFO  : Dag name: INSERT INTO TABLE functional_orc_def.com...1 (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Loading data to table functional_orc_def.complextypestbl_minor_compacted from hdfs://localhost:20500/test-warehouse/managed/complextypestbl_minor_compacted_orc_def
INFO  : Completed executing command(queryId=ubuntu_20201009153247_6dd7e771-ae31-480f-8569-a046ff0c75e1); Time taken: 0.353 seconds
INFO  : OK
1 row affected (0.398 seconds)
0: jdbc:hive2://localhost:11050/default> INSERT INTO TABLE functional_orc_def.co mplextypestbl_minor_compacted SELECT * FROM functional_orc_def.complextypestbl w here id = 2;
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
INFO  : Compiling command(queryId=ubuntu_20201009153247_d47e23f0-e146-44ba-b764-99d8eb557e0a): INSERT INTO TABLE functional_orc_def.complextypestbl_minor_compacted SELECT * FROM functional_orc_def.complextypestbl where id = 2
INFO  : No Stats for functional_orc_def@complextypestbl, Columns: int_array, int_map_array, id, int_array_array, nested_struct, int_map
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:complextypestbl.id, type:bigint, comment:null), FieldSchema(name:complextypestbl.int_array, type:array<int>, comment:null), FieldSchema(name:complextypestbl.int_array_array, type:array<array<int>>, comment:null), FieldSchema(name:complextypestbl.int_map, type:map<string,int>, comment:null), FieldSchema(name:complextypestbl.int_map_array, type:array<map<string,int>>, comment:null), FieldSchema(name:complextypestbl.nested_struct, type:struct<a:int,b:array<int>,c:struct<d:array<array<struct<e:int,f:string>>>>,g:map<string,struct<h:struct<i:array<double>>>>>, comment:null)], properties:null)
INFO  : Completed compiling command(queryId=ubuntu_20201009153247_d47e23f0-e146-44ba-b764-99d8eb557e0a); Time taken: 0.031 seconds
INFO  : Executing command(queryId=ubuntu_20201009153247_d47e23f0-e146-44ba-b764-99d8eb557e0a): INSERT INTO TABLE functional_orc_def.complextypestbl_minor_compacted SELECT * FROM functional_orc_def.complextypestbl where id = 2
INFO  : Query ID = ubuntu_20201009153247_d47e23f0-e146-44ba-b764-99d8eb557e0a
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Subscribed to counters: [] for queryId: ubuntu_20201009153247_d47e23f0-e146-44ba-b764-99d8eb557e0a
INFO  : Session is already open
INFO  : Dag name: INSERT INTO TABLE functional_orc_def.com...2 (Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id application_1602256773801_0012)

ERROR : Job Commit failed with exception 'org.apache.hadoop.hive.ql.metadata.HiveException(java.io.EOFException)'
org.apache.hadoop.hive.ql.metadata.HiveException: java.io.EOFException
	at org.apache.hadoop.hive.ql.exec.FileSinkOperator.jobCloseOp(FileSinkOperator.java:1468)
	at org.apache.hadoop.hive.ql.exec.Operator.jobClose(Operator.java:798)
	at org.apache.hadoop.hive.ql.exec.Operator.jobClose(Operator.java:803)
	at org.apache.hadoop.hive.ql.exec.Operator.jobClose(Operator.java:803)
	at org.apache.hadoop.hive.ql.exec.Operator.jobClose(Operator.java:803)
	at org.apache.hadoop.hive.ql.exec.tez.TezTask.close(TezTask.java:627)
	at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:342)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:213)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105)
	at org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:357)
	at org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:330)
	at org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:246)
	at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:109)
	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:721)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:488)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:482)
	at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:166)
	at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:225)
	at org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:87)
	at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:322)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
	at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:340)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.EOFException
	at java.io.DataInputStream.readInt(DataInputStream.java:392)
	at org.apache.hadoop.hive.ql.exec.Utilities.handleDirectInsertTableFinalPath(Utilities.java:4587)
	at org.apache.hadoop.hive.ql.exec.FileSinkOperator.jobCloseOp(FileSinkOperator.java:1462)
	... 30 more

ERROR : FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.tez.TezTask
INFO  : Completed executing command(queryId=ubuntu_20201009153247_d47e23f0-e146-44ba-b764-99d8eb557e0a); Time taken: 0.587 seconds
INFO  : OK
Error: Error while compiling statement: FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.tez.TezTask (state=08S01,code=3)
java.sql.SQLException: Error while compiling statement: FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.tez.TezTask
	at org.apache.hive.jdbc.HiveStatement.waitForOperationToComplete(HiveStatement.java:401)
	at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:266)
	at org.apache.hive.beeline.Commands.executeInternal(Commands.java:1007)
	at org.apache.hive.beeline.Commands.execute(Commands.java:1217)
	at org.apache.hive.beeline.Commands.sql(Commands.java:1146)
	at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1497)
	at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1355)
	at org.apache.hive.beeline.BeeLine.executeFile(BeeLine.java:1329)
	at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1127)
	at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1082)
	at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:546)
	at org.apache.hive.beeline.BeeLine.main(BeeLine.java:528)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:232)
Closing: 0: jdbc:hive2://localhost:11050/default;auth=none
