[IMPALA-7143] TestDescribeTableResults started failing because of OwnerType

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 3.1.0
• Fix Version/s: Impala 2.13.0, Impala 3.1.0
• Component/s: Frontend
• Labels: broken-build
• Target Version: Impala 2.13.0, Impala 3.1.0
• Epic Color: ghx-label-6
• Assignee: Tim Armstrong
• Reporter: Tim Armstrong
• Created: 07/Jun/18 15:28
• Updated: 07/Jun/18 22:31
• Resolved: 07/Jun/18 17:12

Description

23:27:32   AuthorizationTest.TestDescribeTableResults:1963->verifyOutputWithOptionalData:1988 Size difference. Expected: [# col_name, data_type, comment, , NULL, NULL, id, int, NULL, bool_col, boolean, NULL, tinyint_col, tinyint, NULL, smallint_col, smallint, NULL, int_col, int, NULL, bigint_col, bigint, NULL, float_col, float, NULL, double_col, double, NULL, date_string_col, string, NULL, string_col, string, NULL, timestamp_col, timestamp, NULL, , NULL, NULL, # Partition Information, NULL, NULL, # col_name, data_type, comment, , NULL, NULL, year, int, NULL, month, int, NULL, day, int, NULL, , NULL, NULL, # Detailed Table Information, NULL, NULL, Database:, functional, NULL, Owner:, *, NULL, CreateTime:, *, NULL, LastAccessTime:, UNKNOWN, NULL, Retention:, 0, NULL, Location:, hdfs://localhost:20500/test-warehouse/alltypesagg, NULL, Table Type:, EXTERNAL_TABLE, NULL, Table Parameters:, NULL, NULL, , DO_NOT_UPDATE_STATS, true, , EXTERNAL, TRUE, , STATS_GENERATED, TASK, , impala.lastComputeStatsTime, *, , numRows, 11000, , totalSize, 834279, , transient_lastDdlTime, *, , NULL, NULL, # Storage Information, NULL, NULL, SerDe Library:, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, NULL, InputFormat:, org.apache.hadoop.mapred.TextInputFormat, NULL, OutputFormat:, org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat, NULL, Compressed:, No, NULL, Num Buckets:, 0, NULL, Bucket Columns:, [], NULL, Sort Columns:, [], NULL, Storage Desc Params:, NULL, NULL, , escape.delim, \\, , field.delim, ,, , serialization.format, ,] Actual: [# col_name, data_type, comment, , NULL, NULL, id, int, NULL, bool_col, boolean, NULL, tinyint_col, tinyint, NULL, smallint_col, smallint, NULL, int_col, int, NULL, bigint_col, bigint, NULL, float_col, float, NULL, double_col, double, NULL, date_string_col, string, NULL, string_col, string, NULL, timestamp_col, timestamp, NULL, , NULL, NULL, # Partition Information, NULL, NULL, # col_name, data_type, comment, , NULL, NULL, year, int, NULL, month, int, NULL, day, int, NULL, , NULL, NULL, # Detailed Table Information, NULL, NULL, Database:, functional, NULL, OwnerType:, USER, NULL, Owner:, jenkins, NULL, CreateTime:, Wed Jun 06 21:50:33 PDT 2018, NULL, LastAccessTime:, UNKNOWN, NULL, Retention:, 0, NULL, Location:, hdfs://localhost:20500/test-warehouse/alltypesagg, NULL, Table Type:, EXTERNAL_TABLE, NULL, Table Parameters:, NULL, NULL, , DO_NOT_UPDATE_STATS, true, , EXTERNAL, TRUE, , STATS_GENERATED, TASK, , impala.lastComputeStatsTime, 1528349431, , numRows, 11000, , totalSize, 834279, , transient_lastDdlTime, 1528347033, , NULL, NULL, # Storage Information, NULL, NULL, SerDe Library:, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, NULL, InputFormat:, org.apache.hadoop.mapred.TextInputFormat, NULL, OutputFormat:, org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat, NULL, Compressed:, No, NULL, Num Buckets:, 0, NULL, Bucket Columns:, [], NULL, Sort Columns:, [], NULL, Storage Desc Params:, NULL, NULL, , escape.delim, \\, , field.delim, ,, , serialization.format, ,] expected:<150> but was:<153>
23:27:32   AuthorizationTest.TestDescribeTableResults:1963->verifyOutputWithOptionalData:1988 Size difference. Expected: [# col_name, data_type, comment, , NULL, NULL, id, int, NULL, bool_col, boolean, NULL, tinyint_col, tinyint, NULL, smallint_col, smallint, NULL, int_col, int, NULL, bigint_col, bigint, NULL, float_col, float, NULL, double_col, double, NULL, date_string_col, string, NULL, string_col, string, NULL, timestamp_col, timestamp, NULL, , NULL, NULL, # Partition Information, NULL, NULL, # col_name, data_type, comment, , NULL, NULL, year, int, NULL, month, int, NULL, day, int, NULL, , NULL, NULL, # Detailed Table Information, NULL, NULL, Database:, functional, NULL, Owner:, *, NULL, CreateTime:, *, NULL, LastAccessTime:, UNKNOWN, NULL, Retention:, 0, NULL, Location:, hdfs://localhost:20500/test-warehouse/alltypesagg, NULL, Table Type:, EXTERNAL_TABLE, NULL, Table Parameters:, NULL, NULL, , DO_NOT_UPDATE_STATS, true, , EXTERNAL, TRUE, , STATS_GENERATED, TASK, , impala.lastComputeStatsTime, *, , numRows, 11000, , totalSize, 834279, , transient_lastDdlTime, *, , NULL, NULL, # Storage Information, NULL, NULL, SerDe Library:, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, NULL, InputFormat:, org.apache.hadoop.mapred.TextInputFormat, NULL, OutputFormat:, org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat, NULL, Compressed:, No, NULL, Num Buckets:, 0, NULL, Bucket Columns:, [], NULL, Sort Columns:, [], NULL, Storage Desc Params:, NULL, NULL, , escape.delim, \\, , field.delim, ,, , serialization.format, ,] Actual: [# col_name, data_type, comment, , NULL, NULL, id, int, NULL, bool_col, boolean, NULL, tinyint_col, tinyint, NULL, smallint_col, smallint, NULL, int_col, int, NULL, bigint_col, bigint, NULL, float_col, float, NULL, double_col, double, NULL, date_string_col, string, NULL, string_col, string, NULL, timestamp_col, timestamp, NULL, , NULL, NULL, # Partition Information, NULL, NULL, # col_name, data_type, comment, , NULL, NULL, year, int, NULL, month, int, NULL, day, int, NULL, , NULL, NULL, # Detailed Table Information, NULL, NULL, Database:, functional, NULL, OwnerType:, USER, NULL, Owner:, jenkins, NULL, CreateTime:, Wed Jun 06 21:50:33 PDT 2018, NULL, LastAccessTime:, UNKNOWN, NULL, Retention:, 0, NULL, Location:, hdfs://localhost:20500/test-warehouse/alltypesagg, NULL, Table Type:, EXTERNAL_TABLE, NULL, Table Parameters:, NULL, NULL, , DO_NOT_UPDATE_STATS, true, , EXTERNAL, TRUE, , STATS_GENERATED, TASK, , impala.lastComputeStatsTime, 1528349431, , numRows, 11000, , totalSize, 834279, , transient_lastDdlTime, 1528347033, , NULL, NULL, # Storage Information, NULL, NULL, SerDe Library:, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, NULL, InputFormat:, org.apache.hadoop.mapred.TextInputFormat, NULL, OutputFormat:, org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat, NULL, Compressed:, No, NULL, Num Buckets:, 0, NULL, Bucket Columns:, [], NULL, Sort Columns:, [], NULL, Storage Desc Params:, NULL, NULL, , escape.delim, \\, , field.delim, ,, , serialization.format, ,] expected:<150> but was:<153>

The newly-added fields are:

 OwnerType:, USER, NULL,

I suspect HIVE-19374 is somehow related.

Issue Links

• relates to: IMPALA-7144 Reenable tests disabled by IMPALA-7143