[IMPALA-7036] TestKuduOperations.test_local_tz_conversion_ops() fails with missing row

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Duplicate
• Affects Version/s: Impala 2.13.0
• Component/s: Backend
• Labels: broken-build
• Epic Color: ghx-label-1
• Assignee: Thomas Tauber-Marshall
• Reporter: Joe McDonnell
• Created: 15/May/18 21:38
• Updated: 23/May/18 22:29
• Resolved: 23/May/18 22:29

Description

A 2.x core dataload job failed with:

16:16:30  TestKuduOperations.test_local_tz_conversion_ops[exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'debug_action': None, 'exec_single_node_rows_threshold': 0} | table_format: text/none] 
16:16:30 custom_cluster/test_kudu.py:42: in test_local_tz_conversion_ops
16:16:30     self.run_test_case('QueryTest/kudu_insert', vector, use_db=unique_database)
16:16:30 common/impala_test_suite.py:462: in run_test_case
16:16:30     pytest.config.option.update_results, result_section='DML_RESULTS')
16:16:30 common/test_result_verifier.py:434: in verify_raw_results
16:16:30     VERIFIER_MAP[verifier](expected, actual)
16:16:30 common/test_result_verifier.py:261: in verify_query_result_is_equal
16:16:30     assert expected_results == actual_results
16:16:30 E   assert Comparing QueryTestResults (expected vs actual):
16:16:30 E     1,10,100,1000,NULL,1,'test',true,1111.11,NULL,10000 == 1,10,100,1000,NULL,1,'test',true,1111.11,NULL,10000
16:16:30 E     2,10,100,1000,NULL,2,'test',true,1111.11,NULL,10000 == 2,10,100,1000,NULL,2,'test',true,1111.11,NULL,10000
16:16:30 E     3,10,100,1000,NULL,3,'test',true,1111.11,NULL,10000 == 3,10,100,1000,NULL,3,'test',true,1111.11,NULL,10000
16:16:30 E     4,10,100,1000,NULL,4,'test',true,1111.11,NULL,10000 == 4,10,100,1000,NULL,4,'test',true,1111.11,NULL,10000
16:16:30 E     5,5,5,5,5,5,'row',false,55555.55,NULL,10000 == 5,5,5,5,5,5,'row',false,55555.55,NULL,10000
16:16:30 E     6,6,6,6,6,6,'another row',false,66666.66,6,6 != None
16:16:30 E     Number of rows returned (expected vs actual): 6 != 5

The test is executing these SQLs:

16:16:30 -- executing against localhost:21000
16:16:30 create table tbl_with_defaults (a int primary key, b int null default 10,
16:16:30   c int not null default 100, d int default 1000, e int null, f int not null,
16:16:30   g string default 'test', h boolean default true,
16:16:30   i decimal(9, 2) default 1111.11) partition by hash (a)
16:16:30   partitions 3 stored as kudu;
16:16:30 
16:16:30 -- executing against localhost:21000
16:16:30 insert into tbl_with_defaults (a, f) values (1, 1), (2, 2), (3, 3), (4, 4);
16:16:30 
16:16:30 -- executing against localhost:21000
16:16:30 select * from tbl_with_defaults limit 1000;
16:16:30 
16:16:30 -- executing against localhost:21000
16:16:30 insert into tbl_with_defaults values (5, 5, 5, 5, 5, 5, 'row', false, 55555.55);
16:16:30 
16:16:30 -- executing against localhost:21000
16:16:30 select * from tbl_with_defaults limit 1000;
16:16:30 
16:16:30 -- executing against localhost:21000
16:16:30 alter table tbl_with_defaults add columns (j int null, k int not null default 10000);
16:16:30 
16:16:30 -- executing against localhost:21000
16:16:30 select * from tbl_with_defaults;
16:16:30 
16:16:30 -- executing against localhost:21000
16:16:30 insert into tbl_with_defaults values (6,6,6,6,6,6,'another row',false,66666.66,6,6);
16:16:30 
16:16:30 -- executing against localhost:21000
16:16:30 select * from tbl_with_defaults limit 1000;
16:16:30 
16:16:30 MainThread: Comparing QueryTestResults (expected vs actual):
16:16:30 1,10,100,1000,NULL,1,'test',true,1111.11,NULL,10000 == 1,10,100,1000,NULL,1,'test',true,1111.11,NULL,10000
16:16:30 2,10,100,1000,NULL,2,'test',true,1111.11,NULL,10000 == 2,10,100,1000,NULL,2,'test',true,1111.11,NULL,10000
16:16:30 3,10,100,1000,NULL,3,'test',true,1111.11,NULL,10000 == 3,10,100,1000,NULL,3,'test',true,1111.11,NULL,10000
16:16:30 4,10,100,1000,NULL,4,'test',true,1111.11,NULL,10000 == 4,10,100,1000,NULL,4,'test',true,1111.11,NULL,10000
16:16:30 5,5,5,5,5,5,'row',false,55555.55,NULL,10000 == 5,5,5,5,5,5,'row',false,55555.55,NULL,10000
16:16:30 6,6,6,6,6,6,'another row',false,66666.66,6,6 != None
16:16:30 Number of rows returned (expected vs actual): 6 != 5

Only saw this once so far.

Issue Links

• is related to: IMPALA-7028 TestKuduOperations.test_kudu_update fails due to wrong NumModifiedRows