[IMPALA-4615] test_avro_schema_resolution.py fails with wrong results

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.8.0, Impala 2.9.0
• Fix Version/s: Impala 2.9.0
• Component/s: Backend
• Labels: broken-build flaky
• Target Version: Impala 2.9.0
• Assignee: Lars Volker
• Reporter: Alexander Behm
• Created: 07/Dec/16 14:58
• Updated: 01/Jun/17 13:51
• Resolved: 09/Mar/17 17:37

Description

Jenkins console output:

02:07:54 ---------------------------- Captured stderr setup -----------------------------
02:07:54 -- connecting to: localhost:21000
02:07:54 SET sync_ddl=False;
02:07:54 -- executing against localhost:21000
02:07:54 DROP DATABASE IF EXISTS `test_avro_schema_resolution_cad70577` CASCADE;
02:07:54 
02:07:54 SET sync_ddl=False;
02:07:54 -- executing against localhost:21000
02:07:54 CREATE DATABASE `test_avro_schema_resolution_cad70577`;
02:07:54 
02:07:54 MainThread: Created database "test_avro_schema_resolution_cad70577" for test ID "query_test/test_avro_schema_resolution.py::TestAvroSchemaResolution::()::test_avro_schema_resolution[exec_option: {'disable_codegen': True, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: avro/snap/block]"
02:07:54 ----------------------------- Captured stderr call -----------------------------
02:07:54 -- executing against localhost:21000
02:07:54 use test_avro_schema_resolution_cad70577;
02:07:54 
02:07:54 SET disable_codegen=True;
02:07:54 SET abort_on_error=1;
02:07:54 SET exec_single_node_rows_threshold=0;
02:07:54 SET batch_size=0;
02:07:54 SET num_nodes=0;
02:07:54 -- executing against localhost:21000
02:07:54 select * from functional_avro_snap.schema_resolution_test;
02:07:54 
02:07:54 MainThread: Skipping type verification of Avro-format table.
02:07:54 -- executing against localhost:21000
02:07:54 select * from functional_avro_snap.no_avro_schema where year = 2009 order by id limit 1
02:07:54 union all
02:07:54 select * from functional_avro_snap.no_avro_schema where year = 2010 order by id limit 1;
02:07:54 
02:07:54 MainThread: Skipping type verification of Avro-format table.
02:07:54 -- executing against localhost:21000
02:07:54 select count(*) from functional_avro_snap.avro_coldef;
02:07:54 
02:07:54 MainThread: Skipping type verification of Avro-format table.
02:07:54 MainThread: Comparing QueryTestResults (expected vs actual):
02:07:54 10 != 0
02:07:54  TestAvroSchemaResolution.test_avro_schema_resolution[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: avro/snap/block] 
02:07:54 [gw2] linux2 -- Python 2.7.5 /data/jenkins/workspace/impala-cdh5-2.7.0_5.10.0-exhaustive-rhel7/repos/Impala/bin/../infra/python/env/bin/python
02:07:54 query_test/test_avro_schema_resolution.py:35: in test_avro_schema_resolution
02:07:54     self.run_test_case('QueryTest/avro-schema-resolution', vector, unique_database)
02:07:54 common/impala_test_suite.py:353: in run_test_case
02:07:54     self.__verify_results_and_errors(vector, test_section, result, use_db)
02:07:54 common/impala_test_suite.py:238: in __verify_results_and_errors
02:07:54     replace_filenames_with_placeholder)
02:07:54 common/test_result_verifier.py:404: in verify_raw_results
02:07:54     VERIFIER_MAP[verifier](expected, actual)
02:07:54 common/test_result_verifier.py:231: in verify_query_result_is_equal
02:07:54     assert expected_results == actual_results
02:07:54 E   assert Comparing QueryTestResults (expected vs actual):
02:07:54 E     10 != 0
02:07:54 ---------------------------- Captured stderr setup -----------------------------
02:07:54 SET sync_ddl=False;
02:07:54 -- executing against localhost:21000
02:07:54 DROP DATABASE IF EXISTS `test_avro_schema_resolution_9eabe99a` CASCADE;
02:07:54 
02:07:54 SET sync_ddl=False;
02:07:54 -- executing against localhost:21000
02:07:54 CREATE DATABASE `test_avro_schema_resolution_9eabe99a`;
02:07:54 
02:07:54 MainThread: Created database "test_avro_schema_resolution_9eabe99a" for test ID "query_test/test_avro_schema_resolution.py::TestAvroSchemaResolution::()::test_avro_schema_resolution[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: avro/snap/block]"
02:07:54 ----------------------------- Captured stderr call -----------------------------
02:07:54 -- executing against localhost:21000
02:07:54 use test_avro_schema_resolution_9eabe99a;
02:07:54 
02:07:54 SET disable_codegen=False;
02:07:54 SET abort_on_error=1;
02:07:54 SET exec_single_node_rows_threshold=0;
02:07:54 SET batch_size=0;
02:07:54 SET num_nodes=0;
02:07:54 -- executing against localhost:21000
02:07:54 select * from functional_avro_snap.schema_resolution_test;
02:07:54 
02:07:54 MainThread: Skipping type verification of Avro-format table.
02:07:54 -- executing against localhost:21000
02:07:54 select * from functional_avro_snap.no_avro_schema where year = 2009 order by id limit 1
02:07:54 union all
02:07:54 select * from functional_avro_snap.no_avro_schema where year = 2010 order by id limit 1;
02:07:54 
02:07:54 MainThread: Skipping type verification of Avro-format table.
02:07:54 -- executing against localhost:21000
02:07:54 select count(*) from functional_avro_snap.avro_coldef;
02:07:54 
02:07:54 MainThread: Skipping type verification of Avro-format table.
02:07:54 MainThread: Comparing QueryTestResults (expected vs actual):
02:07:54 10 != 0
02:07:54  generated xml file: /data/jenkins/workspace/impala-cdh5-2.7.0_5.10.0-exhaustive-rhel7/repos/Impala/logs/ee_tests/results/TEST-impala-parallel.xml 
02:07:54 =========================== short test summary info ============================

Issue Links

• is depended upon by: IMPALA-5287 Add a test for skip.header.line.count on compressed files