[IMPALA-4589] Kudu now requires replication factor must be odd; tests broken

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.8.0
• Fix Version/s: Impala 2.8.0
• Component/s: Frontend
• Labels: kudu
• Target Version: Impala 2.8.0
• Assignee: Matthew Jacobs
• Reporter: Matthew Jacobs
• Created: 05/Dec/16 18:37
• Updated: 27/Jan/17 06:52
• Resolved: 07/Dec/16 17:40

Description

In testing the latest kudu build in the Impala toolchain, I discovered that Kudu now requires the replication factor to be odd. We need to fix tests (some set it to 2) and check if any FE/Catalog handling may be necessary.

13:57:01 -- Test range partitioning with overlapping partitions
13:57:01 create table simple_range_with_overlapping (id int, name string, valf float, vali bigint,
13:57:01   primary key (id, name)) distribute by range (id)
13:57:01   (partition values <= 10, partition values < 20, partition value = 5) stored as kudu;
13:57:01 
13:57:01  TestKuduOperations.test_kudu_stats[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: text/none] 
13:57:01 [gw0] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/bin/../infra/python/env/bin/python
13:57:01 query_test/test_kudu.py:66: in test_kudu_stats
13:57:01     self.run_test_case('QueryTest/kudu_stats', vector, use_db=unique_database)
13:57:01 common/impala_test_suite.py:324: in run_test_case
13:57:01     result = self.__execute_query(target_impalad_client, query, user=user)
13:57:01 common/impala_test_suite.py:532: in __execute_query
13:57:01     return impalad_client.execute(query, user=user)
13:57:01 common/impala_connection.py:160: in execute
13:57:01     return self.__beeswax_client.execute(sql_stmt, user=user)
13:57:01 beeswax/impala_beeswax.py:173: in execute
13:57:01     handle = self.__execute_query(query_string.strip(), user=user)
13:57:01 beeswax/impala_beeswax.py:337: in __execute_query
13:57:01     handle = self.execute_query_async(query_string, user=user)
13:57:01 beeswax/impala_beeswax.py:333: in execute_query_async
13:57:01     return self.__do_rpc(lambda: self.imp_service.query(query,))
13:57:01 beeswax/impala_beeswax.py:458: in __do_rpc
13:57:01     raise ImpalaBeeswaxException(self.__build_error_message(b), b)
13:57:01 E   ImpalaBeeswaxException: ImpalaBeeswaxException:
13:57:01 E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
13:57:01 E    MESSAGE: 
13:57:01 E   ImpalaRuntimeException: Error creating Kudu table 'impala::test_kudu_stats_8950fab4.simple'
13:57:01 E   CAUSED BY: NonRecoverableException: illegal replication factor 2 (replication factor must be odd)

Testing w/ native-toolchain & build:
IMPALA_TOOLCHAIN_BUILD_ID=289-f12b0dd2e9
IMPALA_KUDU_VERSION=60aa54e