Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4589

Kudu now requires replication factor must be odd; tests broken

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: Impala 2.8.0
    • Fix Version/s: Impala 2.8.0
    • Component/s: Frontend
    • Labels:

      Description

      In testing the latest kudu build in the Impala toolchain, I discovered that Kudu now requires the replication factor to be odd. We need to fix tests (some set it to 2) and check if any FE/Catalog handling may be necessary.

      13:57:01 -- Test range partitioning with overlapping partitions
      13:57:01 create table simple_range_with_overlapping (id int, name string, valf float, vali bigint,
      13:57:01   primary key (id, name)) distribute by range (id)
      13:57:01   (partition values <= 10, partition values < 20, partition value = 5) stored as kudu;
      13:57:01 
      13:57:01  TestKuduOperations.test_kudu_stats[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: text/none] 
      13:57:01 [gw0] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/bin/../infra/python/env/bin/python
      13:57:01 query_test/test_kudu.py:66: in test_kudu_stats
      13:57:01     self.run_test_case('QueryTest/kudu_stats', vector, use_db=unique_database)
      13:57:01 common/impala_test_suite.py:324: in run_test_case
      13:57:01     result = self.__execute_query(target_impalad_client, query, user=user)
      13:57:01 common/impala_test_suite.py:532: in __execute_query
      13:57:01     return impalad_client.execute(query, user=user)
      13:57:01 common/impala_connection.py:160: in execute
      13:57:01     return self.__beeswax_client.execute(sql_stmt, user=user)
      13:57:01 beeswax/impala_beeswax.py:173: in execute
      13:57:01     handle = self.__execute_query(query_string.strip(), user=user)
      13:57:01 beeswax/impala_beeswax.py:337: in __execute_query
      13:57:01     handle = self.execute_query_async(query_string, user=user)
      13:57:01 beeswax/impala_beeswax.py:333: in execute_query_async
      13:57:01     return self.__do_rpc(lambda: self.imp_service.query(query,))
      13:57:01 beeswax/impala_beeswax.py:458: in __do_rpc
      13:57:01     raise ImpalaBeeswaxException(self.__build_error_message(b), b)
      13:57:01 E   ImpalaBeeswaxException: ImpalaBeeswaxException:
      13:57:01 E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
      13:57:01 E    MESSAGE: 
      13:57:01 E   ImpalaRuntimeException: Error creating Kudu table 'impala::test_kudu_stats_8950fab4.simple'
      13:57:01 E   CAUSED BY: NonRecoverableException: illegal replication factor 2 (replication factor must be odd)
      

      Testing w/ native-toolchain & build:
      IMPALA_TOOLCHAIN_BUILD_ID=289-f12b0dd2e9
      IMPALA_KUDU_VERSION=60aa54e

        Attachments

          Activity

            People

            • Assignee:
              mjacobs Matthew Jacobs
              Reporter:
              mjacobs Matthew Jacobs
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: