Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-12931

TestEventProcessingCustomConfigs.test_no_hms_event_incremental_refresh_transactional_table fails in some builds

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Blocker
    • Resolution: Unresolved
    • None
    • None
    • None
    • ghx-label-6

    Description

      TestEventProcessingCustomConfigs.test_no_hms_event_incremental_refresh_transactional_table fails in some builds:

      Error Message

      assert [] == ['1', '2', '3'] Right contains more items, first extra item: '1' Full diff: - [] + ['1', '2', '3']

      Stacktrace

      custom_cluster/test_events_custom_configs.py:1246: in test_no_hms_event_incremental_refresh_transactional_table
          assert results.data == ["1", "2", "3"]
      E   assert [] == ['1', '2', '3']
      E     Right contains more items, first extra item: '1'
      E     Full diff:
      E     - []
      E     + ['1', '2', '3']

      Standard Error

       

      -- 2024-03-19 21:11:27,574 INFO     MainThread: Starting cluster with command: /data/jenkins/workspace/impala-cdw-master-staging-exhaustive-redhat8-shard1/repos/Impala/bin/start-impala-cluster.py '--state_store_args=--statestore_update_frequency_ms=50     --statestore_priority_update_frequency_ms=50     --statestore_heartbeat_frequency_ms=50' --cluster_size=3 --num_coordinators=3 --log_dir=/data/jenkins/workspace/impala-cdw-master-staging-exhaustive-redhat8-shard1/repos/Impala/logs/custom_cluster_tests --log_level=1 '--state_store_args=None ' '--catalogd_args=--hms_event_incremental_refresh_transactional_table=false ' --impalad_args=--default_query_options=
      21:11:28 MainThread: Found 0 impalad/0 statestored/0 catalogd process(es)
      21:11:28 MainThread: Starting State Store logging to /data/jenkins/workspace/impala-cdw-master-staging-exhaustive-redhat8-shard1/repos/Impala/logs/custom_cluster_tests/statestored.INFO
      21:11:28 MainThread: Starting Catalog Service logging to /data/jenkins/workspace/impala-cdw-master-staging-exhaustive-redhat8-shard1/repos/Impala/logs/custom_cluster_tests/catalogd.INFO
      21:11:28 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-cdw-master-staging-exhaustive-redhat8-shard1/repos/Impala/logs/custom_cluster_tests/impalad.INFO
      21:11:28 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-cdw-master-staging-exhaustive-redhat8-shard1/repos/Impala/logs/custom_cluster_tests/impalad_node1.INFO
      21:11:28 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-cdw-master-staging-exhaustive-redhat8-shard1/repos/Impala/logs/custom_cluster_tests/impalad_node2.INFO
      21:11:31 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      21:11:31 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      21:11:31 MainThread: Getting num_known_live_backends from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25000
      21:11:31 MainThread: 'backends'
      21:11:31 MainThread: Waiting for num_known_live_backends=3. Current value: None
      21:11:32 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      21:11:32 MainThread: Getting num_known_live_backends from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25000
      21:11:32 MainThread: Waiting for num_known_live_backends=3. Current value: 0
      21:11:33 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      21:11:33 MainThread: Getting num_known_live_backends from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25000
      21:11:33 MainThread: Waiting for num_known_live_backends=3. Current value: 0
      21:11:34 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      21:11:34 MainThread: Getting num_known_live_backends from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25000
      21:11:34 MainThread: num_known_live_backends has reached value: 3
      21:11:34 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      21:11:34 MainThread: Getting num_known_live_backends from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25001
      21:11:34 MainThread: num_known_live_backends has reached value: 3
      21:11:35 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      21:11:35 MainThread: Getting num_known_live_backends from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25002
      21:11:35 MainThread: num_known_live_backends has reached value: 3
      21:11:35 MainThread: Impala Cluster Running with 3 nodes (3 coordinators, 3 executors).
      -- 2024-03-19 21:11:35,965 DEBUG    MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      -- 2024-03-19 21:11:35,965 INFO     MainThread: Getting metric: statestore.live-backends from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25010
      -- 2024-03-19 21:11:35,968 INFO     MainThread: Metric 'statestore.live-backends' has reached desired value: 4
      -- 2024-03-19 21:11:35,968 DEBUG    MainThread: Getting num_known_live_backends from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25000
      -- 2024-03-19 21:11:35,970 INFO     MainThread: num_known_live_backends has reached value: 3
      -- 2024-03-19 21:11:35,970 DEBUG    MainThread: Getting num_known_live_backends from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25001
      -- 2024-03-19 21:11:35,971 INFO     MainThread: num_known_live_backends has reached value: 3
      -- 2024-03-19 21:11:35,971 DEBUG    MainThread: Getting num_known_live_backends from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25002
      -- 2024-03-19 21:11:35,973 INFO     MainThread: num_known_live_backends has reached value: 3
      SET client_identifier=custom_cluster/test_events_custom_configs.py::TestEventProcessingCustomConfigs::()::test_no_hms_event_incremental_refresh_transactional_table;
      -- connecting to: localhost:21000
      -- 2024-03-19 21:11:35,973 INFO     MainThread: Could not connect to ('::1', 21000, 0, 0)
      Traceback (most recent call last):
        File "/data0/jenkins/workspace/impala-cdw-master-staging-exhaustive-redhat8-shard1/repos/Impala/infra/python/env-gcc10.4.0/lib/python2.7/site-packages/thrift/transport/TSocket.py", line 137, in open
          handle.connect(sockaddr)
        File "/data/jenkins/workspace/impala-cdw-master-staging-exhaustive-redhat8-shard1/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/socket.py", line 228, in meth
          return getattr(self._sock,name)(*args)
      error: [Errno 111] Connection refused
      -- connecting to localhost:21050 with impyla
      -- 2024-03-19 21:11:35,974 INFO     MainThread: Could not connect to ('::1', 21050, 0, 0)
      Traceback (most recent call last):
        File "/data0/jenkins/workspace/impala-cdw-master-staging-exhaustive-redhat8-shard1/repos/Impala/infra/python/env-gcc10.4.0/lib/python2.7/site-packages/thrift/transport/TSocket.py", line 137, in open
          handle.connect(sockaddr)
        File "/data/jenkins/workspace/impala-cdw-master-staging-exhaustive-redhat8-shard1/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/socket.py", line 228, in meth
          return getattr(self._sock,name)(*args)
      error: [Errno 111] Connection refused
      -- 2024-03-19 21:11:36,115 INFO     MainThread: Closing active operation
      -- connecting to localhost:28000 with impyla
      -- 2024-03-19 21:11:36,131 INFO     MainThread: Closing active operation
      -- connecting to localhost:11050 with impyla
      SET client_identifier=custom_cluster/test_events_custom_configs.py::TestEventProcessingCustomConfigs::()::test_no_hms_event_incremental_refresh_transactional_table;
      SET sync_ddl=False;
      -- executing against localhost:21000
      DROP DATABASE IF EXISTS `test_no_hms_event_incremental_refresh_transactional_table_75c9c83d` CASCADE;
      -- 2024-03-19 21:11:36,186 INFO     MainThread: Started query dc4f96723e39c4e0:83716ca800000000
      SET client_identifier=custom_cluster/test_events_custom_configs.py::TestEventProcessingCustomConfigs::()::test_no_hms_event_incremental_refresh_transactional_table;
      SET sync_ddl=False;
      -- executing against localhost:21000
      CREATE DATABASE `test_no_hms_event_incremental_refresh_transactional_table_75c9c83d`;
      -- 2024-03-19 21:11:36,307 INFO     MainThread: Started query 73464f29afa1e868:27e6b8c900000000
      -- 2024-03-19 21:11:36,609 INFO     MainThread: Created database "test_no_hms_event_incremental_refresh_transactional_table_75c9c83d" for test ID "custom_cluster/test_events_custom_configs.py::TestEventProcessingCustomConfigs::()::test_no_hms_event_incremental_refresh_transactional_table"
      -- 2024-03-19 21:11:36,610 INFO     MainThread: -- executing in HiveServer2
      create transactional table test_no_hms_event_incremental_refresh_transactional_table_75c9c83d.tbl (i int)
      -- 2024-03-19 21:11:40,122 INFO     MainThread: Waiting until events processor syncs to event id:42423
      -- 2024-03-19 21:11:40,967 DEBUG    MainThread: Metric last-synced-event-id has reached the desired value: 42423
      -- 2024-03-19 21:11:41,006 INFO     MainThread: Getting metric: catalog.curr-version from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25000
      -- 2024-03-19 21:11:41,017 INFO     MainThread: Sleeping 1s before next retry.
      -- 2024-03-19 21:11:42,018 INFO     MainThread: Getting metric: catalog.curr-version from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25000
      -- 2024-03-19 21:11:42,021 INFO     MainThread: Metric 'catalog.curr-version' has reached desired value: 2077
      -- 2024-03-19 21:11:42,021 INFO     MainThread: Getting metric: catalog.curr-version from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25001
      -- 2024-03-19 21:11:42,032 INFO     MainThread: Metric 'catalog.curr-version' has reached desired value: 2077
      -- 2024-03-19 21:11:42,032 INFO     MainThread: Getting metric: catalog.curr-version from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25002
      -- 2024-03-19 21:11:42,043 INFO     MainThread: Metric 'catalog.curr-version' has reached desired value: 2077
      -- executing against localhost:21000
      refresh test_no_hms_event_incremental_refresh_transactional_table_75c9c83d.tbl;
      -- 2024-03-19 21:11:42,052 INFO     MainThread: Started query 1a4c50fdf1662cc0:994be68900000000
      -- 2024-03-19 21:11:42,405 INFO     MainThread: -- executing in HiveServer2
      insert into test_no_hms_event_incremental_refresh_transactional_table_75c9c83d.tbl values (1),(2),(3)
      -- 2024-03-19 21:11:56,045 INFO     MainThread: Waiting until events processor syncs to event id:42427
      -- 2024-03-19 21:11:56,991 DEBUG    MainThread: Metric last-synced-event-id has reached the desired value: 42427
      -- 2024-03-19 21:11:57,009 INFO     MainThread: Getting metric: catalog.curr-version from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25000
      -- 2024-03-19 21:11:57,021 INFO     MainThread: Metric 'catalog.curr-version' has reached desired value: 2079
      -- 2024-03-19 21:11:57,021 INFO     MainThread: Getting metric: catalog.curr-version from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25001
      -- 2024-03-19 21:11:57,031 INFO     MainThread: Metric 'catalog.curr-version' has reached desired value: 2079
      -- 2024-03-19 21:11:57,031 INFO     MainThread: Getting metric: catalog.curr-version from impala-ec2-redhat86-m6i-4xlarge-ondemand-0866.vpc.cloudera.com:25002
      -- 2024-03-19 21:11:57,042 INFO     MainThread: Metric 'catalog.curr-version' has reached desired value: 2079
      -- executing against localhost:21000
      select i from test_no_hms_event_incremental_refresh_transactional_table_75c9c83d.tbl;
      -- 2024-03-19 21:11:57,438 INFO     MainThread: Started query f64b0ed3452de446:e876609700000000
      

      As the test was introduced by IMPALA-12835, csringhofer could you take a look?

       

      Attachments

        Activity

          People

            csringhofer Csaba Ringhofer
            daniel.becker Daniel Becker
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: