[IMPALA-12944] test_query_log_table_different_table failed in Ozone build

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.4.0
• Labels: broken-build
• Epic Color: ghx-label-11
• Assignee: Jason Fehr
• Reporter: Zoltán Borók-Nagy
• Created: 27/Mar/24 12:27
• Updated: 29/Mar/24 22:41
• Resolved: 29/Mar/24 22:38

Description

Based on Standard Error, it seems like the issue was that the test couldn't connect to the Impala cluster.
 

Error Message

ImpalaBeeswaxException: ImpalaBeeswaxException:  INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>  MESSAGE: AnalysisException: Table does not exist: sys.completed_queries_table_1711376107

Stack trace

custom_cluster/test_query_log.py:403: in test_query_log_table_different_table
    client.execute("drop table {0}.{1} purge".format(self.WM_DB, self.OTHER_TBL))
common/impala_connection.py:219: in execute
    fetch_profile_after_close=fetch_profile_after_close)
beeswax/impala_beeswax.py:191: in execute
    handle = self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:382: in __execute_query
    handle = self.execute_query_async(query_string, user=user)
beeswax/impala_beeswax.py:376: in execute_query_async
    handle = self.__do_rpc(lambda: self.imp_service.query(query,))
beeswax/impala_beeswax.py:539: in __do_rpc
    raise ImpalaBeeswaxException(self.__build_error_message(b), b)
E   ImpalaBeeswaxException: ImpalaBeeswaxException:
E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
E    MESSAGE: AnalysisException: Table does not exist: sys.completed_queries_table_1711376107

Standard Error

-- 2024-03-25 09:22:26,560 INFO     MainThread: Starting cluster with command: /data/jenkins/workspace/impala-cdw-master-staging-core-ozone/repos/Impala/bin/start-impala-cluster.py '--state_store_args=--statestore_update_frequency_ms=50     --statestore_priority_update_frequency_ms=50     --statestore_heartbeat_frequency_ms=50' --cluster_size=3 --num_coordinators=3 --log_dir=/data/jenkins/workspace/impala-cdw-master-staging-core-ozone/repos/Impala/logs/custom_cluster_tests --log_level=1 '--impalad_args=--enable_workload_mgmt --query_log_write_interval_s=1 --shutdown_grace_period_s=10 --shutdown_deadline_s=30 --blacklisted_dbs=information_schema --query_log_table_name=completed_queries_table_1711376107 ' '--state_store_args=None ' '--catalogd_args=--enable_workload_mgmt --blacklisted_dbs=information_schema ' --impalad_args=--default_query_options=
09:22:27 MainThread: Found 0 impalad/0 statestored/0 catalogd process(es)
...
-- 2024-03-25 09:22:35,972 DEBUG    MainThread: Getting num_known_live_backends from impala-ec2-centos79-m6i-4xlarge-ondemand-1477.vpc.cloudera.com:25002
-- 2024-03-25 09:22:35,973 INFO     MainThread: num_known_live_backends has reached value: 3
SET client_identifier=custom_cluster/test_query_log.py::TestQueryLogTableBeeswax::()::test_query_log_table_different_table[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;';
-- connecting to: localhost:21000
-- 2024-03-25 09:22:35,974 INFO     MainThread: Could not connect to ('::1', 21000, 0, 0)
Traceback (most recent call last):
  File "/data0/jenkins/workspace/impala-cdw-master-staging-core-ozone/repos/Impala/infra/python/env-gcc10.4.0/lib/python2.7/site-packages/thrift/transport/TSocket.py", line 137, in open
    handle.connect(sockaddr)
  File "/data/jenkins/workspace/impala-cdw-master-staging-core-ozone/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/socket.py", line 228, in meth
    return getattr(self._sock,name)(*args)
error: [Errno 111] Connection refused
-- connecting to localhost:21050 with impyla
-- 2024-03-25 09:22:35,974 INFO     MainThread: Could not connect to ('::1', 21050, 0, 0)
Traceback (most recent call last):
  File "/data0/jenkins/workspace/impala-cdw-master-staging-core-ozone/repos/Impala/infra/python/env-gcc10.4.0/lib/python2.7/site-packages/thrift/transport/TSocket.py", line 137, in open
    handle.connect(sockaddr)
  File "/data/jenkins/workspace/impala-cdw-master-staging-core-ozone/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/socket.py", line 228, in meth
    return getattr(self._sock,name)(*args)
error: [Errno 111] Connection refused
-- 2024-03-25 09:22:36,001 INFO     MainThread: Closing active operation
-- connecting to localhost:28000 with impyla
-- 2024-03-25 09:22:36,018 INFO     MainThread: Closing active operation
-- connecting to localhost:11050 with impyla
SET client_identifier=custom_cluster/test_query_log.py::TestQueryLogTableBeeswax::()::test_query_log_table_different_table[protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;';
-- connecting to: localhost:21000
-- 2024-03-25 09:22:36,032 INFO     MainThread: Could not connect to ('::1', 21000, 0, 0)
Traceback (most recent call last):
  File "/data0/jenkins/workspace/impala-cdw-master-staging-core-ozone/repos/Impala/infra/python/env-gcc10.4.0/lib/python2.7/site-packages/thrift/transport/TSocket.py", line 137, in open
    handle.connect(sockaddr)
  File "/data/jenkins/workspace/impala-cdw-master-staging-core-ozone/Impala-Toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/socket.py", line 228, in meth
    return getattr(self._sock,name)(*args)
error: [Errno 111] Connection refused
-- executing against localhost:21000

show tables in sys;

-- 2024-03-25 09:22:36,051 INFO     MainThread: Started query a84b3df4e3f08943:788fcc7d00000000
-- executing against localhost:21000

drop table sys.completed_queries_table_1711376107 purge;

Issue Links

• is caused by: IMPALA-12426 SQL Interface to Completed Queries/DDLs/DMLs