[IMPALA-12054] Some of the non-kudu tests fail if kudu cluster is not running

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.4.0
• Component/s: Infrastructure
• Epic Color: ghx-label-5
• Assignee: Unassigned
• Reporter: Quanlong Huang
• Created: 11/Apr/23 09:10
• Updated: 16/Jan/24 23:21
• Resolved: 16/Jan/24 23:21

Description

I usually shutdown kudu in my dev env to save some resources. However, tests that use skip.py will fail if kudu cluster is not running locally, even if they are unrelated to Kudu. E.g.

$ impala-py.test tests/query_test/test_observability.py -k _end_time

tests/query_test/test_observability.py:23: in <module>
    from tests.common.skip import SkipIfFS, SkipIfLocal, SkipIfNotHdfsMinicluster
tests/common/skip.py:91: in <module>
    class SkipIfKudu:
tests/common/skip.py:93: in SkipIfKudu
    get_kudu_master_flag("--use_hybrid_clock") == "false",
tests/common/kudu_test_suite.py:61: in get_kudu_master_flag
    varz = get_kudu_master_webpage("varz")
tests/common/kudu_test_suite.py:57: in get_kudu_master_webpage
    return requests.get(url).text
infra/python/env-gcc10.4.0/lib/python2.7/site-packages/requests/api.py:75: in get
    return request('get', url, params=params, **kwargs)
infra/python/env-gcc10.4.0/lib/python2.7/site-packages/requests/api.py:60: in request
    return session.request(method=method, url=url, **kwargs)
infra/python/env-gcc10.4.0/lib/python2.7/site-packages/requests/sessions.py:533: in request
    resp = self.send(prep, **send_kwargs)
infra/python/env-gcc10.4.0/lib/python2.7/site-packages/requests/sessions.py:646: in send
    r = adapter.send(request, **kwargs)
infra/python/env-gcc10.4.0/lib/python2.7/site-packages/requests/adapters.py:516: in send
    raise ConnectionError(e, request=request)
E   ConnectionError: HTTPConnectionPool(host='localhost', port=8051): Max retries exceeded with url: /varz (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f774b2ebb50>: Failed to establish a new connection: [Errno 111] Connection refused',))