Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7579

TestObservability.test_query_profile_contains_all_events fails for S3 tests

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 3.1.0
    • Impala 3.1.0
    • Infrastructure
    • None
    • ghx-label-8

    Description

      For S3 tests, the test introduced in https://gerrit.cloudera.org/#/c/11387/ fails with:

      query_test/test_observability.py:225: in test_query_profile_contains_all_events
          self.hdfs_client.delete_file_dir(path)
      util/hdfs_util.py:90: in delete_file_dir
          if not self.exists(path):
      util/hdfs_util.py:138: in exists
          self.get_file_dir_status(path)
      util/hdfs_util.py:102: in get_file_dir_status
          return super(PyWebHdfsClientWithChmod, self).get_file_dir_status(path)
      /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/pywebhdfs/webhdfs.py:335: in get_file_dir_status
          response = requests.get(uri, allow_redirects=True)
      /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/requests/api.py:69: in get
          return request('get', url, params=params, **kwargs)
      /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/requests/api.py:50: in request
          response = session.request(method=method, url=url, **kwargs)
      /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/requests/sessions.py:465: in request
          resp = self.send(prep, **send_kwargs)
      /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/requests/sessions.py:573: in send
          r = adapter.send(request, **kwargs)
      /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/requests/adapters.py:415: in send
          raise ConnectionError(err, request=request)
      E   ConnectionError: ('Connection aborted.', error(111, 'Connection refused'))

      The dir delete might want to be guarded by an "if exists". The failure cases may differ between hdfs and s3, which is probably what this test ran into.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            asherman Andrew Sherman
            vukercegovac Vuk Ercegovac
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment