Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7580

test_local_catalog fails on S3 build

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 3.1.0
    • Impala 3.1.0
    • None
    • ghx-label-3

    Description

      07:07:19 _____________ TestAutomaticCatalogInvalidation.test_local_catalog ______________
      07:07:19 custom_cluster/test_automatic_invalidation.py:65: in test_local_catalog
      07:07:19     self._run_test(cursor)
      07:07:19 custom_cluster/test_automatic_invalidation.py:45: in _run_test
      07:07:19     assert self.metadata_cache_string in self._get_catalog_object()
      07:07:19 E   assert 'columns (list) = list&lt;struct&gt;' in '<!--\nLicensed to the Apache Software Foundation (ASF) under one\nor more contributor license agreements.  See the NO...ot;functional&quot;,\n    02: tbl_name (string) = &quot;alltypes&quot;,\n  },\n}</pre>\n\n</div>\n</body>\n</html>\n\n'
      07:07:19 E    +  where 'columns (list) = list&lt;struct&gt;' = <test_automatic_invalidation.TestAutomaticCatalogInvalidation object at 0x7faac427b450>.metadata_cache_string
      07:07:19 E    +  and   '<!--\nLicensed to the Apache Software Foundation (ASF) under one\nor more contributor license agreements.  See the NO...ot;functional&quot;,\n    02: tbl_name (string) = &quot;alltypes&quot;,\n  },\n}</pre>\n\n</div>\n</body>\n</html>\n\n' = <bound method TestAutomaticCatalogInvalidation._get_catalog_object of <test_automatic_invalidation.TestAutomaticCatalogInvalidation object at 0x7faac427b450>>()
      07:07:19 E    +    where <bound method TestAutomaticCatalogInvalidation._get_catalog_object of <test_automatic_invalidation.TestAutomaticCatalogInvalidation object at 0x7faac427b450>> = <test_automatic_invalidation.TestAutomaticCatalogInvalidation object at 0x7faac427b450>._get_catalog_object
      07:07:19 ---------------------------- Captured stderr setup -----------------------------
      07:07:19 -- 2018-09-16 06:23:18,238 INFO     MainThread: Starting cluster with command: /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/bin/start-impala-cluster.py --cluster_size=3 --num_coordinators=3 --log_dir=/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests --log_level=1 '--impalad_args="--invalidate_tables_timeout_s=5 --use_local_catalog" ' '--state_store_args="--statestore_update_frequency_ms=50     --statestore_priority_update_frequency_ms=50     --statestore_heartbeat_frequency_ms=50" ' '--catalogd_args="--invalidate_tables_timeout_s=5 --catalog_topic_mode=minimal" '
      07:07:19 06:23:18 MainThread: Starting State Store logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/statestored.INFO
      07:07:19 06:23:18 MainThread: Starting Catalog Service logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/catalogd.INFO
      07:07:19 06:23:20 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad.INFO
      07:07:19 06:23:21 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad_node1.INFO
      07:07:19 06:23:22 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad_node2.INFO
      07:07:19 06:23:25 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      07:07:19 06:23:25 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25000
      07:07:19 06:23:25 MainThread: Waiting for num_known_live_backends=3. Current value: 1
      07:07:19 06:23:26 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25000
      07:07:19 06:23:26 MainThread: num_known_live_backends has reached value: 3
      07:07:19 06:23:26 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25001
      07:07:19 06:23:26 MainThread: num_known_live_backends has reached value: 3
      07:07:19 06:23:26 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25002
      07:07:19 06:23:26 MainThread: num_known_live_backends has reached value: 3
      07:07:19 06:23:26 MainThread: Impala Cluster Running with 3 nodes (3 coordinators, 3 executors).
      07:07:19 -- 2018-09-16 06:23:26,087 INFO     MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      07:07:19 -- 2018-09-16 06:23:26,088 INFO     MainThread: Getting metric: statestore.live-backends from impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25010
      07:07:19 -- 2018-09-16 06:23:26,089 INFO     MainThread: Metric 'statestore.live-backends' has reached desired value: 4
      07:07:19 -- 2018-09-16 06:23:26,089 INFO     MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25000
      07:07:19 -- 2018-09-16 06:23:26,089 INFO     MainThread: num_known_live_backends has reached value: 3
      07:07:19 -- 2018-09-16 06:23:26,089 INFO     MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25001
      07:07:19 -- 2018-09-16 06:23:26,090 INFO     MainThread: num_known_live_backends has reached value: 3
      07:07:19 -- 2018-09-16 06:23:26,090 INFO     MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-0c64.vpc.cloudera.com:25002
      07:07:19 -- 2018-09-16 06:23:26,091 INFO     MainThread: num_known_live_backends has reached value: 3
      07:07:19 -- connecting to: localhost:21000
      07:07:19 -- 2018-09-16 06:23:26,099 ERROR    MainThread: Failed to open transport (tries_left=3)
      07:07:19 Traceback (most recent call last):
      07:07:19   File "/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/impala/hiveserver2.py", line 940, in _execute
      07:07:19     return func(request)
      07:07:19   File "/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/impala/_thrift_gen/TCLIService/TCLIService.py", line 175, in OpenSession
      07:07:19     return self.recv_OpenSession()
      07:07:19   File "/data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/infra/python/env/lib/python2.7/site-packages/impala/_thrift_gen/TCLIService/TCLIService.py", line 186, in recv_OpenSession
      07:07:19     (fname, mtype, rseqid) = self._iprot.readMessageBegin()
      07:07:19   File "/data/jenkins/workspace/impala-asf-master-core-s3/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/protocol/TBinaryProtocol.py", line 126, in readMessageBegin
      07:07:19     sz = self.readI32()
      07:07:19   File "/data/jenkins/workspace/impala-asf-master-core-s3/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/protocol/TBinaryProtocol.py", line 206, in readI32
      07:07:19     buff = self.trans.readAll(4)
      07:07:19   File "/data/jenkins/workspace/impala-asf-master-core-s3/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/transport/TTransport.py", line 58, in readAll
      07:07:19     chunk = self.read(sz - have)
      07:07:19   File "/data/jenkins/workspace/impala-asf-master-core-s3/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/transport/TTransport.py", line 159, in read
      07:07:19     self.__rbuf = StringIO(self.__trans.read(max(sz, self.__rbuf_size)))
      07:07:19   File "/data/jenkins/workspace/impala-asf-master-core-s3/Impala-Toolchain/thrift-0.9.3-p4/python/lib64/python2.7/site-packages/thrift/transport/TSocket.py", line 120, in read
      07:07:19     message='TSocket read 0 bytes')
      07:07:19 TTransportException: TSocket read 0 bytes
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tianyiwang Tianyi Wang
            twmarshall Thomas Tauber-Marshall
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment