Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7452

test_disable_catalog_data_op s3 failiure

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 3.1.0
    • Impala 3.1.0
    • Infrastructure
    • None

    Description

      Vuk Ercegovac assigning this to you since you just added the test.

      custom_cluster.test_disable_catalog_data_ops.TestDisableCatalogDataOps.test_disable_catalog_data_ops (from pytest)
      
      Error Message
      AssertionError: Expected 1 lines in file /data0/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/catalogd.impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com.jenkins.log.INFO.20180815-074632.10850 matching regex 'Avro schema, hdfs://localhost:20500//test-warehouse/avro_schemas/functional/tinytable.json, not loaded from fs: catalog data ops disabled.', but found 0 lines. Last line was:  I0815 07:46:42.577656 11042 catalog-server.cc:251] A catalog update with 2 entries is assembled. Catalog version: 1138 Last sent catalog version: 1137
      Stacktrace
      custom_cluster/test_disable_catalog_data_ops.py:42: in test_disable_catalog_data_ops
          'INFO', "Avro schema, "
      common/custom_cluster_test_suite.py:181: in assert_catalogd_log_contains
          self.assert_log_contains("catalogd", level, line_regex, expected_count)
      common/custom_cluster_test_suite.py:207: in assert_log_contains
          (expected_count, log_file_path, line_regex, found, line)
      E   AssertionError: Expected 1 lines in file /data0/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/catalogd.impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com.jenkins.log.INFO.20180815-074632.10850 matching regex 'Avro schema, hdfs://localhost:20500//test-warehouse/avro_schemas/functional/tinytable.json, not loaded from fs: catalog data ops disabled.', but found 0 lines. Last line was: 
      E   I0815 07:46:42.577656 11042 catalog-server.cc:251] A catalog update with 2 entries is assembled. Catalog version: 1138 Last sent catalog version: 1137
      Standard Error
      07:46:31 MainThread: Starting State Store logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/statestored.INFO
      07:46:32 MainThread: Starting Catalog Service logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/catalogd.INFO
      07:46:33 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad.INFO
      07:46:34 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad_node1.INFO
      07:46:35 MainThread: Starting Impala Daemon logging to /data/jenkins/workspace/impala-asf-master-core-s3/repos/Impala/logs/custom_cluster_tests/impalad_node2.INFO
      07:46:38 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      07:46:38 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25000
      07:46:38 MainThread: Waiting for num_known_live_backends=3. Current value: 0
      07:46:39 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25000
      07:46:39 MainThread: Waiting for num_known_live_backends=3. Current value: 1
      07:46:40 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25000
      07:46:40 MainThread: Waiting for num_known_live_backends=3. Current value: 2
      07:46:41 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25000
      07:46:41 MainThread: num_known_live_backends has reached value: 3
      07:46:41 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25001
      07:46:41 MainThread: num_known_live_backends has reached value: 3
      07:46:41 MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25002
      07:46:41 MainThread: num_known_live_backends has reached value: 3
      07:46:41 MainThread: Impala Cluster Running with 3 nodes (3 coordinators, 3 executors).
      MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
      MainThread: Getting metric: statestore.live-backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25010
      MainThread: Metric 'statestore.live-backends' has reached desired value: 4
      MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25000
      MainThread: num_known_live_backends has reached value: 3
      MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25001
      MainThread: num_known_live_backends has reached value: 3
      MainThread: Getting num_known_live_backends from impala-ec2-centos74-m5-4xlarge-ondemand-1595.vpc.cloudera.com:25002
      MainThread: num_known_live_backends has reached value: 3
      -- connecting to: localhost:21000
      -- executing against localhost:21000
      select count(*) from functional_avro.tinytable;
      
      MainThread: Started query e34ee6c7ae5915dc:ea0423dc00000000
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vukercegovac Vuk Ercegovac
            mikeb Michael Brown
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment