Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2652

tests/metadata/test_ddl.py test_create_drop_data_src fails when run a second time

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • Impala 2.3.0
    • None
    • Infrastructure

    Description

      The test fails when run a second time without bouncing impala. This shows up in the repeated runs job

      http://sandbox.jenkins.cloudera.com/view/Impala/view/Builds%20-%202.3.0%20Release/job/impala-cdh5.5.0-repeated-runs/19/testReport/metadata.test_ddl/TestDdlStatements/test_create_drop_data_src_exec_option____batch_size___0___num_nodes___0___sync_ddl___0___disable_codegen___False___abort_on_error___1___exec_single_node_rows_threshold___0____table_format__text_none_/

      It looks as though the cache hits and miss metric counts are not necessarily correct when the test is run repeatedly.

      metadata.test_ddl.TestDdlStatements.test_create_drop_data_src[exec_option: {'batch_size': 0, 'num_nodes': 0, 'sync_ddl': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none] (from pytest)

Error Message

AssertionError: Metric value external-data-source.class-cache.misses did not reach value 14 in 10s
Stacktrace

metadata/test_ddl.py:399: in test_create_drop_data_src
    expected_cache_misses)
common/impala_service.py:82: in wait_for_metric_value
    (metric_name, expected_value, timeout)
E   AssertionError: Metric value external-data-source.class-cache.misses did not reach value 14 in 10s
Standard Error

-- executing against localhost:21000
use default;

SET sync_ddl=1;
-- executing against localhost:21000
drop database if exists `ddl_test_db` cascade;

-- executing against localhost:21000
use default;

SET sync_ddl=1;
-- executing against localhost:21000
drop database if exists `ddl_purge_db` cascade;

-- executing against localhost:21000
use default;

SET sync_ddl=1;
-- executing against localhost:21000
drop database if exists `alter_table_test_db` cascade;

-- executing against localhost:21000
use default;

SET sync_ddl=1;
-- executing against localhost:21000
drop database if exists `alter_table_test_db2` cascade;

-- executing against localhost:21000
use default;

SET sync_ddl=1;
-- executing against localhost:21000
drop database if exists `function_ddl_test` cascade;

-- executing against localhost:21000
use default;

SET sync_ddl=1;
-- executing against localhost:21000
drop database if exists `udf_test` cascade;

-- executing against localhost:21000
use default;

SET sync_ddl=1;
-- executing against localhost:21000
drop database if exists `data_src_test` cascade;

-- executing against localhost:21000
use default;

SET sync_ddl=1;
-- executing against localhost:21000
drop database if exists `truncate_table_test_db` cascade;

-- executing against localhost:21000
use default;

SET sync_ddl=1;
-- executing against localhost:21000
drop database if exists `test_db` cascade;

-- executing against localhost:21000
use default;

SET sync_ddl=1;
-- executing against localhost:21000
drop database if exists `alter_purge_db` cascade;

MainThread: Starting new HTTP connection (1): 0.0.0.0
MainThread: Starting new HTTP connection (1): 0.0.0.0
MainThread: Starting new HTTP connection (1): 0.0.0.0
MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
-- executing against localhost:21000
use default;

SET sync_ddl=1;
-- executing against localhost:21000
drop database if exists `data_src_test` cascade;

-- connecting to: localhost:21000
SET sync_ddl=1;
-- executing against localhost:21000
create database data_src_test location '/test-warehouse/data_src_test.db';

-- closing connection to: localhost:21000
SET batch_size=0;
SET num_nodes=1;
SET sync_ddl=0;
SET disable_codegen=False;
SET abort_on_error=1;
SET exec_single_node_rows_threshold=0;
-- executing against localhost:21000
use data_src_test;

-- executing against localhost:21000
drop table if exists data_src_tbl;

-- executing against localhost:21000
drop data source if exists test_data_src;

-- executing against localhost:21000
CREATE DATA SOURCE test_data_src LOCATION '/test-warehouse/data-sources/test-data-source.jar' CLASS 'com.cloudera.impala.extdatasource.AllTypesDataSource' API_VERSION 'V1';

-- executing against localhost:21000
CREATE TABLE data_src_tbl (x int)
        PRODUCED BY DATA SOURCE test_data_src('dummy_init_string');

-- executing against localhost:21000
select * from data_src_tbl limit 1;

-- executing against localhost:21000
drop table  data_src_tbl;

-- executing against localhost:21000
drop data source  test_data_src;

-- executing against localhost:21000
CREATE DATA SOURCE test_data_src LOCATION '/test-warehouse/data-sources/test-data-source.jar' CLASS 'com.cloudera.impala.extdatasource.AllTypesDataSource' API_VERSION 'V1';

-- executing against localhost:21000
CREATE TABLE data_src_tbl (x int)
        PRODUCED BY DATA SOURCE test_data_src('dummy_init_string');

-- executing against localhost:21000
select * from data_src_tbl limit 1;

-- executing against localhost:21000
drop table  data_src_tbl;

-- executing against localhost:21000
drop data source  test_data_src;

MainThread: Getting metric: external-data-source.class-cache.hits from p0434.sjc.cloudera.com:25000
MainThread: Metric 'external-data-source.class-cache.hits' has reach desired value: 3
MainThread: Getting metric: external-data-source.class-cache.misses from p0434.sjc.cloudera.com:25000
MainThread: Waiting for metric value 'external-data-source.class-cache.misses'=14. Current value: 17
MainThread: Sleeping 1s before next retry.
MainThread: Getting metric: external-data-source.class-cache.misses from p0434.sjc.cloudera.com:25000
MainThread: Waiting for metric value 'external-data-source.class-cache.misses'=14. Current value: 17
MainThread: Sleeping 1s before next retry.
MainThread: Getting metric: external-data-source.class-cache.misses from p0434.sjc.cloudera.com:25000
MainThread: Waiting for metric value 'external-data-source.class-cache.misses'=14. Current value: 17
MainThread: Sleeping 1s before next retry.
MainThread: Getting metric: external-data-source.class-cache.misses from p0434.sjc.cloudera.com:25000
MainThread: Waiting for metric value 'external-data-source.class-cache.misses'=14. Current value: 17
MainThread: Sleeping 1s before next retry.
MainThread: Getting metric: external-data-source.class-cache.misses from p0434.sjc.cloudera.com:25000
MainThread: Waiting for metric value 'external-data-source.class-cache.misses'=14. Current value: 17
MainThread: Sleeping 1s before next retry.
MainThread: Getting metric: external-data-source.class-cache.misses from p0434.sjc.cloudera.com:25000
MainThread: Waiting for metric value 'external-data-source.class-cache.misses'=14. Current value: 17
MainThread: Sleeping 1s before next retry.
MainThread: Getting metric: external-data-source.class-cache.misses from p0434.sjc.cloudera.com:25000
MainThread: Waiting for metric value 'external-data-source.class-cache.misses'=14. Current value: 17
MainThread: Sleeping 1s before next retry.
MainThread: Getting metric: external-data-source.class-cache.misses from p0434.sjc.cloudera.com:25000
MainThread: Waiting for metric value 'external-data-source.class-cache.misses'=14. Current value: 17
MainThread: Sleeping 1s before next retry.
MainThread: Getting metric: external-data-source.class-cache.misses from p0434.sjc.cloudera.com:25000
MainThread: Waiting for metric value 'external-data-source.class-cache.misses'=14. Current value: 17
MainThread: Sleeping 1s before next retry.
MainThread: Getting metric: external-data-source.class-cache.misses from p0434.sjc.cloudera.com:25000
MainThread: Waiting for metric value 'external-data-source.class-cache.misses'=14. Current value: 17
MainThread: Sleeping 1s before next retry.

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-3491 Reduce number of serial tests with unique database fixture

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-2650 tests/query_test/test_udfs.py test_udf_update_via_create must clean up state

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              hsheinblatt_impala_e511 Harrison Sheinblatt
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: