[IMPALA-3491] Reduce number of serial tests with unique database fixture

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: Impala 2.5.0
• Fix Version/s: Impala 2.8.0
• Component/s: Infrastructure
• Labels: test-infra
• Target Version: Product Backlog
• Assignee: Alexander Behm
• Reporter: Alexander Behm
• Created: 06/May/16 18:14
• Updated: 23/Oct/18 22:44
• Resolved: 04/Mar/17 01:24

Description

We have a significant number of tests that have to run serial due to shared state among parallel tests/dimensions, most prominently transient test databases and tables.

Michael B recently introduced a new pytest fixture for creating an isolated unique database. The task here is to roll out the new fixture to all existing tests.

I will add a comment for every commit that relates to fixing these tests. Here is a complete list of tests that could benefit from the new fixture:

./tests/data_errors/test_data_errors.py
./tests/custom_cluster/test_insert_behaviour.py
./tests/custom_cluster/test_hdfs_fd_caching.py
./tests/custom_cluster/test_permanent_udfs.py
./tests/custom_cluster/test_parquet_max_page_header.py
./tests/catalog_service/test_catalog_service_client.py
./tests/metadata/test_show_create_table.py
./tests/metadata/test_metadata_query_statements.py
./tests/metadata/test_last_ddl_time_update.py
./tests/metadata/test_hbase_metadata.py
./tests/metadata/test_hdfs_permissions.py
./tests/metadata/test_compute_stats.py
./tests/metadata/test_load.py
./tests/metadata/test_ddl.py
./tests/metadata/test_explain.py
./tests/metadata/test_views_compatibility.py
./tests/metadata/test_hidden_files.py
./tests/metadata/test_recover_partitions.py
./tests/metadata/test_hdfs_encryption.py
./tests/metadata/test_stale_metadata.py
./tests/metadata/test_col_stats.py
./tests/metadata/test_partition_metadata.py
./tests/shell/test_shell_commandline.py
./tests/shell/test_shell_interactive.py
./tests/query_test/test_hdfs_caching.py
./tests/query_test/test_insert.py
./tests/query_test/test_insert_behaviour.py
./tests/query_test/test_hdfs_fd_caching.py
./tests/query_test/test_cancellation.py
./tests/query_test/test_join_queries.py
./tests/query_test/test_partitioning.py
./tests/query_test/test_chars.py
./tests/query_test/test_insert_parquet.py
./tests/query_test/test_udfs.py
./tests/query_test/test_nested_types.py
./tests/query_test/test_compressed_formats.py
./tests/query_test/test_local_fs.py
./tests/query_test/test_multiple_filesystems.py
./tests/query_test/test_scanners.py
./tests/query_test/test_delimited_text.py
./tests/stress/test_ddl_stress.py
./tests/query_test/test_kudu.py

Issue Links

• is duplicated by: IMPALA-2652 tests/metadata/test_ddl.py test_create_drop_data_src fails when run a second time
• is duplicated by: IMPALA-2714 metadata.test_ddl.TestDdlStatements.test_functions_ddl fails on repeated runs