[HIVE-22942] Replace PTest with an alternative

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Labels: pull-request-available
• Assignee: Zoltan Haindrich
• Reporter: Zoltan Haindrich
• Created: 27/Feb/20 10:26
• Updated: 27/Feb/24 22:23
• Resolved: 29/May/20 11:22

Description

I never opened a jira about this...but it might actually help collect ideas and actually start going somewhere sooner than later

Right now we maintain the ptest2 project inside Hive to be able to run Hive tests in a distributed fashion...the backstab of this solution is that we are putting much effort into maintaining a distributed test execution framework...

I think it would be better if we could find an off the shelf solution for the task and migrate to that instead of putting more efforts into the ptest framework

some info/etc about how it compares to existing one:
https://docs.google.com/document/d/1dhL5B-eBvYNKEsNV3kE6RrkV5w-LtDgw5CtHV5pdoX4/edit#heading=h.e51vlxui3e6n

Issue Links

• links to: GitHub Pull Request #948

Sub-Tasks

• TestScheduledReplicationScenarios#testAcidTablesReplLoadBootstrapIncr is unstable: Open
• Provide a way to include/exclude a set of tests: Open
• Collect ignored tests: Open
• Run metastore integration tests during precommit: Open
• Running masking_mv.q breaks strict_pruning.q: Patch Available
• stats_list_bucketing breaks sysdb output: Open
• Rows are not removed from the skewed_string_list_values table: Open
• TestSessionManagerMetrics#testAbandonedSessionMetrics is unstable: Open
• TransactionalKafkaWriterTest#writerFencedOut is unstable: Open
• TestDbNotificationListener#sqlInsertPartition is unstable: Open
• strict_pruning_2 is unstable: Open
• TestMiniDruidCliDriver#testCliDriver[druid_materialized_view_rewrite_ssb] is flaky: Open
• TestTriggersTezSessionPoolManager sometimes exits the JVM: Open
• TestNewGetSplitsFormat is unstable: Open
• TestJdbcWithServiceDiscovery is unstable: Open
• TestActivePassiveHA is unstable: Open
• TestJdbcWithMiniLlapVectorArrow is unstable: Open
• TestMiniLlapCliDriver.testCliDriver[merge_test_dummy_operator] is unstable: Open
• TestSlotZnode concurrency tests are unstable: Open
• temp_table_multi_insert_partitioned.q is unstable: Open
• schema_evol_par_vec_table_* tests are unstable: Open
• authorization_disallow_transform.q is unstable: Open
• Run a smoketest during precommit: Open
• TestSparkClient is flaky: Open
• TestDbNotificationListener is unstable: Reopened
• TestTriggersMoveWorkloadManager is unstable: Open
• TestMetrics is flaky: Open
• TestNegativeCliDriver#[external_jdbc_negative] is flaky: Open
• TestMiniLlapLocalCliDriver#testCliDriver[schq_materialized] is flaky: Open
• TestCodahaleMetrics.testFileReporting is flaky: Open
• TestMiniDruidKafkaCliDriver.testCliDriver[druidkafkamini_basic] resultset unstable: Open
• jdbc_handler is flaky: Open
• Run Oracle integration tests during precommit: Open
• Run Mssql integration tests during precommit: Open