[HIVE-22942] Replace PTest with an alternative

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Labels: pull-request-available
• Assignee: Zoltan Haindrich
• Reporter: Zoltan Haindrich
• Created: 27/Feb/20 10:26
• Updated: 27/Feb/24 22:23
• Resolved: 29/May/20 11:22

Description

I never opened a jira about this...but it might actually help collect ideas and actually start going somewhere sooner than later

Right now we maintain the ptest2 project inside Hive to be able to run Hive tests in a distributed fashion...the backstab of this solution is that we are putting much effort into maintaining a distributed test execution framework...

I think it would be better if we could find an off the shelf solution for the task and migrate to that instead of putting more efforts into the ptest framework

some info/etc about how it compares to existing one:
https://docs.google.com/document/d/1dhL5B-eBvYNKEsNV3kE6RrkV5w-LtDgw5CtHV5pdoX4/edit#heading=h.e51vlxui3e6n

Issue Links

• links to: GitHub Pull Request #948

Sub-Tasks

• CliDriver leaves the session id in the threadname on failure: Closed
• UDAFExampleMaxMinNUtil.sortedMerge must be able to handle all inputs: Closed
• Prevent infinite loop in TestJdbcWithMiniLlapArrow: Closed
• Reduce MiniDruidCluster memory requeirements: Closed
• PostExecOrcFileDump listing order may depend on the underlying filesystem: Closed
• Increase timeout for some tez tests: Closed
• avro-mapred should not pull in org.mortbay.jetty: Closed
• Scheduled query related qtests may not finish before it's expected: Closed
• Provide a way to have only a selection of datasets loaded: Closed
• Change spark related tests to be optional: Closed
• Update some tests to better tolerate a more busy environment: Closed
• Tolerate in tests that metastore is not removing rows from the skewed_string_list_values table: Closed
• Add qsplits profile: Closed
• schq_ingest may run twice during a test execution: Closed
• QueryDisplay must be threadsafe: Closed
• Add qoption to disable qtests: Closed
• Many fixes and improvements to stabilize tests: Closed
• Upgrade to Kudu 1.12: Closed
• Close stale PRs automatically: Closed
• Build failure is incorrectly reported as tests passed: Closed
• Use junit5 to execute tests: Closed
• Enforce ASF headers on source files: Closed
• Use the test target instead of install: Closed
• Provide a way to check test stability: Closed
• TestTxnHandler#allocateNextWriteIdRetriesAfterDetectingConflictingConcurrentInsert is unstable: Resolved
• Early abort the build in case new commits are added to the PR: Resolved
• RetryTest is unstable: Closed
• Move shaded perf builds into a separate profile: Resolved
• TestAcidTxnCleanerService is unstable: Closed
• special_character_in_tabnames_1.q is unstable: Resolved
• Run metastore verification tests during precommit: Closed
• Some jdbc tests are unstable: Resolved
• Enable removal of old builds on hive ci: Closed
• TestBeeLineWithArgs#testRowsAffected is unstable: Closed
• TestScheduledReplicationScenarios#testAcidTablesReplLoadBootstrapIncr is unstable: Open
• Provide a way to include/exclude a set of tests: Open
• Collect ignored tests: Open
• Run metastore integration tests during precommit: Open
• Running masking_mv.q breaks strict_pruning.q: Patch Available
• stats_list_bucketing breaks sysdb output: Open
• Rows are not removed from the skewed_string_list_values table: Open
• TestJdbcGenericUDTFGetSplits2#testGenericUDTFOrderBySplitCount1 is flaky: Resolved
• TestSessionManagerMetrics#testAbandonedSessionMetrics is unstable: Open
• TransactionalKafkaWriterTest#writerFencedOut is unstable: Open
• TestDbNotificationListener#sqlInsertPartition is unstable: Open
• strict_pruning_2 is unstable: Open
• TestMiniDruidCliDriver#testCliDriver[druid_materialized_view_rewrite_ssb] is flaky: Open
• TestTriggersTezSessionPoolManager sometimes exits the JVM: Open
• TestNewGetSplitsFormat is unstable: Open
• TestJdbcWithServiceDiscovery is unstable: Open
• TestActivePassiveHA is unstable: Open
• TestJdbcWithMiniLlapVectorArrow is unstable: Open
• TestMiniLlapCliDriver.testCliDriver[merge_test_dummy_operator] is unstable: Open
• TestSlotZnode concurrency tests are unstable: Open
• temp_table_multi_insert_partitioned.q is unstable: Open
• schema_evol_par_vec_table_* tests are unstable: Open
• authorization_disallow_transform.q is unstable: Open
• Fix orc_merge9: Resolved
• Run a smoketest during precommit: Open
• TestSparkClient is flaky: Open
• TestDbNotificationListener is unstable: Reopened
• TestTriggersMoveWorkloadManager is unstable: Open
• TestMetrics is flaky: Open
• TestNegativeCliDriver#[external_jdbc_negative] is flaky: Open
• TestMiniLlapLocalCliDriver#testCliDriver[schq_materialized] is flaky: Open
• TestCodahaleMetrics.testFileReporting is flaky: Open
• HiveKafkaProducerTest.resumeTransaction is flaky: Closed
• TestMiniDruidKafkaCliDriver.testCliDriver[druidkafkamini_basic] resultset unstable: Open
• jdbc_handler is flaky: Open
• Run Oracle integration tests during precommit: Open
• Run Mssql integration tests during precommit: Open
• Remove unused code from ptest/ptest2: Closed