Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22942

Replace PTest with an alternative

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: None

      Description

      I never opened a jira about this...but it might actually help collect ideas and actually start going somewhere sooner than later

      Right now we maintain the ptest2 project inside Hive to be able to run Hive tests in a distributed fashion...the backstab of this solution is that we are putting much effort into maintaining a distributed test execution framework...

      I think it would be better if we could find an off the shelf solution for the task and migrate to that instead of putting more efforts into the ptest framework

      some info/etc about how it compares to existing one:
      https://docs.google.com/document/d/1dhL5B-eBvYNKEsNV3kE6RrkV5w-LtDgw5CtHV5pdoX4/edit#heading=h.e51vlxui3e6n

        Attachments

        1. HIVE-22942.01.patch
          25 kB
          Zoltan Haindrich

          Issue Links

          1.
          Provide a way to include/exclude a set of tests Sub-task Open Zoltan Haindrich  
          2.
          Collect ignored tests Sub-task Open Unassigned  
          3.
          Run metastore integration tests during precommit Sub-task Open Unassigned  
          4.
          Running masking_mv.q breaks strict_pruning.q Sub-task Patch Available Zoltan Haindrich  
          5.
          stats_list_bucketing breaks sysdb output Sub-task Open Zoltan Haindrich  
          6.
          Rows are not removed from the skewed_string_list_values table Sub-task Open Unassigned  
          7.
          TestJdbcGenericUDTFGetSplits2#testGenericUDTFOrderBySplitCount1 is flaky Sub-task Open Unassigned  
          8.
          TestScheduledReplicationScenarios#testAcidTablesReplLoadBootstrapIncr is unstable Sub-task Open Pravin Sinha

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          9.
          TestBeeLineWithArgs#testRowsAffected is unstable Sub-task Open Unassigned  
          10.
          TestSessionManagerMetrics#testAbandonedSessionMetrics is unstable Sub-task Open Unassigned  
          11.
          TransactionalKafkaWriterTest#writerFencedOut is unstable Sub-task Open Unassigned  
          12.
          TestDbNotificationListener#sqlInsertPartition is unstable Sub-task Open Unassigned  
          13.
          strict_pruning_2 is unstable Sub-task Open Unassigned  
          14.
          TestMiniDruidCliDriver#testCliDriver[druid_materialized_view_rewrite_ssb] is flaky Sub-task Open Jesus Camacho Rodriguez  
          15.
          TestTriggersTezSessionPoolManager sometimes exits the JVM Sub-task Open Unassigned  
          16.
          TestNewGetSplitsFormat is unstable Sub-task Open Unassigned  
          17.
          TestJdbcWithServiceDiscovery is unstable Sub-task Open Unassigned  
          18.
          TestActivePassiveHA is unstable Sub-task Open Unassigned  
          19.
          TestJdbcWithMiniLlapVectorArrow is unstable Sub-task Open Unassigned  
          20.
          TestMiniLlapCliDriver.testCliDriver[merge_test_dummy_operator] is unstable Sub-task Open Unassigned  
          21.
          TestSlotZnode concurrency tests are unstable Sub-task Open Unassigned  
          22.
          temp_table_multi_insert_partitioned.q is unstable Sub-task Open Unassigned  
          23.
          schema_evol_par_vec_table_* tests are unstable Sub-task Open Unassigned  
          24.
          authorization_disallow_transform.q is unstable Sub-task Open Unassigned  
          25.
          Fix orc_merge9 Sub-task Open Unassigned  
          26.
          Run a smoketest during precommit Sub-task Open Unassigned  
          27.
          TestSparkClient is flaky Sub-task Open Unassigned  
          28.
          TestDbNotificationListener is unstable Sub-task Open Aasha Medhi  
          29.
          TestTriggersMoveWorkloadManager is unstable Sub-task Open Unassigned  
          30.
          TestMetrics is flaky Sub-task Open Unassigned  
          31.
          TestNegativeCliDriver#[external_jdbc_negative] is flaky Sub-task Open Unassigned  
          32.
          TestMiniLlapLocalCliDriver#testCliDriver[schq_materialized] is flaky Sub-task Open Zoltan Haindrich  
          33.
          TestCodahaleMetrics.testFileReporting is flaky Sub-task Open Unassigned  
          34.
          HiveKafkaProducerTest.resumeTransaction is flaky Sub-task Open Unassigned  
          35.
          TestMiniDruidKafkaCliDriver.testCliDriver[druidkafkamini_basic] resultset unstable Sub-task Open Unassigned  
          36.
          jdbc_handler is flaky Sub-task Open Unassigned  
          37.
          Run metastore verification tests during precommit Sub-task Open Zoltan Haindrich

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m

            Activity

              People

              • Assignee:
                kgyrtkirk Zoltan Haindrich
                Reporter:
                kgyrtkirk Zoltan Haindrich
              • Votes:
                0 Vote for this issue
                Watchers:
                17 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 12h 10m
                  12h 10m