Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13503

[Umbrella] Test sub-system improvements

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      Primarily targeting faster pre-commit builds.

        Attachments

          Issue Links

          relates to

          Task - A task that needs to be done. HIVE-14547 [Umbrella] Test case fixes / improvements

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. HIVE-14817 Shutdown the SessionManager timeoutChecker thread properly upon shutdown

          • Major - Major loss of function.
          • Resolved
          1.
          		 Create initial test data once across multiple test runs - TestCliDriver Sub-task Patch Available Siddharth Seth
          2.
          		 Add timeout for individual tests Sub-task Patch Available Ashutosh Chauhan
          3.
          		 Add a timeout for static initialization blocks Sub-task Open Unassigned
          4.
          		 Skip running TestDummy where possibe during precommit builds Sub-task Closed Siddharth Seth
          5.
          		 Investigate speeding up artifact rsyncs in the precommit build Sub-task Resolved Unassigned
          6.
          		 Improved logging for ptest Sub-task Closed Siddharth Seth
          7.
          		 Run clidriver tests from within the qtest dir for the precommit tests Sub-task Closed Siddharth Seth
          8.
          		 Add a generic timeout to non CliDriver tests Sub-task Open Siddharth Seth
          9.
          		 Don't allow any test to run for longer than 60minutes in the ptest setup Sub-task Closed Siddharth Seth
          10.
          		 Reduce the max runtime of a test further Sub-task Resolved Siddharth Seth
          11.
          		 Convert MiniTez tests to MiniLlap tests Sub-task Resolved Prasanth Jayachandran
          12.
          		 Explore surefire parallel testing options Sub-task Open Prasanth Jayachandran
          13.
          		 Run additional tests from the module directory Sub-task Resolved Siddharth Seth
          14.
          		 Add support in ptest to create batches for non qfile tests Sub-task Resolved Siddharth Seth
          15.
          		 Remove tez golden files after HIVE-14502 Sub-task Resolved Prasanth Jayachandran
          16.
          		 Enable reuseForks for most modules Sub-task Open Unassigned
          17.
          		 Ptest: Add javadocs/documentation to Ptest code Sub-task Open Unassigned
          18.
          		 Testing: Evaluate and fix overheads in executing a single q test Sub-task Resolved Vaibhav Gumashta
          19.
          		 Sync up configs for MiniTez and MiniLlap Sub-task Open Prasanth Jayachandran
          20.
          		 Minor ptest2 improvements Sub-task Resolved Siddharth Seth
          21.
          		 Minor qtest fixes Sub-task Closed Siddharth Seth
          22.
          		 Add a local cluster for Tez and LLAP Sub-task Closed Siddharth Seth
          23.
          		 Change ptest java language version to 1.7, other version changes and fixes Sub-task Resolved Siddharth Seth
          24.
          		 Have the actual error reported when a q test fails instead of having to go through the logs Sub-task Resolved László Bodor
          25.
          		 Ensure directories are cleaned up on test cleanup in QTestUtil Sub-task Open Unassigned
          26.
          		 ptest uses invalid killall command Sub-task Resolved Unassigned
          27.
          		 Add a warning to the jenkins report for slow tests Sub-task Open Unassigned
          28.
          		 Determine unit tests to batch together based on previous run info Sub-task Open Siddharth Seth
          29.
          		 ptest killall command does not work Sub-task Resolved Siddharth Seth
          30.
          		 Reduce number of retries while starting HiveServer for tests Sub-task Resolved Siddharth Seth
          31.
          		 Separate fstype from cluster type in QTestUtil Sub-task Closed Siddharth Seth
          32.
          		 Improve ptest2 build time Sub-task Resolved Prasanth Jayachandran
          33.
          		 Change qtest logging to not redirect all logs to console Sub-task Closed Siddharth Seth
          34.
          		 Add a core cluster type to QTestUtil Sub-task Closed Siddharth Seth
          35.
          		 Reduce the memory used by MiniMr, MiniTez, MiniLlap tests Sub-task Closed Siddharth Seth
          36.
          		 Improve the 'TestClass' did not produce a TEST-*.xml file message Sub-task Resolved Siddharth Seth
          37.
          		 Add an option to skip log collection for successful tests Sub-task Resolved Siddharth Seth
          38.
          		 Reduce the memory requirements for Spark tests Sub-task Resolved Dapeng Sun
          39.
          		 Improve the 'TestClass' did not produce a TEST-*.xml file message to include list of all qfiles in a batch, batch id Sub-task Resolved Siddharth Seth
          40.
          		 ptest - avoid unnecessary cleanup from previous test runs in batch-exec.vm Sub-task Resolved Siddharth Seth
          41.
          		 Test framework integration with findbugs, rat checks etc. Sub-task Closed Peter Vary
          42.
          		 Reduce the memory used by unit tests, MiniCliDriver, MiniLlapLocal, MiniSpark Sub-task Resolved Siddharth Seth
          43.
          		 Fix batchSize for TestNegativeCliDriver Sub-task Resolved Vihang Karajgaonkar
          44.
          		 Fix ptest2 test failures Sub-task Resolved Vihang Karajgaonkar
          45.
          		 Make it possible to run checkstyle for a specific module Sub-task Closed Peter Vary
          46.
          		 Make it possible to run findbugs for itest modules as well Sub-task Resolved Peter Vary
          47.
          		 Remove YETUS*.sh files after a YETUS release Sub-task Closed Peter Vary
          48.
          		 Integreate YETUS to Pre-Commit Sub-task Closed Ádám Szita
          49.
          		 Run YETUS in Docker container Sub-task Open Unassigned
          50.
          		 Run checkstyle on ptest2 module with proper configuration Sub-task Closed Ádám Szita
          51.
          		 Fix ASF headers Sub-task Closed Ádám Szita
          52.
          		 Upgrade checkstyle version to support lambdas Sub-task Closed Ádám Szita
          53.
          		 Run checkstyle on storage-api module with proper configuration Sub-task Closed Ádám Szita
          54.
          		 Make sure Yetus check always has a full log Sub-task Closed Ádám Szita
          55.
          		 Ensure git gc finished in ptest prep phase before copying repo Sub-task Closed Ádám Szita
          56.
          		 Add findbugs to yetus pre-commit checks Sub-task Resolved Sahil Takiar
          57.
          		 Fix findbugs yetus pre-commit checks Sub-task Resolved Sahil Takiar

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                sseth Siddharth Seth
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: