Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0
    • Component/s: repl
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      We want to clean up the old dump dirs to save space and reduce scan time when needed.

        Activity

        Hide
        hiveqa Hive QA added a comment -

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12886788/HIVE-17522.1.patch

        ERROR: -1 due to no test(s) being added or modified.

        ERROR: -1 due to 11 failed/errored test(s), 11040 tests executed
        Failed tests:

        TestAccumuloCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=230)
        TestDummy - did not produce a TEST-*.xml file (likely timed out) (batchId=230)
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[create_view] (batchId=39)
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[insert_values_orig_table_use_metadata] (batchId=61)
        org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[unionDistinct_1] (batchId=143)
        org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[union_fast_stats] (batchId=156)
        org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainanalyze_2] (batchId=100)
        org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[drop_table_failure2] (batchId=89)
        org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] (batchId=234)
        org.apache.hadoop.hive.ql.TestAcidOnTez.testCtasTezUnion (batchId=215)
        org.apache.hadoop.hive.ql.TestAcidOnTez.testNonStandardConversion01 (batchId=215)
        

        Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/6807/testReport
        Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/6807/console
        Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-6807/

        Messages:

        Executing org.apache.hive.ptest.execution.TestCheckPhase
        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Executing org.apache.hive.ptest.execution.ReportingPhase
        Tests exited with: TestsFailedException: 11 tests failed
        

        This message is automatically generated.

        ATTACHMENT ID: 12886788 - PreCommit-HIVE-Build

        Show
        hiveqa Hive QA added a comment - Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12886788/HIVE-17522.1.patch ERROR: -1 due to no test(s) being added or modified. ERROR: -1 due to 11 failed/errored test(s), 11040 tests executed Failed tests: TestAccumuloCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=230) TestDummy - did not produce a TEST-*.xml file (likely timed out) (batchId=230) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[create_view] (batchId=39) org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[insert_values_orig_table_use_metadata] (batchId=61) org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[unionDistinct_1] (batchId=143) org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[union_fast_stats] (batchId=156) org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainanalyze_2] (batchId=100) org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[drop_table_failure2] (batchId=89) org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] (batchId=234) org.apache.hadoop.hive.ql.TestAcidOnTez.testCtasTezUnion (batchId=215) org.apache.hadoop.hive.ql.TestAcidOnTez.testNonStandardConversion01 (batchId=215) Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/6807/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/6807/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-6807/ Messages: Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 11 tests failed This message is automatically generated. ATTACHMENT ID: 12886788 - PreCommit-HIVE-Build
        Hide
        taoli-hwx Tao Li added a comment -

        Test looks good (failures are unrelated). Daniel Dai Can you please take a look at this change?

        Show
        taoli-hwx Tao Li added a comment - Test looks good (failures are unrelated). Daniel Dai Can you please take a look at this change?
        Hide
        daijy Daniel Dai added a comment -

        +1. Patch pushed to master.

        Show
        daijy Daniel Dai added a comment - +1. Patch pushed to master.
        Hide
        leftylev Lefty Leverenz added a comment -

        Doc note: This adds hive.repl.dumpdir.clean.freq and hive.repl.dumpdir.ttl to HiveConf.java, so they need to be documented in the wiki for release 3.0.0.

        Added a TODOC3.0 label.

        Question: What does TTL mean?

        Show
        leftylev Lefty Leverenz added a comment - Doc note: This adds hive.repl.dumpdir.clean.freq and hive.repl.dumpdir.ttl to HiveConf.java, so they need to be documented in the wiki for release 3.0.0. Configuration Properties – Replication Added a TODOC3.0 label. Question: What does TTL mean?

          People

          • Assignee:
            taoli-hwx Tao Li
            Reporter:
            taoli-hwx Tao Li
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development