Hive
  1. Hive
  2. HIVE-6966

More fixes for TestCliDriver on Windows

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.14.0
    • Component/s: Tests, Windows
    • Labels:
      None

      Description

      This prevents the Test*CliDriver tests from compiling properly.

        Activity

        Hide
        Thejas M Nair added a comment -

        This has been fixed in 0.14 release. Please open new jira if you see any issues.

        Show
        Thejas M Nair added a comment - This has been fixed in 0.14 release. Please open new jira if you see any issues.
        Hide
        Sushanth Sowmyan added a comment -

        Committed to trunk. Thanks, Jason!

        Show
        Sushanth Sowmyan added a comment - Committed to trunk. Thanks, Jason!
        Hide
        Jason Dere added a comment -

        These failures do not look related, they appear to be the list of failing tests on hadoop-2 at the time. Most of these should be resolved by now, we can re-run the tests if you want.

        Show
        Jason Dere added a comment - These failures do not look related, they appear to be the list of failing tests on hadoop-2 at the time. Most of these should be resolved by now, we can re-run the tests if you want.
        Hide
        Sushanth Sowmyan added a comment -

        The test failures noted here seem to not be related to the patch. Jason Dere, could you please verify/confirm? I can go ahead and commit it after that.

        Show
        Sushanth Sowmyan added a comment - The test failures noted here seem to not be related to the patch. Jason Dere , could you please verify/confirm? I can go ahead and commit it after that.
        Hide
        Sushanth Sowmyan added a comment -

        Looks good to me. +1.

        Show
        Sushanth Sowmyan added a comment - Looks good to me. +1.
        Hide
        Hive QA added a comment -

        Overall: -1 at least one tests failed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12641575/HIVE-6966.1.patch

        ERROR: -1 due to 41 failed/errored test(s), 5418 tests executed
        Failed tests:

        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join32
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_filters
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_numeric
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby2_map_skew
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_1
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_skew_1
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_infer_bucket_sort_list_bucket
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_list_bucket_dml_6
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_list_bucket_dml_7
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_list_bucket_dml_8
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapjoin_test_outer
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_nullgroup3
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_createas1
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_join4
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_select_dummy_source
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_list_bucket
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_partscan_1_23
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_symlink_text_input_format
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_truncate_column_list_bucket
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_current_database
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_1
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_10
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_12
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_13
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_14
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_19
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_2
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_20
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_21
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_22
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_23
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_24
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_4
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_5
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_7
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_8
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_9
        org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketizedhiveinputformat
        org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
        org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_dynamic_partitions_with_whitelist
        org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_stats_partialscan_autogether
        

        Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/29/testReport
        Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/29/console

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Executing org.apache.hive.ptest.execution.ReportingPhase
        Tests exited with: TestsFailedException: 41 tests failed
        

        This message is automatically generated.

        ATTACHMENT ID: 12641575

        Show
        Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12641575/HIVE-6966.1.patch ERROR: -1 due to 41 failed/errored test(s), 5418 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join32 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_filters org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_numeric org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby2_map_skew org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_skew_1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_infer_bucket_sort_list_bucket org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_list_bucket_dml_6 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_list_bucket_dml_7 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_list_bucket_dml_8 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapjoin_test_outer org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_nullgroup3 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_createas1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_join4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_select_dummy_source org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_list_bucket org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_partscan_1_23 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_symlink_text_input_format org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_truncate_column_list_bucket org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_current_database org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_10 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_12 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_13 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_14 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_19 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_20 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_21 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_22 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_23 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_24 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_5 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_7 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_8 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_9 org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketizedhiveinputformat org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_dynamic_partitions_with_whitelist org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_stats_partialscan_autogether Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/29/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/29/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 41 tests failed This message is automatically generated. ATTACHMENT ID: 12641575
        Hide
        shanyu zhao added a comment -

        +1.
        I verified that this patch make compile in itests folder work.

        Show
        shanyu zhao added a comment - +1. I verified that this patch make compile in itests folder work.
        Hide
        Jason Dere added a comment -

        Patch v1:

        • escape hiveConfDir when generating Test*CliDriver
        • Fix log4j file scheme on Windows (file:/ instead of file://)
        • Add HADOOP_HOME/bin to PATH when running tests on Windows to fix issues with resolving native libs.
        Show
        Jason Dere added a comment - Patch v1: escape hiveConfDir when generating Test*CliDriver Fix log4j file scheme on Windows ( file:/ instead of file:// ) Add HADOOP_HOME/bin to PATH when running tests on Windows to fix issues with resolving native libs.
        Hide
        Jason Dere added a comment -

        Have a few more Windows-specific fixes for TestCliDriver, will also add here

        Show
        Jason Dere added a comment - Have a few more Windows-specific fixes for TestCliDriver, will also add here

          People

          • Assignee:
            Jason Dere
            Reporter:
            Jason Dere
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development