Hive
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-7791

Enable tests on Spark branch (1) [Sparch Branch]

    Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: Spark
    • Labels:
      None

      Description

      This jira is to enable most of the tests below. If tests don't pass because of some unsupported feature, ensure that a JIRA exists and move on.

       alter_merge_orc.q,\
        alter_merge_stats_orc.q,\
        auto_join0.q,\
        auto_join1.q,\
        bucket2.q,\
        bucket3.q,\
        bucket4.q,\
        count.q,\
        create_merge_compressed.q,\
        cross_join.q,\
        cross_product_check_1.q,\
        cross_product_check_2.q,\
        ctas.q,\
      custom_input_output_format.q,\
        disable_merge_for_bucketing.q,\
        dynpart_sort_opt_vectorization.q,\
        dynpart_sort_optimization.q,\
      
      1. HIVE-7791.2-spark.patch
        158 kB
        Brock Noland
      2. HIVE-7791.1-spark.patch
        159 kB
        Brock Noland
      3. HIVE-7791.1-spark.patch
        161 kB
        Brock Noland
      4. HIVE-7791.patch
        60 kB
        Brock Noland

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          20h 1m 1 Brock Noland 21/Aug/14 01:21
          Patch Available Patch Available Resolved Resolved
          2d 22h 30m 1 Brock Noland 23/Aug/14 23:51
          Xuefu Zhang made changes -
          Fix Version/s 1.1.0 [ 12329363 ]
          Fix Version/s spark-branch [ 12327352 ]
          Brock Noland made changes -
          Component/s Spark [ 12323200 ]
          Brock Noland made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s spark-branch [ 12327352 ]
          Resolution Fixed [ 1 ]
          Hide
          Brock Noland added a comment -

          Thank you for the review! I have committed to spark.

          Show
          Brock Noland added a comment - Thank you for the review! I have committed to spark.
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12663794/HIVE-7791.2-spark.patch

          ERROR: -1 due to 4 failed/errored test(s), 6005 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2
          org.apache.hive.hcatalog.pig.TestHCatLoader.testReadDataPrimitiveTypes
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/84/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/84/console
          Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-84/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 4 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12663794

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12663794/HIVE-7791.2-spark.patch ERROR: -1 due to 4 failed/errored test(s), 6005 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2 org.apache.hive.hcatalog.pig.TestHCatLoader.testReadDataPrimitiveTypes Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/84/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/84/console Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-84/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 4 tests failed This message is automatically generated. ATTACHMENT ID: 12663794
          Hide
          Szehon Ho added a comment -

          +1

          Show
          Szehon Ho added a comment - +1
          Brock Noland made changes -
          Attachment HIVE-7791.2-spark.patch [ 12663794 ]
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12663329/HIVE-7791.1-spark.patch

          ERROR: -1 due to 4 failed/errored test(s), 5986 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2
          org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/73/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/73/console
          Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-73/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 4 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12663329

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12663329/HIVE-7791.1-spark.patch ERROR: -1 due to 4 failed/errored test(s), 5986 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2 org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/73/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/73/console Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-73/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 4 tests failed This message is automatically generated. ATTACHMENT ID: 12663329
          Brock Noland made changes -
          Attachment HIVE-7791.1-spark.patch [ 12663329 ]
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12663286/HIVE-7791.1-spark.patch

          ERROR: -1 due to 5 failed/errored test(s), 5986 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_null
          org.apache.hive.hcatalog.pig.TestHCatLoader.testReadDataPrimitiveTypes
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/71/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/71/console
          Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-71/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 5 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12663286

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12663286/HIVE-7791.1-spark.patch ERROR: -1 due to 5 failed/errored test(s), 5986 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_null org.apache.hive.hcatalog.pig.TestHCatLoader.testReadDataPrimitiveTypes Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/71/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/71/console Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-71/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 5 tests failed This message is automatically generated. ATTACHMENT ID: 12663286
          Brock Noland made changes -
          Remote Link This issue links to "Review Board (Web Link)" [ 17232 ]
          Hide
          Brock Noland added a comment -

          Attached patch also does not enable:

            dynpart_sort_opt_vectorization.q,\
            dynpart_sort_optimization.q,\
          

          which will be covered by: HIVE-7580

          Show
          Brock Noland added a comment - Attached patch also does not enable: dynpart_sort_opt_vectorization.q,\ dynpart_sort_optimization.q,\ which will be covered by: HIVE-7580
          Brock Noland made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Brock Noland made changes -
          Attachment HIVE-7791.1-spark.patch [ 12663286 ]
          Hide
          Brock Noland added a comment -

          The following tests are related to joins which we don't yet support so I'll add a separate jira for them.

            auto_join0.q,\
            auto_join1.q,\
            cross_join.q,\
            cross_product_check_1.q,\
            cross_product_check_2.q,\
          
          Show
          Brock Noland added a comment - The following tests are related to joins which we don't yet support so I'll add a separate jira for them. auto_join0.q,\ auto_join1.q,\ cross_join.q,\ cross_product_check_1.q,\ cross_product_check_2.q,\
          Brock Noland made changes -
          Attachment HIVE-7791.patch [ 12663242 ]
          Brock Noland made changes -
          Assignee Brock Noland [ brocknoland ]
          Brock Noland made changes -
          Description {noformat}
           alter_merge_orc.q,\
            alter_merge_stats_orc.q,\
            auto_join0.q,\
            auto_join1.q,\
            bucket2.q,\
            bucket3.q,\
            bucket4.q,\
            count.q,\
            create_merge_compressed.q,\
            cross_join.q,\
            cross_product_check_1.q,\
            cross_product_check_2.q,\
            ctas.q,\
          custom_input_output_format.q,\
            disable_merge_for_bucketing.q,\
            dynpart_sort_opt_vectorization.q,\
            dynpart_sort_optimization.q,\
          {noformat}
          This jira is to enable *most* of the tests below. If tests don't pass because of some unsupported feature, ensure that a JIRA exists and move on.
          {noformat}
           alter_merge_orc.q,\
            alter_merge_stats_orc.q,\
            auto_join0.q,\
            auto_join1.q,\
            bucket2.q,\
            bucket3.q,\
            bucket4.q,\
            count.q,\
            create_merge_compressed.q,\
            cross_join.q,\
            cross_product_check_1.q,\
            cross_product_check_2.q,\
            ctas.q,\
          custom_input_output_format.q,\
            disable_merge_for_bucketing.q,\
            dynpart_sort_opt_vectorization.q,\
            dynpart_sort_optimization.q,\
          {noformat}
          Brock Noland made changes -
          Field Original Value New Value
          Description
          {noformat}
           alter_merge_orc.q,\
            alter_merge_stats_orc.q,\
            auto_join0.q,\
            auto_join1.q,\
            bucket2.q,\
            bucket3.q,\
            bucket4.q,\
            count.q,\
            create_merge_compressed.q,\
            cross_join.q,\
            cross_product_check_1.q,\
            cross_product_check_2.q,\
            ctas.q,\
          {noformat}
          {noformat}
           alter_merge_orc.q,\
            alter_merge_stats_orc.q,\
            auto_join0.q,\
            auto_join1.q,\
            bucket2.q,\
            bucket3.q,\
            bucket4.q,\
            count.q,\
            create_merge_compressed.q,\
            cross_join.q,\
            cross_product_check_1.q,\
            cross_product_check_2.q,\
            ctas.q,\
          custom_input_output_format.q,\
            disable_merge_for_bucketing.q,\
            dynpart_sort_opt_vectorization.q,\
            dynpart_sort_optimization.q,\
          {noformat}
          Brock Noland created issue -

            People

            • Assignee:
              Brock Noland
              Reporter:
              Brock Noland
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development