Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0
    • Component/s: Query Planning
    • Labels:
      None

      Description

      CLEAR LIBRARY CACHE

      Current version (Hive 0.14) does not support union (or union distinct). It only supports union all. In this patch, we try to add this new feature by rewriting union distinct to union all followed by group by.

      1. HIVE-9039.01.patch
        674 kB
        Pengcheng Xiong
      2. HIVE-9039.02.patch
        678 kB
        Pengcheng Xiong
      3. HIVE-9039.03.patch
        678 kB
        Pengcheng Xiong
      4. HIVE-9039.04.patch
        1.18 MB
        Pengcheng Xiong
      5. HIVE-9039.05.patch
        1.18 MB
        Pengcheng Xiong
      6. HIVE-9039.06.patch
        1.31 MB
        Pengcheng Xiong
      7. HIVE-9039.07.patch
        1.35 MB
        Pengcheng Xiong
      8. HIVE-9039.08.patch
        1.36 MB
        Pengcheng Xiong
      9. HIVE-9039.09.patch
        1.36 MB
        Pengcheng Xiong
      10. HIVE-9039.10.patch
        1.41 MB
        Pengcheng Xiong
      11. HIVE-9039.11.patch
        1.50 MB
        Pengcheng Xiong
      12. HIVE-9039.12.patch
        1.78 MB
        Pengcheng Xiong
      13. HIVE-9039.13.patch
        1.53 MB
        Pengcheng Xiong
      14. HIVE-9039.14.patch
        1.51 MB
        Pengcheng Xiong
      15. HIVE-9039.15.patch
        1.57 MB
        Pengcheng Xiong
      16. HIVE-9039.16.patch
        1.65 MB
        Pengcheng Xiong
      17. HIVE-9039.17.patch
        1.32 MB
        Pengcheng Xiong
      18. HIVE-9039.18.patch
        1.32 MB
        Pengcheng Xiong
      19. HIVE-9039.19.patch
        1.32 MB
        Pengcheng Xiong
      20. HIVE-9039.20.patch
        1.32 MB
        Pengcheng Xiong
      21. HIVE-9039.21.patch
        1.33 MB
        Pengcheng Xiong
      22. HIVE-9039.22.patch
        1.33 MB
        Laljo John Pullokkaran
      23. HIVE-9039.23.patch
        1.31 MB
        Pengcheng Xiong

        Issue Links

          Activity

          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12685683/HIVE-9039.01.patch

          ERROR: -1 due to 12 failed/errored test(s), 6700 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_logical
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_1_23
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_skew_1_23
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input_part7
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join34
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join35
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_optimize_nullscan
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union22
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union24
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_ppr
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_decimal_aggregate
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1993/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1993/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1993/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 12 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12685683 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12685683/HIVE-9039.01.patch ERROR: -1 due to 12 failed/errored test(s), 6700 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_logical org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_1_23 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_skew_1_23 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input_part7 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join34 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join35 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union22 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union24 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_ppr org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_decimal_aggregate org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1993/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1993/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1993/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 12 tests failed This message is automatically generated. ATTACHMENT ID: 12685683 - PreCommit-HIVE-TRUNK-Build
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12686740/HIVE-9039.02.patch

          ERROR: -1 due to 2 failed/errored test(s), 6703 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
          org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2051/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2051/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2051/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 2 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12686740 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12686740/HIVE-9039.02.patch ERROR: -1 due to 2 failed/errored test(s), 6703 tests executed Failed tests: org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2051/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2051/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2051/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed This message is automatically generated. ATTACHMENT ID: 12686740 - PreCommit-HIVE-TRUNK-Build
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12686767/HIVE-9039.02.patch

          ERROR: -1 due to 1 failed/errored test(s), 6703 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2054/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2054/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2054/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 1 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12686767 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12686767/HIVE-9039.02.patch ERROR: -1 due to 1 failed/errored test(s), 6703 tests executed Failed tests: org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2054/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2054/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2054/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed This message is automatically generated. ATTACHMENT ID: 12686767 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          update golden file for nullscan

          Show
          Pengcheng Xiong added a comment - update golden file for nullscan
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12686910/HIVE-9039.03.patch

          ERROR: -1 due to 2 failed/errored test(s), 6703 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority
          org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2066/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2066/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2066/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 2 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12686910 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12686910/HIVE-9039.03.patch ERROR: -1 due to 2 failed/errored test(s), 6703 tests executed Failed tests: org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2066/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2066/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2066/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed This message is automatically generated. ATTACHMENT ID: 12686910 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          Laljo John Pullokkaran, could you please review the code? The failed tests are not related. Thanks.

          Show
          Pengcheng Xiong added a comment - Laljo John Pullokkaran , could you please review the code? The failed tests are not related. Thanks.
          Hide
          Pengcheng Xiong added a comment -

          patch after the blocker patches checked in

          Show
          Pengcheng Xiong added a comment - patch after the blocker patches checked in
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12688206/HIVE-9039.04.patch

          ERROR: -1 due to 2 failed/errored test(s), 6722 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_1
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2139/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2139/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2139/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 2 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12688206 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12688206/HIVE-9039.04.patch ERROR: -1 due to 2 failed/errored test(s), 6722 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_1 Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2139/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2139/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2139/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed This message is automatically generated. ATTACHMENT ID: 12688206 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          update golden file due to the previous commit HIVE-7024 : Escape control characters for explain result (Navis reviewed by Sergey Shelukhin)

          Show
          Pengcheng Xiong added a comment - update golden file due to the previous commit HIVE-7024 : Escape control characters for explain result (Navis reviewed by Sergey Shelukhin)
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12688368/HIVE-9039.05.patch

          ERROR: -1 due to 3 failed/errored test(s), 6722 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_nonmr_fetch
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_virtual_column
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2144/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2144/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2144/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 3 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12688368 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12688368/HIVE-9039.05.patch ERROR: -1 due to 3 failed/errored test(s), 6722 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_nonmr_fetch org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_virtual_column org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2144/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2144/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2144/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 3 tests failed This message is automatically generated. ATTACHMENT ID: 12688368 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          3 failures are not related. Laljo John Pullokkaran, could you please take a look? Thanks!

          Show
          Pengcheng Xiong added a comment - 3 failures are not related. Laljo John Pullokkaran , could you please take a look? Thanks!
          Hide
          Laljo John Pullokkaran added a comment -

          Could you change parser to support Union key word; i.e union -> union Distinct

          Show
          Laljo John Pullokkaran added a comment - Could you change parser to support Union key word; i.e union -> union Distinct
          Hide
          Pengcheng Xiong added a comment -

          Hi John,

          If you scroll down in HiveParser.g, you will see

          KW_UNION KW_DISTINCT? -> ^(TOK_UNIONDISTINCT)

          This means, union, union distinct will both be treated as union distinct

          Show
          Pengcheng Xiong added a comment - Hi John, If you scroll down in HiveParser.g, you will see KW_UNION KW_DISTINCT? -> ^(TOK_UNIONDISTINCT) This means, union, union distinct will both be treated as union distinct
          Hide
          Pengcheng Xiong added a comment -

          (1) support select distinct *
          (2) use select distinct * to rewrite union distinct to union all with group by

          Show
          Pengcheng Xiong added a comment - (1) support select distinct * (2) use select distinct * to rewrite union distinct to union all with group by
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12689141/HIVE-9039.06.patch

          ERROR: -1 due to 20 failed/errored test(s), 6728 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_complex_alias
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_view
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multi_join_union
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_union_view
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoin_mapjoin5
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoin_mapjoin7
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt9
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union27
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union34
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_12
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_13
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_14
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_6
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_top_level
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_view
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_smb_main
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_1
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_list_bucket_dml_10
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_ql_rewrite_gbtoidx
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2196/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2196/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2196/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 20 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12689141 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12689141/HIVE-9039.06.patch ERROR: -1 due to 20 failed/errored test(s), 6728 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_complex_alias org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_view org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multi_join_union org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_union_view org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoin_mapjoin5 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoin_mapjoin7 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt9 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union27 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union34 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_12 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_13 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_14 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_6 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_top_level org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_view org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_smb_main org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_1 org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_list_bucket_dml_10 org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_ql_rewrite_gbtoidx Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2196/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2196/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2196/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 20 tests failed This message is automatically generated. ATTACHMENT ID: 12689141 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          update golden files

          Show
          Pengcheng Xiong added a comment - update golden files
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12689198/HIVE-9039.07.patch

          ERROR: -1 due to 3 failed/errored test(s), 6729 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoin_mapjoin5
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_list_bucket_dml_10
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2201/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2201/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2201/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 3 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12689198 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12689198/HIVE-9039.07.patch ERROR: -1 due to 3 failed/errored test(s), 6729 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoin_mapjoin5 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_list_bucket_dml_10 Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2201/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2201/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2201/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 3 tests failed This message is automatically generated. ATTACHMENT ID: 12689198 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          rebase on HIVE-9133

          Show
          Pengcheng Xiong added a comment - rebase on HIVE-9133
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12689369/HIVE-9039.08.patch

          ERROR: -1 due to 2 failed/errored test(s), 6729 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_list_bucket_dml_10
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2211/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2211/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2211/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 2 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12689369 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12689369/HIVE-9039.08.patch ERROR: -1 due to 2 failed/errored test(s), 6729 tests executed Failed tests: org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_list_bucket_dml_10 Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2211/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2211/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2211/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed This message is automatically generated. ATTACHMENT ID: 12689369 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          address (1) union distinct, union order by limit in select statement. Now limit can not be in the non-final sub select statement. (2) Need to do more for fromstatement. It seems that "from src select key select value;" will pass the semantic analyzer but will fail in the task compilation. Then, how to address
          from src select key select value limit 1 union all from src select key select value limit 1? And, it seems that traditional DBMS will not support from... select... Then, what standard should we follow?

          Show
          Pengcheng Xiong added a comment - address (1) union distinct, union order by limit in select statement. Now limit can not be in the non-final sub select statement. (2) Need to do more for fromstatement. It seems that "from src select key select value;" will pass the semantic analyzer but will fail in the task compilation. Then, how to address from src select key select value limit 1 union all from src select key select value limit 1? And, it seems that traditional DBMS will not support from... select... Then, what standard should we follow?
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12690023/HIVE-9039.09.patch

          ERROR: -1 due to 45 failed/errored test(s), 6730 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_view_as_select
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ba_table_union
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cbo_union
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_char_union1
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_or_replace_view
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_view
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_view_partitioned
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_view_translate
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explode_null
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input25
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input26
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lateral_view_noalias
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_load_dyn_part14
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_merge4
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_metadataOnlyOptimizer
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_union_view
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_script_env_var1
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_script_env_var2
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_show_create_table_view
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_exists_explain_rewrite
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_in_explain_rewrite
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union24
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_null
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_25
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_top_level
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_varchar_union1
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_multi_insert
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_view
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_view_cast
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_cbo_union
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_script_env_var1
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_script_env_var2
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_1
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_invalidate_view1
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_lateral_view_join
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_select_star_suffix
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_subquery_exists_implicit_gby
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_subquery_missing_from
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_subquery_nested_subquery
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_subquery_notexists_implicit_gby
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_subquery_windowing_corr
          org.apache.hadoop.hive.ql.parse.TestIUD.testSelectStarFromAnonymousVirtTable1Row
          org.apache.hadoop.hive.ql.parse.TestParseNegative.testParseNegative_invalid_select
          org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2249/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2249/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2249/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 45 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12690023 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12690023/HIVE-9039.09.patch ERROR: -1 due to 45 failed/errored test(s), 6730 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_view_as_select org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ba_table_union org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cbo_union org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_char_union1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_or_replace_view org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_view org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_view_partitioned org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_view_translate org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explode_null org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input25 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input26 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lateral_view_noalias org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_load_dyn_part14 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_merge4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_metadataOnlyOptimizer org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_union_view org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_script_env_var1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_script_env_var2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_show_create_table_view org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_exists_explain_rewrite org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_in_explain_rewrite org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union24 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_null org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_25 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_top_level org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_varchar_union1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_multi_insert org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_view org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_view_cast org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_cbo_union org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_script_env_var1 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_script_env_var2 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_1 org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_invalidate_view1 org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_lateral_view_join org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_select_star_suffix org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_subquery_exists_implicit_gby org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_subquery_missing_from org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_subquery_nested_subquery org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_subquery_notexists_implicit_gby org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_subquery_windowing_corr org.apache.hadoop.hive.ql.parse.TestIUD.testSelectStarFromAnonymousVirtTable1Row org.apache.hadoop.hive.ql.parse.TestParseNegative.testParseNegative_invalid_select org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2249/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2249/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2249/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 45 tests failed This message is automatically generated. ATTACHMENT ID: 12690023 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          After discussing with Laljo John Pullokkaran, we are going to separate the union distinct with union order by/limit bug. This patch is for union distinct implementation only and should be committed after select distinct *

          Show
          Pengcheng Xiong added a comment - After discussing with Laljo John Pullokkaran , we are going to separate the union distinct with union order by/limit bug. This patch is for union distinct implementation only and should be committed after select distinct *
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12690680/HIVE-9039.10.patch

          ERROR: -1 due to 2 failed/errored test(s), 6739 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_6
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2294/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2294/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2294/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 2 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12690680 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12690680/HIVE-9039.10.patch ERROR: -1 due to 2 failed/errored test(s), 6739 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_6 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2294/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2294/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2294/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed This message is automatically generated. ATTACHMENT ID: 12690680 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          now, union distinct is implemented, union order by, limit bug is fixed. Now also support create view. updated golden files too.

          Show
          Pengcheng Xiong added a comment - now, union distinct is implemented, union order by, limit bug is fixed. Now also support create view. updated golden files too.
          Hide
          Hive QA added a comment -

          Overall: -1 no tests executed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12691418/HIVE-9039.11.patch

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2321/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2321/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2321/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Tests exited with: IllegalArgumentException: No propertifies found in file: mainProperties for property: spark.query.files
          

          This message is automatically generated.

          ATTACHMENT ID: 12691418 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12691418/HIVE-9039.11.patch Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2321/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2321/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2321/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Tests exited with: IllegalArgumentException: No propertifies found in file: mainProperties for property: spark.query.files This message is automatically generated. ATTACHMENT ID: 12691418 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          don't know why the previous patch can not work. resubmit.

          Show
          Pengcheng Xiong added a comment - don't know why the previous patch can not work. resubmit.
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12691513/HIVE-9039.12.patch

          ERROR: -1 due to 8 failed/errored test(s), 6743 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_complex_alias
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_logical
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_percentile_approx_23
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union3
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_25
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_union3
          org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2331/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2331/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2331/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 8 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12691513 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12691513/HIVE-9039.12.patch ERROR: -1 due to 8 failed/errored test(s), 6743 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_complex_alias org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_logical org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_percentile_approx_23 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union3 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_25 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_union3 org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2331/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2331/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2331/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 8 tests failed This message is automatically generated. ATTACHMENT ID: 12691513 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          update golden files, e.g., union3

          Show
          Pengcheng Xiong added a comment - update golden files, e.g., union3
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12691565/HIVE-9039.13.patch

          ERROR: -1 due to 1 failed/errored test(s), 6753 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_25
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2333/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2333/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2333/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 1 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12691565 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12691565/HIVE-9039.13.patch ERROR: -1 due to 1 failed/errored test(s), 6753 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_25 Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2333/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2333/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2333/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed This message is automatically generated. ATTACHMENT ID: 12691565 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          update union remove 25.q

          Show
          Pengcheng Xiong added a comment - update union remove 25.q
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12691597/HIVE-9039.14.patch

          ERROR: -1 due to 19 failed/errored test(s), 7314 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_25
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join27
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_groupby_sort_1_23
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_groupby_sort_skew_1_23
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join34
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join35
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_load_dyn_part14
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_parallel_join0
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_script_env_var1
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_script_env_var2
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt9
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union3
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_null
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_ppr
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_remove_10
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_remove_25
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_windowing
          org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2336/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2336/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2336/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 19 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12691597 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12691597/HIVE-9039.14.patch ERROR: -1 due to 19 failed/errored test(s), 7314 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_25 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join27 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_groupby_sort_1_23 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_groupby_sort_skew_1_23 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join34 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join35 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_load_dyn_part14 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_parallel_join0 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_script_env_var1 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_script_env_var2 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt9 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union3 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_null org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_ppr org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_remove_10 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_remove_25 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_windowing org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1 Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2336/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2336/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2336/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 19 tests failed This message is automatically generated. ATTACHMENT ID: 12691597 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          update golden files for spark, add negative tests as well.

          Show
          Pengcheng Xiong added a comment - update golden files for spark, add negative tests as well.
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12691725/HIVE-9039.15.patch

          ERROR: -1 due to 5 failed/errored test(s), 7321 tests executed
          Failed tests:

          TestCustomAuthentication - did not produce a TEST-*.xml file
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
          org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_unionSemantic
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan
          org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2344/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2344/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2344/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 5 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12691725 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12691725/HIVE-9039.15.patch ERROR: -1 due to 5 failed/errored test(s), 7321 tests executed Failed tests: TestCustomAuthentication - did not produce a TEST-*.xml file org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_unionSemantic org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1 Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2344/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2344/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2344/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 5 tests failed This message is automatically generated. ATTACHMENT ID: 12691725 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          rebase the patch on HIVE-9194

          Show
          Pengcheng Xiong added a comment - rebase the patch on HIVE-9194
          Hide
          Hive QA added a comment -

          Overall: -1 no tests executed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12692386/HIVE-9039.16.patch

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2388/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2388/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2388/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Tests exited with: NonZeroExitCodeException
          Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]]
          + export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
          + JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
          + export PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
          + PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
          + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
          + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
          + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
          + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
          + cd /data/hive-ptest/working/
          + tee /data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-2388/source-prep.txt
          + [[ false == \t\r\u\e ]]
          + mkdir -p maven ivy
          + [[ svn = \s\v\n ]]
          + [[ -n '' ]]
          + [[ -d apache-svn-trunk-source ]]
          + [[ ! -d apache-svn-trunk-source/.svn ]]
          + [[ ! -d apache-svn-trunk-source ]]
          + cd apache-svn-trunk-source
          + svn revert -R .
          Reverted 'ql/src/test/results/clientpositive/spark/smb_mapjoin_25.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/ppd_outer_join5.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/vector_mapjoin_reduce.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/ppd_join4.q.out'
          Reverted 'ql/src/test/results/clientpositive/ppd_clusterby.q.out'
          Reverted 'ql/src/test/results/clientpositive/cluster.q.out'
          Reverted 'ql/src/test/results/clientpositive/regex_col.q.out'
          Reverted 'ql/src/test/results/clientpositive/smb_mapjoin_25.q.out'
          Reverted 'ql/src/test/results/clientpositive/join_nullsafe.q.out'
          Reverted 'ql/src/test/results/clientpositive/identity_project_remove_skip.q.out'
          Reverted 'ql/src/test/results/clientpositive/ppd_join4.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/join_nullsafe.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/vector_decimal_mapjoin.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/vector_mapjoin_reduce.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/vectorized_dynamic_partition_pruning.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out'
          Reverted 'ql/src/test/results/clientpositive/constprog_partitioner.q.out'
          Reverted 'ql/src/test/results/clientpositive/union27.q.out'
          Reverted 'ql/src/test/results/clientpositive/ppd2.q.out'
          Reverted 'ql/src/test/results/clientpositive/constprog2.q.out'
          Reverted 'ql/src/test/results/clientpositive/ppd_outer_join5.q.out'
          Reverted 'ql/src/test/results/clientpositive/vector_mapjoin_reduce.q.out'
          Reverted 'ql/src/test/results/clientpositive/ppd_union_view.q.out'
          Reverted 'ql/src/test/queries/clientpositive/constprog_partitioner.q'
          Reverted 'ql/src/java/org/apache/hadoop/hive/ql/optimizer/ConstantPropagateProcFactory.java'
          ++ egrep -v '^X|^Performing status on external'
          ++ awk '{print $2}'
          ++ svn status --no-ignore
          + rm -rf target datanucleus.log ant/target shims/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/scheduler/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target itests/target itests/thirdparty itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-unit-hadoop2/target itests/hive-minikdc/target itests/hive-unit/target itests/custom-serde/target itests/util/target itests/qtest-spark/target hcatalog/target hcatalog/core/target hcatalog/streaming/target hcatalog/server-extensions/target hcatalog/hcatalog-pig-adapter/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target accumulo-handler/target hwi/target common/target common/src/gen spark-client/target service/target contrib/target serde/target beeline/target odbc/target cli/target ql/dependency-reduced-pom.xml ql/target
          + svn update
          
          Fetching external item into 'hcatalog/src/test/e2e/harness'
          External at revision 1652352.
          
          At revision 1652352.
          + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
          + patchFilePath=/data/hive-ptest/working/scratch/build.patch
          + [[ -f /data/hive-ptest/working/scratch/build.patch ]]
          + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
          + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch
          The patch does not appear to apply with p0, p1, or p2
          + exit 1
          '
          

          This message is automatically generated.

          ATTACHMENT ID: 12692386 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12692386/HIVE-9039.16.patch Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2388/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2388/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2388/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]] + export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera + JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera + export PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin + PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + cd /data/hive-ptest/working/ + tee /data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-2388/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ svn = \s\v\n ]] + [[ -n '' ]] + [[ -d apache-svn-trunk-source ]] + [[ ! -d apache-svn-trunk-source/.svn ]] + [[ ! -d apache-svn-trunk-source ]] + cd apache-svn-trunk-source + svn revert -R . Reverted 'ql/src/test/results/clientpositive/spark/smb_mapjoin_25.q.out' Reverted 'ql/src/test/results/clientpositive/spark/ppd_outer_join5.q.out' Reverted 'ql/src/test/results/clientpositive/spark/vector_mapjoin_reduce.q.out' Reverted 'ql/src/test/results/clientpositive/spark/ppd_join4.q.out' Reverted 'ql/src/test/results/clientpositive/ppd_clusterby.q.out' Reverted 'ql/src/test/results/clientpositive/cluster.q.out' Reverted 'ql/src/test/results/clientpositive/regex_col.q.out' Reverted 'ql/src/test/results/clientpositive/smb_mapjoin_25.q.out' Reverted 'ql/src/test/results/clientpositive/join_nullsafe.q.out' Reverted 'ql/src/test/results/clientpositive/identity_project_remove_skip.q.out' Reverted 'ql/src/test/results/clientpositive/ppd_join4.q.out' Reverted 'ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out' Reverted 'ql/src/test/results/clientpositive/tez/join_nullsafe.q.out' Reverted 'ql/src/test/results/clientpositive/tez/vector_decimal_mapjoin.q.out' Reverted 'ql/src/test/results/clientpositive/tez/vector_mapjoin_reduce.q.out' Reverted 'ql/src/test/results/clientpositive/tez/vectorized_dynamic_partition_pruning.q.out' Reverted 'ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out' Reverted 'ql/src/test/results/clientpositive/constprog_partitioner.q.out' Reverted 'ql/src/test/results/clientpositive/union27.q.out' Reverted 'ql/src/test/results/clientpositive/ppd2.q.out' Reverted 'ql/src/test/results/clientpositive/constprog2.q.out' Reverted 'ql/src/test/results/clientpositive/ppd_outer_join5.q.out' Reverted 'ql/src/test/results/clientpositive/vector_mapjoin_reduce.q.out' Reverted 'ql/src/test/results/clientpositive/ppd_union_view.q.out' Reverted 'ql/src/test/queries/clientpositive/constprog_partitioner.q' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/optimizer/ConstantPropagateProcFactory.java' ++ egrep -v '^X|^Performing status on external' ++ awk '{print $2}' ++ svn status --no-ignore + rm -rf target datanucleus.log ant/target shims/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/scheduler/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target itests/target itests/thirdparty itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-unit-hadoop2/target itests/hive-minikdc/target itests/hive-unit/target itests/custom-serde/target itests/util/target itests/qtest-spark/target hcatalog/target hcatalog/core/target hcatalog/streaming/target hcatalog/server-extensions/target hcatalog/hcatalog-pig-adapter/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target accumulo-handler/target hwi/target common/target common/src/gen spark-client/target service/target contrib/target serde/target beeline/target odbc/target cli/target ql/dependency-reduced-pom.xml ql/target + svn update Fetching external item into 'hcatalog/src/test/e2e/harness' External at revision 1652352. At revision 1652352. + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hive-ptest/working/scratch/build.patch + [[ -f /data/hive-ptest/working/scratch/build.patch ]] + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch The patch does not appear to apply with p0, p1, or p2 + exit 1 ' This message is automatically generated. ATTACHMENT ID: 12692386 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          remove TOK_UNION from non-reserved words

          Show
          Pengcheng Xiong added a comment - remove TOK_UNION from non-reserved words
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12692853/HIVE-9039.17.patch

          ERROR: -1 due to 12 failed/errored test(s), 7258 tests executed
          Failed tests:

          TestMiniTezCliDriver-scriptfile1.q-union2.q-vectorized_bucketmapjoin1.q-and-12-more - did not produce a TEST-*.xml file
          TestMiniTezCliDriver-vectorization_10.q-vector_partitioned_date_time.q-vector_non_string_partition.q-and-12-more - did not produce a TEST-*.xml file
          TestMiniTezCliDriver-vectorization_16.q-mapjoin_mapjoin.q-groupby2.q-and-12-more - did not produce a TEST-*.xml file
          TestMinimrCliDriver-bucketmapjoin6.q-constprog_partitioner.q-infer_bucket_sort_dyn_part.q-and-1-more - did not produce a TEST-*.xml file
          TestMinimrCliDriver-load_fs2.q-file_with_header_footer.q-ql_rewrite_gbtoidx_cbo_1.q-and-1-more - did not produce a TEST-*.xml file
          TestMinimrCliDriver-schemeAuthority2.q-infer_bucket_sort_bucketed_table.q-bucket4.q-and-1-more - did not produce a TEST-*.xml file
          TestMinimrCliDriver-smb_mapjoin_8.q - did not produce a TEST-*.xml file
          TestNegativeMinimrCliDriver-udf_local_resource.q-mapreduce_stack_trace_turnoff_hadoop20.q-mapreduce_stack_trace.q-and-5-more - did not produce a TEST-*.xml file
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_histogram_numeric
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_ql_rewrite_gbtoidx
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan
          org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2407/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2407/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2407/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 12 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12692853 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12692853/HIVE-9039.17.patch ERROR: -1 due to 12 failed/errored test(s), 7258 tests executed Failed tests: TestMiniTezCliDriver-scriptfile1.q-union2.q-vectorized_bucketmapjoin1.q-and-12-more - did not produce a TEST-*.xml file TestMiniTezCliDriver-vectorization_10.q-vector_partitioned_date_time.q-vector_non_string_partition.q-and-12-more - did not produce a TEST-*.xml file TestMiniTezCliDriver-vectorization_16.q-mapjoin_mapjoin.q-groupby2.q-and-12-more - did not produce a TEST-*.xml file TestMinimrCliDriver-bucketmapjoin6.q-constprog_partitioner.q-infer_bucket_sort_dyn_part.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-load_fs2.q-file_with_header_footer.q-ql_rewrite_gbtoidx_cbo_1.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-schemeAuthority2.q-infer_bucket_sort_bucketed_table.q-bucket4.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-smb_mapjoin_8.q - did not produce a TEST-*.xml file TestNegativeMinimrCliDriver-udf_local_resource.q-mapreduce_stack_trace_turnoff_hadoop20.q-mapreduce_stack_trace.q-and-5-more - did not produce a TEST-*.xml file org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_histogram_numeric org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_ql_rewrite_gbtoidx org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1 Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2407/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2407/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2407/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 12 tests failed This message is automatically generated. ATTACHMENT ID: 12692853 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          update golden files

          Show
          Pengcheng Xiong added a comment - update golden files
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12692960/HIVE-9039.18.patch

          ERROR: -1 due to 16 failed/errored test(s), 7253 tests executed
          Failed tests:

          TestAccumuloRangeGenerator - did not produce a TEST-*.xml file
          TestLongComparison - did not produce a TEST-*.xml file
          TestMiniTezCliDriver-insert_update_delete.q-vector_groupby_3.q-auto_sortmerge_join_4.q - did not produce a TEST-*.xml file
          TestMiniTezCliDriver-script_pipe.q-unionDistinct_1.q-insert_values_non_partitioned.q-and-12-more - did not produce a TEST-*.xml file
          TestMiniTezCliDriver-vector_data_types.q-orc_merge5.q-vectorization_limit.q-and-12-more - did not produce a TEST-*.xml file
          TestMiniTezCliDriver-vectorization_10.q-vector_partitioned_date_time.q-vector_non_string_partition.q-and-12-more - did not produce a TEST-*.xml file
          TestMinimrCliDriver-infer_bucket_sort_map_operators.q-join1.q-bucketmapjoin7.q-and-1-more - did not produce a TEST-*.xml file
          TestMinimrCliDriver-infer_bucket_sort_reducers_power_two.q-scriptfile1.q-scriptfile1_win.q-and-1-more - did not produce a TEST-*.xml file
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_histogram_numeric
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join4
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_mapjoin_subquery2
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_statsfs
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_table_access_keys_stats
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union25
          org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_remove_21
          org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2413/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2413/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2413/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 16 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12692960 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12692960/HIVE-9039.18.patch ERROR: -1 due to 16 failed/errored test(s), 7253 tests executed Failed tests: TestAccumuloRangeGenerator - did not produce a TEST-*.xml file TestLongComparison - did not produce a TEST-*.xml file TestMiniTezCliDriver-insert_update_delete.q-vector_groupby_3.q-auto_sortmerge_join_4.q - did not produce a TEST-*.xml file TestMiniTezCliDriver-script_pipe.q-unionDistinct_1.q-insert_values_non_partitioned.q-and-12-more - did not produce a TEST-*.xml file TestMiniTezCliDriver-vector_data_types.q-orc_merge5.q-vectorization_limit.q-and-12-more - did not produce a TEST-*.xml file TestMiniTezCliDriver-vectorization_10.q-vector_partitioned_date_time.q-vector_non_string_partition.q-and-12-more - did not produce a TEST-*.xml file TestMinimrCliDriver-infer_bucket_sort_map_operators.q-join1.q-bucketmapjoin7.q-and-1-more - did not produce a TEST-*.xml file TestMinimrCliDriver-infer_bucket_sort_reducers_power_two.q-scriptfile1.q-scriptfile1_win.q-and-1-more - did not produce a TEST-*.xml file org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_histogram_numeric org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join4 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_mapjoin_subquery2 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_statsfs org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_table_access_keys_stats org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union25 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_union_remove_21 org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1 Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2413/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2413/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2413/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 16 tests failed This message is automatically generated. ATTACHMENT ID: 12692960 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          can not understand why the tests failed. Rerun all of them on laptop and all got passed. resubmit the patch

          Show
          Pengcheng Xiong added a comment - can not understand why the tests failed. Rerun all of them on laptop and all got passed. resubmit the patch
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12693127/HIVE-9039.19.patch

          ERROR: -1 due to 3 failed/errored test(s), 7335 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_grouping_window
          org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1
          org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2428/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2428/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2428/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 3 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12693127 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12693127/HIVE-9039.19.patch ERROR: -1 due to 3 failed/errored test(s), 7335 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_grouping_window org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1 org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2428/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2428/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2428/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 3 tests failed This message is automatically generated. ATTACHMENT ID: 12693127 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          Laljo John Pullokkaran, 2 out of 4 failures testCliDriver_groupby_grouping_window and TestMTQueries.testMTQueries1 also fails in the next test in QA, thus, it is not related. The "org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler
          " query failure seems unrelated. Thus, it is ready to go. Thanks.

          Show
          Pengcheng Xiong added a comment - Laljo John Pullokkaran , 2 out of 4 failures testCliDriver_groupby_grouping_window and TestMTQueries.testMTQueries1 also fails in the next test in QA, thus, it is not related. The "org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler " query failure seems unrelated. Thus, it is ready to go. Thanks.
          Hide
          Laljo John Pullokkaran added a comment -

          Please address the review comments; otherwise looks good.

          Show
          Laljo John Pullokkaran added a comment - Please address the review comments; otherwise looks good.
          Hide
          Pengcheng Xiong added a comment -

          address Laljo John Pullokkaran's comments

          Show
          Pengcheng Xiong added a comment - address Laljo John Pullokkaran 's comments
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12693994/HIVE-9039.20.patch

          ERROR: -1 due to 66 failed/errored test(s), 7356 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_excludeHadoop20
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_multi
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join11
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join12
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join13
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join27
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join4
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join5
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join8
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cbo_simple_select
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cbo_subq_in
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_column_access_stats
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_constantPropagateForSubQuery
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer1
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer6
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer8
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_logical
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_join_breaktask
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_join_breaktask2
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_1_23
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_skew_1_23
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_metadataOnlyOptimizer
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_metadataonly1
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_gby2
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_join_filter
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_outer_join5
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_union_view
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_vc
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_rcfile_union
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_smb_mapjoin_25
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_in
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_in_having
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_notin
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_notin_having
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_views
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_table_access_keys_stats
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union24
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union28
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union30
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_null
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_10
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_2
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_5
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_6_subq
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_8
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_9
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_decimal_mapjoin
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_mapjoin_reduce
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_cbo_simple_select
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_cbo_subq_in
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynamic_partition_pruning
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynamic_partition_pruning_2
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_filter_join_breaktask
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_filter_join_breaktask2
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_mrr
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_subquery_in
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_1
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_2
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_decimal_mapjoin
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_mapjoin_reduce
          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vectorized_dynamic_partition_pruning
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_constprog_partitioner
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_ql_rewrite_gbtoidx_cbo_1
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_ql_rewrite_gbtoidx_cbo_2
          org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2491/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2491/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2491/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 66 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12693994 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12693994/HIVE-9039.20.patch ERROR: -1 due to 66 failed/errored test(s), 7356 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_excludeHadoop20 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_multi org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join11 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join12 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join13 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join27 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join5 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join8 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cbo_simple_select org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cbo_subq_in org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_column_access_stats org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_constantPropagateForSubQuery org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer6 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer8 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_explain_logical org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_join_breaktask org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_join_breaktask2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_1_23 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_skew_1_23 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_metadataOnlyOptimizer org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_metadataonly1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_gby2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_join_filter org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_outer_join5 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_union_view org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_vc org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_rcfile_union org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_smb_mapjoin_25 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_in org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_in_having org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_notin org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_notin_having org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_views org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_table_access_keys_stats org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union24 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union28 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union30 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_unionDistinct_1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_null org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_10 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_5 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_6_subq org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_8 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union_remove_9 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_decimal_mapjoin org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_mapjoin_reduce org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_cbo_simple_select org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_cbo_subq_in org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynamic_partition_pruning org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynamic_partition_pruning_2 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_filter_join_breaktask org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_filter_join_breaktask2 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_mrr org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_subquery_in org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_1 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_unionDistinct_2 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_decimal_mapjoin org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_mapjoin_reduce org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vectorized_dynamic_partition_pruning org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_constprog_partitioner org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_ql_rewrite_gbtoidx_cbo_1 org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_ql_rewrite_gbtoidx_cbo_2 org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2491/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2491/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2491/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 66 tests failed This message is automatically generated. ATTACHMENT ID: 12693994 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          rebase patch

          Show
          Pengcheng Xiong added a comment - rebase patch
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12694329/HIVE-9039.21.patch

          ERROR: -1 due to 2 failed/errored test(s), 7375 tests executed
          Failed tests:

          org.apache.hadoop.hive.metastore.txn.TestCompactionTxnHandler.testRevokeTimedOutWorkers
          org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2508/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2508/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2508/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 2 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12694329 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12694329/HIVE-9039.21.patch ERROR: -1 due to 2 failed/errored test(s), 7375 tests executed Failed tests: org.apache.hadoop.hive.metastore.txn.TestCompactionTxnHandler.testRevokeTimedOutWorkers org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2508/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2508/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2508/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed This message is automatically generated. ATTACHMENT ID: 12694329 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          Laljo John Pullokkaran, I checked the failed tests. They are not related and they passed on my laptop. The patch is ready to go. Thanks.

          Show
          Pengcheng Xiong added a comment - Laljo John Pullokkaran , I checked the failed tests. They are not related and they passed on my laptop. The patch is ready to go. Thanks.
          Hide
          Laljo John Pullokkaran added a comment -

          +1

          Show
          Laljo John Pullokkaran added a comment - +1
          Hide
          Hive QA added a comment -

          Overall: -1 no tests executed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12696511/HIVE-9039.22.patch

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2663/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2663/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2663/

          Messages:

          **** This message was trimmed, see log for full details ****
          Reverted 'accumulo-handler/src/test/org/apache/hadoop/hive/accumulo/TestLazyAccumuloRow.java'
          Reverted 'accumulo-handler/src/test/org/apache/hadoop/hive/accumulo/serde/TestAccumuloRowSerializer.java'
          Reverted 'accumulo-handler/src/test/org/apache/hadoop/hive/accumulo/serde/TestDefaultAccumuloRowIdFactory.java'
          Reverted 'accumulo-handler/src/test/org/apache/hadoop/hive/accumulo/serde/TestAccumuloSerDe.java'
          Reverted 'accumulo-handler/src/test/org/apache/hadoop/hive/accumulo/mr/TestHiveAccumuloTableOutputFormat.java'
          Reverted 'accumulo-handler/src/java/org/apache/hadoop/hive/accumulo/serde/AccumuloSerDeParameters.java'
          Reverted 'accumulo-handler/src/java/org/apache/hadoop/hive/accumulo/serde/AccumuloRowSerializer.java'
          Reverted 'accumulo-handler/src/java/org/apache/hadoop/hive/accumulo/serde/DefaultAccumuloRowIdFactory.java'
          Reverted 'accumulo-handler/src/java/org/apache/hadoop/hive/accumulo/serde/AccumuloSerDe.java'
          Reverted 'contrib/src/java/org/apache/hadoop/hive/contrib/serde2/MultiDelimitSerDe.java'
          Reverted 'serde/src/test/org/apache/hadoop/hive/serde2/lazy/TestLazyArrayMapStruct.java'
          Reverted 'serde/src/test/org/apache/hadoop/hive/serde2/lazy/TestLazySimpleSerDe.java'
          Reverted 'serde/src/test/org/apache/hadoop/hive/serde2/objectinspector/TestCrossMapEqualComparer.java'
          Reverted 'serde/src/test/org/apache/hadoop/hive/serde2/objectinspector/TestSimpleMapEqualComparer.java'
          Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyUtils.java'
          Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java'
          Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java'
          Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/columnar/ColumnarSerDe.java'
          Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/columnar/LazyBinaryColumnarSerDe.java'
          Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_3.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin_negative3.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/sample8.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/transform_ppr2.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/union_ppr.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/pcr.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/outer_join_ppr.q.java1.7.out'
          Reverted 'ql/src/test/results/clientpositive/spark/mapjoin_mapjoin.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/router_join_ppr.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/vectorized_ptf.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_4.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin10.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/smb_mapjoin_15.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_11.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/sample10.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/auto_join_reordering_values.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_5.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/louter_join_ppr.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/filter_join_breaktask.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/sort_merge_join_desc_5.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin7.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin11.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/ppd_join_filter.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_12.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/optimize_nullscan.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/sort_merge_join_desc_6.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/groupby_sort_skew_1_23.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin8.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin12.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/sample6.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/join_filters_overlap.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/groupby_sort_1_23.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/bucket_map_join_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_7.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/outer_join_ppr.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/sort_merge_join_desc_7.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin9.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_2.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin13.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/transform_ppr1.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/bucket_map_join_2.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/bucket_map_join_spark4.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/smb_mapjoin_13.q.out'
          Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_8.q.out'
          Reverted 'ql/src/test/results/clientpositive/input_part7.q.out'
          Reverted 'ql/src/test/results/clientpositive/pcr.q.out'
          Reverted 'ql/src/test/results/clientpositive/outer_join_ppr.q.java1.7.out'
          Reverted 'ql/src/test/results/clientpositive/mapjoin_mapjoin.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_5.q.java1.7.out'
          Reverted 'ql/src/test/results/clientpositive/alter_partition_coltype.q.out'
          Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_4.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_query_oneskew_2.q.out'
          Reverted 'ql/src/test/results/clientpositive/sample9.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out'
          Reverted 'ql/src/test/results/clientpositive/combine2_win.q.out'
          Reverted 'ql/src/test/results/clientpositive/push_or.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketcontext_7.q.out'
          Reverted 'ql/src/test/results/clientpositive/groupby_sort_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_11.q.out'
          Reverted 'ql/src/test/results/clientpositive/rand_partitionpruner1.q.out'
          Reverted 'ql/src/test/results/clientpositive/combine2_hadoop20.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketcontext_2.q.out'
          Reverted 'ql/src/test/results/clientpositive/auto_join_reordering_values.q.out'
          Reverted 'ql/src/test/results/clientpositive/filter_join_breaktask.q.out'
          Reverted 'ql/src/test/results/clientpositive/sort_merge_join_desc_5.q.out'
          Reverted 'ql/src/test/results/clientpositive/input_part9.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketmapjoin7.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketmapjoin11.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_12.q.java1.7.out'
          Reverted 'ql/src/test/results/clientpositive/ppd_join_filter.q.out'
          Reverted 'ql/src/test/results/clientpositive/smb_mapjoin_11.q.out'
          Reverted 'ql/src/test/results/clientpositive/ppr_allchildsarenull.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_14.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/groupby_sort_skew_1_23.q.out'
          Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/sample6.q.out'
          Reverted 'ql/src/test/results/clientpositive/join_filters_overlap.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucket_map_join_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_3.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/transform_ppr2.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_12.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/optimize_nullscan.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/mapjoin_mapjoin.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/vectorized_ptf.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_4.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/metadataonly1.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_7.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_2.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/transform_ppr1.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_11.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_5.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/filter_join_breaktask.q.out'
          Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_8.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_4.q.java1.7.out'
          Reverted 'ql/src/test/results/clientpositive/rand_partitionpruner3.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketcontext_4.q.out'
          Reverted 'ql/src/test/results/clientpositive/udtf_explode.q.out'
          Reverted 'ql/src/test/results/clientpositive/sort_merge_join_desc_7.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketmapjoin9.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketmapjoin13.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucket_map_join_spark4.q.out'
          Reverted 'ql/src/test/results/clientpositive/combine2.q.out'
          Reverted 'ql/src/test/results/clientpositive/smb_mapjoin_13.q.out'
          Reverted 'ql/src/test/results/clientpositive/groupby_sort_skew_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_8.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_3.q.out'
          Reverted 'ql/src/test/results/clientpositive/columnstats_partlvl.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out'
          Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_3.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_query_oneskew_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/sample8.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_11.q.java1.7.out'
          Reverted 'ql/src/test/results/clientpositive/transform_ppr2.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_query_multiskew_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/union_ppr.q.out'
          Reverted 'ql/src/test/results/clientpositive/serde_user_properties.q.out'
          Reverted 'ql/src/test/results/clientpositive/ppd_vc.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketcontext_6.q.out'
          Reverted 'ql/src/test/results/clientpositive/router_join_ppr.q.out'
          Reverted 'ql/src/test/results/clientpositive/vectorized_ptf.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketcontext_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/input42.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketmapjoin10.q.out'
          Reverted 'ql/src/test/results/clientpositive/union24.q.out'
          Reverted 'ql/src/test/results/clientpositive/columnstats_tbllvl.q.out'
          Reverted 'ql/src/test/results/clientpositive/smb_mapjoin_15.q.out'
          Reverted 'ql/src/test/results/clientpositive/sample10.q.out'
          Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_5.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_query_oneskew_3.q.out'
          Reverted 'ql/src/test/results/clientpositive/louter_join_ppr.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_query_multiskew_3.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketcontext_8.q.out'
          Reverted 'ql/src/test/results/clientpositive/udf_explode.q.out'
          Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_12.q.out'
          Reverted 'ql/src/test/results/clientpositive/optimize_nullscan.q.out'
          Reverted 'ql/src/test/results/clientpositive/display_colstats_tbllvl.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketcontext_3.q.out'
          Reverted 'ql/src/test/results/clientpositive/temp_table_display_colstats_tbllvl.q.out'
          Reverted 'ql/src/test/results/clientpositive/sort_merge_join_desc_6.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketmapjoin8.q.out'
          Reverted 'ql/src/test/results/clientpositive/encrypted/encryption_join_unencrypted_tbl.q.out'
          Reverted 'ql/src/test/results/clientpositive/encrypted/encryption_join_with_different_encryption_keys.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketmapjoin12.q.out'
          Reverted 'ql/src/test/results/clientpositive/groupby_sort_1_23.q.out'
          Reverted 'ql/src/test/results/clientpositive/constantPropagateForSubQuery.q.out'
          Reverted 'ql/src/test/results/clientpositive/truncate_column_list_bucket.q.out'
          Reverted 'ql/src/test/results/clientpositive/metadataonly1.q.out'
          Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_7.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_2.q.java1.7.out'
          Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_2.q.out'
          Reverted 'ql/src/test/results/clientpositive/transform_ppr1.q.out'
          Reverted 'ql/src/test/results/clientpositive/regexp_extract.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucket_map_join_2.q.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_9.q.java1.7.out'
          Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_13.q.java1.7.out'
          Reverted 'ql/src/test/results/clientpositive/ppd_union_view.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketcontext_5.q.out'
          Reverted 'ql/src/test/results/clientpositive/input23.q.out'
          Reverted 'ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java'
          Reverted 'ql/src/java/org/apache/hadoop/hive/ql/index/HiveIndexResult.java'
          ++ egrep -v '^X|^Performing status on external'
          ++ awk '{print $2}'
          ++ svn status --no-ignore
          + rm -rf target datanucleus.log ant/target shims/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/scheduler/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target data/files/nestedcomplex_additional.txt itests/target itests/thirdparty itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-unit-hadoop2/target itests/hive-minikdc/target itests/hive-jmh/target itests/hive-unit/target itests/custom-serde/target itests/util/target itests/qtest-spark/target hcatalog/target hcatalog/core/target hcatalog/streaming/target hcatalog/server-extensions/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target hcatalog/hcatalog-pig-adapter/target accumulo-handler/target hwi/target common/target common/src/gen spark-client/target service/target contrib/target serde/target serde/src/java/org/apache/hadoop/hive/serde2/SerDeParameters.java beeline/target odbc/target cli/target ql/dependency-reduced-pom.xml ql/target ql/src/test/results/clientpositive/nested_complex_additional.q.out ql/src/test/queries/clientpositive/nested_complex_additional.q
          + svn update
          
          Fetching external item into 'hcatalog/src/test/e2e/harness'
          External at revision 1657492.
          
          At revision 1657492.
          + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
          + patchFilePath=/data/hive-ptest/working/scratch/build.patch
          + [[ -f /data/hive-ptest/working/scratch/build.patch ]]
          + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
          + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch
          The patch does not appear to apply with p0, p1, or p2
          + exit 1
          '
          

          This message is automatically generated.

          ATTACHMENT ID: 12696511 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12696511/HIVE-9039.22.patch Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2663/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2663/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2663/ Messages: **** This message was trimmed, see log for full details **** Reverted 'accumulo-handler/src/test/org/apache/hadoop/hive/accumulo/TestLazyAccumuloRow.java' Reverted 'accumulo-handler/src/test/org/apache/hadoop/hive/accumulo/serde/TestAccumuloRowSerializer.java' Reverted 'accumulo-handler/src/test/org/apache/hadoop/hive/accumulo/serde/TestDefaultAccumuloRowIdFactory.java' Reverted 'accumulo-handler/src/test/org/apache/hadoop/hive/accumulo/serde/TestAccumuloSerDe.java' Reverted 'accumulo-handler/src/test/org/apache/hadoop/hive/accumulo/mr/TestHiveAccumuloTableOutputFormat.java' Reverted 'accumulo-handler/src/java/org/apache/hadoop/hive/accumulo/serde/AccumuloSerDeParameters.java' Reverted 'accumulo-handler/src/java/org/apache/hadoop/hive/accumulo/serde/AccumuloRowSerializer.java' Reverted 'accumulo-handler/src/java/org/apache/hadoop/hive/accumulo/serde/DefaultAccumuloRowIdFactory.java' Reverted 'accumulo-handler/src/java/org/apache/hadoop/hive/accumulo/serde/AccumuloSerDe.java' Reverted 'contrib/src/java/org/apache/hadoop/hive/contrib/serde2/MultiDelimitSerDe.java' Reverted 'serde/src/test/org/apache/hadoop/hive/serde2/lazy/TestLazyArrayMapStruct.java' Reverted 'serde/src/test/org/apache/hadoop/hive/serde2/lazy/TestLazySimpleSerDe.java' Reverted 'serde/src/test/org/apache/hadoop/hive/serde2/objectinspector/TestCrossMapEqualComparer.java' Reverted 'serde/src/test/org/apache/hadoop/hive/serde2/objectinspector/TestSimpleMapEqualComparer.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyUtils.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/columnar/ColumnarSerDe.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/columnar/LazyBinaryColumnarSerDe.java' Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_3.q.out' Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin_negative3.q.out' Reverted 'ql/src/test/results/clientpositive/spark/sample8.q.out' Reverted 'ql/src/test/results/clientpositive/spark/transform_ppr2.q.out' Reverted 'ql/src/test/results/clientpositive/spark/union_ppr.q.out' Reverted 'ql/src/test/results/clientpositive/spark/pcr.q.out' Reverted 'ql/src/test/results/clientpositive/spark/outer_join_ppr.q.java1.7.out' Reverted 'ql/src/test/results/clientpositive/spark/mapjoin_mapjoin.q.out' Reverted 'ql/src/test/results/clientpositive/spark/router_join_ppr.q.out' Reverted 'ql/src/test/results/clientpositive/spark/vectorized_ptf.q.out' Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_4.q.out' Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin10.q.out' Reverted 'ql/src/test/results/clientpositive/spark/smb_mapjoin_15.q.out' Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_11.q.out' Reverted 'ql/src/test/results/clientpositive/spark/sample10.q.out' Reverted 'ql/src/test/results/clientpositive/spark/auto_join_reordering_values.q.out' Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_5.q.out' Reverted 'ql/src/test/results/clientpositive/spark/louter_join_ppr.q.out' Reverted 'ql/src/test/results/clientpositive/spark/filter_join_breaktask.q.out' Reverted 'ql/src/test/results/clientpositive/spark/sort_merge_join_desc_5.q.out' Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin7.q.out' Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin11.q.out' Reverted 'ql/src/test/results/clientpositive/spark/ppd_join_filter.q.out' Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_12.q.out' Reverted 'ql/src/test/results/clientpositive/spark/optimize_nullscan.q.out' Reverted 'ql/src/test/results/clientpositive/spark/sort_merge_join_desc_6.q.out' Reverted 'ql/src/test/results/clientpositive/spark/groupby_sort_skew_1_23.q.out' Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin8.q.out' Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin12.q.out' Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_1.q.out' Reverted 'ql/src/test/results/clientpositive/spark/sample6.q.out' Reverted 'ql/src/test/results/clientpositive/spark/join_filters_overlap.q.out' Reverted 'ql/src/test/results/clientpositive/spark/groupby_sort_1_23.q.out' Reverted 'ql/src/test/results/clientpositive/spark/bucket_map_join_1.q.out' Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_7.q.out' Reverted 'ql/src/test/results/clientpositive/spark/outer_join_ppr.q.out' Reverted 'ql/src/test/results/clientpositive/spark/sort_merge_join_desc_7.q.out' Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin9.q.out' Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_2.q.out' Reverted 'ql/src/test/results/clientpositive/spark/bucketmapjoin13.q.out' Reverted 'ql/src/test/results/clientpositive/spark/transform_ppr1.q.out' Reverted 'ql/src/test/results/clientpositive/spark/bucket_map_join_2.q.out' Reverted 'ql/src/test/results/clientpositive/spark/bucket_map_join_spark4.q.out' Reverted 'ql/src/test/results/clientpositive/spark/smb_mapjoin_13.q.out' Reverted 'ql/src/test/results/clientpositive/spark/auto_sortmerge_join_8.q.out' Reverted 'ql/src/test/results/clientpositive/input_part7.q.out' Reverted 'ql/src/test/results/clientpositive/pcr.q.out' Reverted 'ql/src/test/results/clientpositive/outer_join_ppr.q.java1.7.out' Reverted 'ql/src/test/results/clientpositive/mapjoin_mapjoin.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_5.q.java1.7.out' Reverted 'ql/src/test/results/clientpositive/alter_partition_coltype.q.out' Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_4.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_query_oneskew_2.q.out' Reverted 'ql/src/test/results/clientpositive/sample9.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out' Reverted 'ql/src/test/results/clientpositive/combine2_win.q.out' Reverted 'ql/src/test/results/clientpositive/push_or.q.out' Reverted 'ql/src/test/results/clientpositive/bucketcontext_7.q.out' Reverted 'ql/src/test/results/clientpositive/groupby_sort_1.q.out' Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_11.q.out' Reverted 'ql/src/test/results/clientpositive/rand_partitionpruner1.q.out' Reverted 'ql/src/test/results/clientpositive/combine2_hadoop20.q.out' Reverted 'ql/src/test/results/clientpositive/bucketcontext_2.q.out' Reverted 'ql/src/test/results/clientpositive/auto_join_reordering_values.q.out' Reverted 'ql/src/test/results/clientpositive/filter_join_breaktask.q.out' Reverted 'ql/src/test/results/clientpositive/sort_merge_join_desc_5.q.out' Reverted 'ql/src/test/results/clientpositive/input_part9.q.out' Reverted 'ql/src/test/results/clientpositive/bucketmapjoin7.q.out' Reverted 'ql/src/test/results/clientpositive/bucketmapjoin11.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_12.q.java1.7.out' Reverted 'ql/src/test/results/clientpositive/ppd_join_filter.q.out' Reverted 'ql/src/test/results/clientpositive/smb_mapjoin_11.q.out' Reverted 'ql/src/test/results/clientpositive/ppr_allchildsarenull.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_14.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_1.q.out' Reverted 'ql/src/test/results/clientpositive/groupby_sort_skew_1_23.q.out' Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_1.q.out' Reverted 'ql/src/test/results/clientpositive/sample6.q.out' Reverted 'ql/src/test/results/clientpositive/join_filters_overlap.q.out' Reverted 'ql/src/test/results/clientpositive/bucket_map_join_1.q.out' Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_3.q.out' Reverted 'ql/src/test/results/clientpositive/tez/transform_ppr2.q.out' Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_12.q.out' Reverted 'ql/src/test/results/clientpositive/tez/optimize_nullscan.q.out' Reverted 'ql/src/test/results/clientpositive/tez/mapjoin_mapjoin.q.out' Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_1.q.out' Reverted 'ql/src/test/results/clientpositive/tez/vectorized_ptf.q.out' Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_4.q.out' Reverted 'ql/src/test/results/clientpositive/tez/metadataonly1.q.out' Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_7.q.out' Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_2.q.out' Reverted 'ql/src/test/results/clientpositive/tez/transform_ppr1.q.out' Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_11.q.out' Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_5.q.out' Reverted 'ql/src/test/results/clientpositive/tez/filter_join_breaktask.q.out' Reverted 'ql/src/test/results/clientpositive/tez/auto_sortmerge_join_8.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_4.q.java1.7.out' Reverted 'ql/src/test/results/clientpositive/rand_partitionpruner3.q.out' Reverted 'ql/src/test/results/clientpositive/bucketcontext_4.q.out' Reverted 'ql/src/test/results/clientpositive/udtf_explode.q.out' Reverted 'ql/src/test/results/clientpositive/sort_merge_join_desc_7.q.out' Reverted 'ql/src/test/results/clientpositive/bucketmapjoin9.q.out' Reverted 'ql/src/test/results/clientpositive/bucketmapjoin13.q.out' Reverted 'ql/src/test/results/clientpositive/bucket_map_join_spark4.q.out' Reverted 'ql/src/test/results/clientpositive/combine2.q.out' Reverted 'ql/src/test/results/clientpositive/smb_mapjoin_13.q.out' Reverted 'ql/src/test/results/clientpositive/groupby_sort_skew_1.q.out' Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_8.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_3.q.out' Reverted 'ql/src/test/results/clientpositive/columnstats_partlvl.q.out' Reverted 'ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out' Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_3.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_query_oneskew_1.q.out' Reverted 'ql/src/test/results/clientpositive/sample8.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_11.q.java1.7.out' Reverted 'ql/src/test/results/clientpositive/transform_ppr2.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_query_multiskew_1.q.out' Reverted 'ql/src/test/results/clientpositive/union_ppr.q.out' Reverted 'ql/src/test/results/clientpositive/serde_user_properties.q.out' Reverted 'ql/src/test/results/clientpositive/ppd_vc.q.out' Reverted 'ql/src/test/results/clientpositive/bucketcontext_6.q.out' Reverted 'ql/src/test/results/clientpositive/router_join_ppr.q.out' Reverted 'ql/src/test/results/clientpositive/vectorized_ptf.q.out' Reverted 'ql/src/test/results/clientpositive/bucketcontext_1.q.out' Reverted 'ql/src/test/results/clientpositive/input42.q.out' Reverted 'ql/src/test/results/clientpositive/bucketmapjoin10.q.out' Reverted 'ql/src/test/results/clientpositive/union24.q.out' Reverted 'ql/src/test/results/clientpositive/columnstats_tbllvl.q.out' Reverted 'ql/src/test/results/clientpositive/smb_mapjoin_15.q.out' Reverted 'ql/src/test/results/clientpositive/sample10.q.out' Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_5.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_query_oneskew_3.q.out' Reverted 'ql/src/test/results/clientpositive/louter_join_ppr.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_query_multiskew_3.q.out' Reverted 'ql/src/test/results/clientpositive/bucketcontext_8.q.out' Reverted 'ql/src/test/results/clientpositive/udf_explode.q.out' Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_12.q.out' Reverted 'ql/src/test/results/clientpositive/optimize_nullscan.q.out' Reverted 'ql/src/test/results/clientpositive/display_colstats_tbllvl.q.out' Reverted 'ql/src/test/results/clientpositive/bucketcontext_3.q.out' Reverted 'ql/src/test/results/clientpositive/temp_table_display_colstats_tbllvl.q.out' Reverted 'ql/src/test/results/clientpositive/sort_merge_join_desc_6.q.out' Reverted 'ql/src/test/results/clientpositive/bucketmapjoin8.q.out' Reverted 'ql/src/test/results/clientpositive/encrypted/encryption_join_unencrypted_tbl.q.out' Reverted 'ql/src/test/results/clientpositive/encrypted/encryption_join_with_different_encryption_keys.q.out' Reverted 'ql/src/test/results/clientpositive/bucketmapjoin12.q.out' Reverted 'ql/src/test/results/clientpositive/groupby_sort_1_23.q.out' Reverted 'ql/src/test/results/clientpositive/constantPropagateForSubQuery.q.out' Reverted 'ql/src/test/results/clientpositive/truncate_column_list_bucket.q.out' Reverted 'ql/src/test/results/clientpositive/metadataonly1.q.out' Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_7.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_2.q.java1.7.out' Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_2.q.out' Reverted 'ql/src/test/results/clientpositive/transform_ppr1.q.out' Reverted 'ql/src/test/results/clientpositive/regexp_extract.q.out' Reverted 'ql/src/test/results/clientpositive/bucket_map_join_2.q.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_9.q.java1.7.out' Reverted 'ql/src/test/results/clientpositive/list_bucket_dml_13.q.java1.7.out' Reverted 'ql/src/test/results/clientpositive/ppd_union_view.q.out' Reverted 'ql/src/test/results/clientpositive/bucketcontext_5.q.out' Reverted 'ql/src/test/results/clientpositive/input23.q.out' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/index/HiveIndexResult.java' ++ egrep -v '^X|^Performing status on external' ++ awk '{print $2}' ++ svn status --no-ignore + rm -rf target datanucleus.log ant/target shims/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/scheduler/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target data/files/nestedcomplex_additional.txt itests/target itests/thirdparty itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-unit-hadoop2/target itests/hive-minikdc/target itests/hive-jmh/target itests/hive-unit/target itests/custom-serde/target itests/util/target itests/qtest-spark/target hcatalog/target hcatalog/core/target hcatalog/streaming/target hcatalog/server-extensions/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target hcatalog/hcatalog-pig-adapter/target accumulo-handler/target hwi/target common/target common/src/gen spark-client/target service/target contrib/target serde/target serde/src/java/org/apache/hadoop/hive/serde2/SerDeParameters.java beeline/target odbc/target cli/target ql/dependency-reduced-pom.xml ql/target ql/src/test/results/clientpositive/nested_complex_additional.q.out ql/src/test/queries/clientpositive/nested_complex_additional.q + svn update Fetching external item into 'hcatalog/src/test/e2e/harness' External at revision 1657492. At revision 1657492. + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hive-ptest/working/scratch/build.patch + [[ -f /data/hive-ptest/working/scratch/build.patch ]] + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch The patch does not appear to apply with p0, p1, or p2 + exit 1 ' This message is automatically generated. ATTACHMENT ID: 12696511 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          rebase patch on the most recent changes.

          Show
          Pengcheng Xiong added a comment - rebase patch on the most recent changes.
          Hide
          Hive QA added a comment -

          Overall: +1 all checks pass

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12697414/HIVE-9039.23.patch

          SUCCESS: +1 7531 tests passed

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2722/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2722/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2722/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          

          This message is automatically generated.

          ATTACHMENT ID: 12697414 - PreCommit-HIVE-TRUNK-Build

          Show
          Hive QA added a comment - Overall : +1 all checks pass Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12697414/HIVE-9039.23.patch SUCCESS: +1 7531 tests passed Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2722/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2722/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2722/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase This message is automatically generated. ATTACHMENT ID: 12697414 - PreCommit-HIVE-TRUNK-Build
          Hide
          Pengcheng Xiong added a comment -

          Laljo John Pullokkaran, could you please take a look? I think it is ready to go. Thanks.

          Show
          Pengcheng Xiong added a comment - Laljo John Pullokkaran , could you please take a look? I think it is ready to go. Thanks.
          Hide
          Laljo John Pullokkaran added a comment -

          Committed to trunk.
          Thanks Pengcheng Xiong

          Show
          Laljo John Pullokkaran added a comment - Committed to trunk. Thanks Pengcheng Xiong
          Hide
          Lefty Leverenz added a comment -

          Doc note: This should be documented in the UNION doc, with version information.

          The SELECT doc needs to be updated, because currently its link to the UNION doc says UNION ALL. Also, the section "ALL and DISTINCT Clauses" should link to the UNION doc (and "0.15" should be updated to "1.1.0".)

          And how about a release note?

          Show
          Lefty Leverenz added a comment - Doc note: This should be documented in the UNION doc, with version information. The SELECT doc needs to be updated, because currently its link to the UNION doc says UNION ALL. Also, the section "ALL and DISTINCT Clauses" should link to the UNION doc (and "0.15" should be updated to "1.1.0".) LanguageManual – Union LanguageManual – Select Select – ALL and DISTINCT Clauses Select – More Select Syntax – UNION ALL And how about a release note?
          Hide
          Pengcheng Xiong added a comment -

          Lefty Leverenz, thanks for your comments. I have edit the wiki accordingly. Please let me know if you find anything inappropriate. Thanks again.

          Show
          Pengcheng Xiong added a comment - Lefty Leverenz , thanks for your comments. I have edit the wiki accordingly. Please let me know if you find anything inappropriate. Thanks again.
          Hide
          Lefty Leverenz added a comment -

          Nicely done, Pengcheng Xiong. I added emphasis for version changes at the beginning and trimmed the version note at the end. Feel free to change things back again if you disagree.

          Some minor questions:

          1. In this example, should there be a space before "a" and "b" (after the parentheses) or is it optional?

          SELECT key FROM (SELECT key FROM src ORDER BY key LIMIT 10)a
          UNION
          SELECT key FROM (SELECT key FROM src1 ORDER BY key LIMIT 10)b
          

          2. Does DISTRIBUTE BY belong in the first half of this sentence, or should it be removed from the second half? And can "after the last one" be rephrased "after the last SELECT of the UNION" or something similar?

          To apply an ORDER BY, SORT BY, CLUSTER BY or LIMIT clause to the entire UNION result, place the ORDER BY, SORT BY, CLUSTER BY, DISTRIBUTE BY or LIMIT after the last one.

          Thanks.

          Show
          Lefty Leverenz added a comment - Nicely done, Pengcheng Xiong . I added emphasis for version changes at the beginning and trimmed the version note at the end. Feel free to change things back again if you disagree. Some minor questions: 1. In this example, should there be a space before "a" and "b" (after the parentheses) or is it optional? SELECT key FROM (SELECT key FROM src ORDER BY key LIMIT 10)a UNION SELECT key FROM (SELECT key FROM src1 ORDER BY key LIMIT 10)b 2. Does DISTRIBUTE BY belong in the first half of this sentence, or should it be removed from the second half? And can "after the last one" be rephrased "after the last SELECT of the UNION" or something similar? To apply an ORDER BY, SORT BY, CLUSTER BY or LIMIT clause to the entire UNION result, place the ORDER BY, SORT BY, CLUSTER BY, DISTRIBUTE BY or LIMIT after the last one. Thanks.
          Hide
          Pengcheng Xiong added a comment -

          Lefty Leverenz, thanks a lot for your comments. I have addressed them accordingly in wiki. Please let me know if there is any more. Thanks again.

          Show
          Pengcheng Xiong added a comment - Lefty Leverenz , thanks a lot for your comments. I have addressed them accordingly in wiki. Please let me know if there is any more. Thanks again.
          Hide
          Lefty Leverenz added a comment -

          Looks good, thanks Pengcheng Xiong. I'm removing the TODOC1.2 label.

          Show
          Lefty Leverenz added a comment - Looks good, thanks Pengcheng Xiong . I'm removing the TODOC1.2 label.
          Hide
          Sushanth Sowmyan added a comment -

          This issue has been fixed and released as part of the 1.2.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

          Show
          Sushanth Sowmyan added a comment - This issue has been fixed and released as part of the 1.2.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.
          Hide
          wangwenli added a comment -

          this issue will cause backward compatibility problem, sql like this cann't work anymore:

          select s1.key as k, s2.value as v from src s1 join src s2 on (s1.key = s2.key) limit 10
          union all
          select s1.key as k, s2.value as v from src s1 join src s2 on (s1.key = s2.key) limit 10;

          must change to :
          select * from (select s1.key as k, s2.value as v from src s1 join src s2 on (s1.key = s2.key) limit 10)a
          union all
          select * from (select s1.key as k, s2.value as v from src s1 join src s2 on (s1.key = s2.key) limit 10)b;

          Show
          wangwenli added a comment - this issue will cause backward compatibility problem, sql like this cann't work anymore: select s1.key as k, s2.value as v from src s1 join src s2 on (s1.key = s2.key) limit 10 union all select s1.key as k, s2.value as v from src s1 join src s2 on (s1.key = s2.key) limit 10; must change to : select * from (select s1.key as k, s2.value as v from src s1 join src s2 on (s1.key = s2.key) limit 10)a union all select * from (select s1.key as k, s2.value as v from src s1 join src s2 on (s1.key = s2.key) limit 10)b;
          Hide
          Pengcheng Xiong added a comment -

          wangwenli, please take a look at SQL standard. limit should be applied to the whole union all results.

          Show
          Pengcheng Xiong added a comment - wangwenli , please take a look at SQL standard. limit should be applied to the whole union all results.
          Hide
          wangwenli added a comment -

          Pengcheng Xiong, yes, you are correct, i am not means that , i just want to give a clue that, people once write like that, should be chagned after this .
          coming to this union feature, now it must be put under subqueries, any plan to remove this limitation, support like this?

          (select key,value from src limit 2)
          UNION ALL
          (select key,value from src3 limit 3)

          Show
          wangwenli added a comment - Pengcheng Xiong , yes, you are correct, i am not means that , i just want to give a clue that, people once write like that, should be chagned after this . coming to this union feature, now it must be put under subqueries, any plan to remove this limitation, support like this? (select key,value from src limit 2) UNION ALL (select key,value from src3 limit 3)
          Hide
          Pengcheng Xiong added a comment -

          wangwenli, i'm sorry that we do not have any plan to support the query that you posted. . A workaround would be rewriting them as subqueries.....

          Show
          Pengcheng Xiong added a comment - wangwenli , i'm sorry that we do not have any plan to support the query that you posted. . A workaround would be rewriting them as subqueries.....

            People

            • Assignee:
              Pengcheng Xiong
              Reporter:
              Pengcheng Xiong
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development