Hive
  1. Hive
  2. HIVE-6834

Dynamic partition optimization bails out after removing file sink operator

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.13.0
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      HIVE-6455 introduced scalable dynamic partitioning optimization that bails out after removing the file sink operator. This causes union_remove_16.q test to fail by removing all the stages in the plan.

      1. HIVE-6834.1.patch
        2 kB
        Prasanth Jayachandran

        Activity

        Prasanth Jayachandran created issue -
        Hide
        Prasanth Jayachandran added a comment -

        This patch fixes the bug by moving the precondition check just before modify the operator tree.

        Show
        Prasanth Jayachandran added a comment - This patch fixes the bug by moving the precondition check just before modify the operator tree.
        Prasanth Jayachandran made changes -
        Field Original Value New Value
        Attachment HIVE-6834.1.patch [ 12638518 ]
        Prasanth Jayachandran made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Prasanth Jayachandran added a comment -

        Harish Butani/Gunther Hagleitner Can you please review this one?

        Show
        Prasanth Jayachandran added a comment - Harish Butani / Gunther Hagleitner Can you please review this one?
        Hide
        Harish Butani added a comment -

        +1

        Show
        Harish Butani added a comment - +1
        Hide
        Hive QA added a comment -

        Overall: -1 at least one tests failed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12638518/HIVE-6834.1.patch

        ERROR: -1 due to 1 failed/errored test(s), 5547 tests executed
        Failed tests:

        org.apache.hive.service.cli.thrift.TestThriftHttpCLIService.testExecuteStatementAsync
        

        Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2121/testReport
        Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2121/console

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Executing org.apache.hive.ptest.execution.ReportingPhase
        Tests exited with: TestsFailedException: 1 tests failed
        

        This message is automatically generated.

        ATTACHMENT ID: 12638518

        Show
        Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12638518/HIVE-6834.1.patch ERROR: -1 due to 1 failed/errored test(s), 5547 tests executed Failed tests: org.apache.hive.service.cli.thrift.TestThriftHttpCLIService.testExecuteStatementAsync Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2121/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2121/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed This message is automatically generated. ATTACHMENT ID: 12638518
        Hide
        Prasanth Jayachandran added a comment -

        The test failure is not related.

        Show
        Prasanth Jayachandran added a comment - The test failure is not related.
        Hide
        Harish Butani added a comment -

        Committed to trunk and 0.13
        Thanks Prasanth

        Show
        Harish Butani added a comment - Committed to trunk and 0.13 Thanks Prasanth
        Harish Butani made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            Prasanth Jayachandran
            Reporter:
            Prasanth Jayachandran
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development