Hive
  1. Hive
  2. HIVE-6840

Use Unordered Output for Bucket Map Joins on Tez

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      Tez 0.4 adds a placeholder UnorderedOutput. Once Hive is changed to use 0.4, it should be possible to make use of this.

      1. HIVE-6840.1.patch
        2 kB
        Siddharth Seth
      2. HIVE-6840.2.patch
        2 kB
        Siddharth Seth

        Activity

        Hide
        Siddharth Seth added a comment -

        Simple patch. Requires tez 0.4 dependency though, so will not compile at the moment.
        Vikram Dixit K, Gunther Hagleitner - could you please review. Thanks

        Show
        Siddharth Seth added a comment - Simple patch. Requires tez 0.4 dependency though, so will not compile at the moment. Vikram Dixit K , Gunther Hagleitner - could you please review. Thanks
        Hide
        Gunther Hagleitner added a comment -

        +1 LGTM. Can you switch the pom to 0.4.0 in the same patch? Since it's needed for the patch.

        Show
        Gunther Hagleitner added a comment - +1 LGTM. Can you switch the pom to 0.4.0 in the same patch? Since it's needed for the patch.
        Hide
        Siddharth Seth added a comment -

        Updated patch with tez version changed to 0.4

        Show
        Siddharth Seth added a comment - Updated patch with tez version changed to 0.4
        Hide
        Hive QA added a comment -

        Overall: -1 at least one tests failed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12638856/HIVE-6840.2.patch

        ERROR: -1 due to 1 failed/errored test(s), 5547 tests executed
        Failed tests:

        org.apache.hive.service.cli.thrift.TestThriftBinaryCLIService.testExecuteStatementAsync
        

        Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2149/testReport
        Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2149/console

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Executing org.apache.hive.ptest.execution.ReportingPhase
        Tests exited with: TestsFailedException: 1 tests failed
        

        This message is automatically generated.

        ATTACHMENT ID: 12638856

        Show
        Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12638856/HIVE-6840.2.patch ERROR: -1 due to 1 failed/errored test(s), 5547 tests executed Failed tests: org.apache.hive.service.cli.thrift.TestThriftBinaryCLIService.testExecuteStatementAsync Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2149/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2149/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed This message is automatically generated. ATTACHMENT ID: 12638856
        Hide
        Gunther Hagleitner added a comment -

        Failure is unrelated.

        Show
        Gunther Hagleitner added a comment - Failure is unrelated.
        Hide
        Gunther Hagleitner added a comment -

        Committed to branch and trunk. Thanks Siddharth Seth!

        Show
        Gunther Hagleitner added a comment - Committed to branch and trunk. Thanks Siddharth Seth !

          People

          • Assignee:
            Siddharth Seth
            Reporter:
            Siddharth Seth
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development