Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.13.0, 0.14.0
    • Fix Version/s: 0.13.0, 0.14.0
    • Component/s: Query Processor
    • Labels:
      None

      Description

      In case of list bucketing HIVE-6455 looks only at this config "hive.optimize.listbucketing" to bail out. There are cases when this config ("hive.optimize.listbucketing") is not set but list bucketing is enabled using SKEWED BY in CREATE TABLE statement.

      1. HIVE-6760.2.patch
        2 kB
        Prasanth Jayachandran
      2. HIVE-6760.1.patch
        1 kB
        Prasanth Jayachandran

        Activity

        Prasanth Jayachandran created issue -
        Prasanth Jayachandran made changes -
        Field Original Value New Value
        Fix Version/s 0.13.0 [ 12324986 ]
        Fix Version/s 0.14.0 [ 12326450 ]
        Prasanth Jayachandran made changes -
        Component/s Query Processor [ 12312586 ]
        Hide
        Prasanth Jayachandran added a comment -

        This patch looks for list bucketing context and then bails out.

        Show
        Prasanth Jayachandran added a comment - This patch looks for list bucketing context and then bails out.
        Prasanth Jayachandran made changes -
        Attachment HIVE-6760.1.patch [ 12637030 ]
        Prasanth Jayachandran made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Prasanth Jayachandran added a comment -

        Looks like list bucketing context is always available. This patch checks further deeper to see if there are any skewed columns and values before bailing out.

        Show
        Prasanth Jayachandran added a comment - Looks like list bucketing context is always available. This patch checks further deeper to see if there are any skewed columns and values before bailing out.
        Prasanth Jayachandran made changes -
        Attachment HIVE-6760.2.patch [ 12637042 ]
        Hide
        Gunther Hagleitner added a comment -

        +1

        Show
        Gunther Hagleitner added a comment - +1
        Hide
        Alan Gates added a comment -

        Ran tests locally, all looks good.

        Show
        Alan Gates added a comment - Ran tests locally, all looks good.
        Hide
        Harish Butani added a comment -

        +1 for 0.13

        Show
        Harish Butani added a comment - +1 for 0.13
        Hide
        Hive QA added a comment -

        Overall: +1 all checks pass

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12637042/HIVE-6760.2.patch

        SUCCESS: +1 5493 tests passed

        Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1991/testReport
        Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1991/console

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Executing org.apache.hive.ptest.execution.ReportingPhase
        

        This message is automatically generated.

        ATTACHMENT ID: 12637042

        Show
        Hive QA added a comment - Overall : +1 all checks pass Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12637042/HIVE-6760.2.patch SUCCESS: +1 5493 tests passed Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1991/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1991/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase This message is automatically generated. ATTACHMENT ID: 12637042
        Hide
        Gunther Hagleitner added a comment -

        Committed to trunk and branch. Thanks Prasanth Jayachandran!

        Show
        Gunther Hagleitner added a comment - Committed to trunk and branch. Thanks Prasanth Jayachandran !
        Gunther Hagleitner made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Hide
        Thejas M Nair added a comment -

        This has been fixed in 0.14 release. Please open new jira if you see any issues.

        Show
        Thejas M Nair added a comment - This has been fixed in 0.14 release. Please open new jira if you see any issues.
        Thejas M Nair made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        10m 56s 1 Prasanth Jayachandran 26/Mar/14 22:52
        Patch Available Patch Available Resolved Resolved
        1d 6h 39m 1 Gunther Hagleitner 28/Mar/14 05:31
        Resolved Resolved Closed Closed
        230d 14h 9m 1 Thejas M Nair 13/Nov/14 19:40

          People

          • Assignee:
            Prasanth Jayachandran
            Reporter:
            Prasanth Jayachandran
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development