Hive
  1. Hive
  2. HIVE-6192

Optimize sum(1) to answer query using metadata

    Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: Query Processor, Statistics
    • Labels:
      None

      Description

      sum(1) has same semantics as count(1) so it can also be optimized in similar fashion by answering query using stats stored in metastore.

      1. HIVE-6192.patch
        26 kB
        Ashutosh Chauhan
      2. HIVE-6192.2.patch
        30 kB
        Ashutosh Chauhan

        Issue Links

          Activity

          Hide
          Ashutosh Chauhan added a comment -
          Show
          Ashutosh Chauhan added a comment - RB request : https://reviews.apache.org/r/16829/
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12622711/HIVE-6192.patch

          ERROR: -1 due to 1 failed/errored test(s), 4924 tests executed
          Failed tests:

          org.apache.hcatalog.listener.TestNotificationListener.testAMQListener
          

          Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/892/testReport
          Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/892/console

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 1 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12622711

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12622711/HIVE-6192.patch ERROR: -1 due to 1 failed/errored test(s), 4924 tests executed Failed tests: org.apache.hcatalog.listener.TestNotificationListener.testAMQListener Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/892/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/892/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed This message is automatically generated. ATTACHMENT ID: 12622711
          Hide
          Ashutosh Chauhan added a comment -

          Updated patch incorporating feedback from RB.

          Show
          Ashutosh Chauhan added a comment - Updated patch incorporating feedback from RB.
          Hide
          Thejas M Nair added a comment -

          +1

          Show
          Thejas M Nair added a comment - +1
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12623492/HIVE-6192.2.patch

          ERROR: -1 due to 1 failed/errored test(s), 4927 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestNegativeMinimrCliDriver.testNegativeCliDriver_mapreduce_stack_trace_hadoop20
          

          Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/939/testReport
          Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/939/console

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 1 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12623492

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12623492/HIVE-6192.2.patch ERROR: -1 due to 1 failed/errored test(s), 4927 tests executed Failed tests: org.apache.hadoop.hive.cli.TestNegativeMinimrCliDriver.testNegativeCliDriver_mapreduce_stack_trace_hadoop20 Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/939/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/939/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed This message is automatically generated. ATTACHMENT ID: 12623492
          Hide
          Ashutosh Chauhan added a comment -

          Committed to trunk.

          Show
          Ashutosh Chauhan added a comment - Committed to trunk.

            People

            • Assignee:
              Ashutosh Chauhan
              Reporter:
              Ashutosh Chauhan
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development