Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6292

ponder doing stats-based aggregations in metastore

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Metastore, Statistics
    • None

    Description

      StatsOptimizer currently fetches partition stats from metastore and then performs the aggregation. We could do some of these aggregations directly in metastore. It's probably not a very good idea to mess with SQL queries against underlying database, but at least if MS did the same loops we could avoid a bunch of network communication; that would be esp. good for tables with very large number of partitions.

      Attachments

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-6157 Fetching column stats slower than the 101 during rush hour

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              sershe Sergey Shelukhin
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: