Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13925 ETL optimizations
  3. HIVE-13922

Optimize the code path that analyzes/updates col stats

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 2.1.0
    • Metastore
    • None

    Description

      1. Depending on the number of partitions, HiveMetastore::update_partition_column_statistics::getPartValsFromName obtains the same table several times.

      2. In ObjectStore, number of get calls to obtain the column stats can be considerably reduced when writing table/partition stats.

      Attachments

        1. HIVE-13922.1.patch
          15 kB
          Rajesh Balamohan

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-13925 ETL optimizations

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              rajesh.balamohan Rajesh Balamohan
              rajesh.balamohan Rajesh Balamohan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: