Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-2367

Indexes' storage descriptors' columns are not deduped, and altering an index leaves behind an unused storage descriptor

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Metastore
    • None
    • metastore, schema, IDXS, index, column descriptor

    Description

      The metastore migration by HIVE-2246 does not dedupe the COLUMNS information for Indexes. That is, the IDXS table has a Storage Descriptor that always points to a new Column Descriptor, which is unlikely shared by any other storage descriptor.

      Therefore, when altering an index, a new storage Descriptor and column descriptor are created. No other objects will reference the old storage descriptor and column descriptor, but they will persist in the metastore db.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-2366 Metastore upgrade scripts for HIVE-2246 do not migrate indexes nor rename the old COLUMNS table

          • Major - Major loss of function.
          • Closed
          requires

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-2246 Dedupe tables' column schemas from partitions in the metastore db

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              sohanjain Sohan Jain
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated: