Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-2048 Expedite Partition Pruning
  3. HIVE-2114

Backward incompatibility introduced from HIVE-2082 in MetaStoreUtils.getPartSchemaFromTableSchema()

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.8.0
    • Metastore
    • None
    • Reviewed

    Description

      In MetaStoreUtils.getPartSchemaFromTableSchema() the Propertie of a Partitions is first created by cloning the Properties from a Table. Then some of the properties are overwritten by the Partition level properties (Location/InputFormat/OutputFormat etc.). It also copies the properties from the SerDeInfo. If the SerDeInfo contains properties 'columns', 'column_types' and 'partition_columns' this will introduce incompatibility from the previous code path MetaStoreUtils.getSchema(). In getSchema(), the 'columns' etc are put after copying the SerDeInfo, which means we should not overwrite these 3 properties in the new code.

      Attachments

        1. HIVE-2114.patch
          4 kB
          Ning Zhang

        Activity

          People

            nzhang Ning Zhang
            nzhang Ning Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: