[HIVE-19718] Adding partitions in bulk also fetches table for each partition

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Metastore

Environment

Looking at convertToMPart:

  private MPartition convertToMPart(Partition part, boolean useTableCD)
      throws InvalidObjectException, MetaException {
    MTable mt = getMTable(part.getCatName(), part.getDbName(), part.getTableName());
    ...

So what we have as a result is that we fetch table for every partition where it should be done just once.

• Assignee: Peter Vary
• Reporter: Alex Kolbasov
• Created: 25/May/18 23:08
• Updated: 17/Nov/22 08:54
• Resolved: 14/Jun/18 08:12

Description

The ObjectStore.addPartitions() method does this:

for (Partition part : parts) {
  if (!part.getTableName().equals(tblName) || !part.getDbName().equals(dbName)) {
    throw new MetaException("Partition does not belong to target table "
        + dbName + "." + tblName + ": " + part);
  }
  MPartition mpart = convertToMPart(part, true); // <-- Here
  toPersist.add(mpart);
  ...

Issue Links

• is related to: HIVE-19715 Consolidated and flexible API for fetching partition metadata from HMS
• links to: Review board link