[HIVE-7961] metastore schema improvement for adding partition to Hive table

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Metastore
• Assignee: Unassigned
• Reporter: Chu Tong
• Created: 03/Sep/14 17:31
• Updated: 03/Sep/14 17:31

Description

One of the performance bottlenecks for adding a partition in Hive table and the query takes most of the time in this process is:
SELECT A0.PART_NAME FROM PARTITIONS A0 LEFT OUTER JOIN TBLS B0 ON A0.TBL_ID = B0.TBL_ID LEFT OUTER JOIN DBS C0 ON B0.DB_ID = C0.DB_ID WHERE B0.TBL_NAME = @P0 AND C0."NAME" = @P1 AND A0.PART_NAME = @P2
This query joins partition table with table table and database table in Hive metastore and it becomes slow when these tables are big.
A viable way to optimize this is the de-normalize the partition table.