[HIVE-25730] Hive column update performance too low when table partition over 700

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 3.1.1
• Fix Version/s: 3.1.1
• Component/s: Metastore
• Target Version/s: 3.1.1
• Assignee: Unassigned
• Reporter: JungHyun An
• Due: 26/Nov/21
• Created: 22/Nov/21 05:01
• Updated: 22/Nov/21 10:11
• Resolved: 22/Nov/21 10:11

Description

Hi, we using hive 3.1.1

Currently in our hive have tables with hundreds of partitions and hundreds of gigabytes of data.

When updating the column information of the corresponding table, it was confirmed that the performance was several tens of times slower than the Hive 1.1 version of the older CDH.

I would like to ask if there is any architectural change that makes column updates slower than Hive 1 in Hive 3 and later versions.

Thank you.

Issue Links

• duplicates: HIVE-25698 Hive column update performance too low when table partition over 700