[HIVE-25698] Hive column update performance too low when table partition over 700

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.1
• Component/s: Clients, Server Infrastructure

Environment

CentOS 7.8 

Hadoop 3.1.1

Impala 3.4.0

• Target Version/s: 3.1.1
• Assignee: Unassigned
• Reporter: JungHyun An
• Due: 26/Nov/21
• Created: 15/Nov/21 06:06
• Updated: 21/Oct/22 07:20

Description

Now we using hive 3.1.1

 

Currently in our hive we have tables with hundreds of partitions and hundreds of gigabytes of data.

 

When updating the column information of the corresponding table, it was confirmed that the performance was several tens of times slower than the Hive 1.1 version of the existing CDH.

 

I would like to ask if there is any architectural change that makes column updates slower than Hive 1 in Hive 3 and later versions.

 

Thank you.

Issue Links

• is duplicated by: HIVE-25730 Hive column update performance too low when table partition over 700