[HIVE-25060] Hive Compactor doesn´t launch cleaner

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Abandoned
• Affects Version/s: 3.1.1
• Component/s: Hive

Environment

Hive 3.1.0

Hadoop 3.1.1

• Assignee: Fran Gonzalez
• Reporter: Fran Gonzalez
• Created: 27/Apr/21 09:24
• Updated: 04/Nov/21 12:03
• Resolved: 04/Nov/21 12:03

Description

Hello,

there are problems with Hive Compactor. We can see in hivemetastore.log this message "Max block location exceeded for split" and it´s appearing more and more times.
After that, the "compactor.Cleaner" is not launched.

We observed that after a Hive Metastore restart, the "compactor.Cleaner" has not been launched nevermore, but logs doesn´t display any message about it.

Could be a degradation of the Hive Compactor when delta files are growing in the partitions?

Regards.