[HIVE-25947] Compactor job queue cannot be set per table via compactor.mapred.job.queue.name

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: HiveServer2
• Labels: pull-request-available
• Target Version/s: 4.0.0
• Assignee: Stamatis Zampetakis
• Reporter: Stamatis Zampetakis
• Created: 10/Feb/22 10:10
• Updated: 17/Nov/22 08:48
• Resolved: 18/Feb/22 10:42

Description

Before HIVE-20723 it was possible to schedule the compaction for each table on specific job queues by putting compactor.mapred.job.queue.name in the table properties.

CREATE TABLE person (name STRING, age INT) STORED AS ORC TBLPROPERTIES(
'transactional'='true',
'compactor.mapred.job.queue.name'='root.user2);

ALTER TABLE person COMPACT 'major' WITH OVERWRITE TBLPROPERTIES('compactor.mapred.job.queue.name'='root.user2')

This is no longer possible (after HIVE-20723) and in order to achieve the same effect someone needs to use the compactor.hive.compactor.job.queue.

CREATE TABLE person (name STRING, age INT) STORED AS ORC TBLPROPERTIES(
'transactional'='true',
'compactor.hive.compactor.job.queue'='root.user2);

ALTER TABLE person COMPACT 'major' WITH OVERWRITE TBLPROPERTIES('compactor.hive.compactor.job.queue'='root.user2')

Issue Links

• is caused by: HIVE-20723 Allow per table specification of compaction yarn queue
• links to: GitHub Pull Request #3027