[FLINK-31132] compact without setting parallelism does not follow the configured sink parallelism for HiveTableSink

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.17.0
• Fix Version/s: 1.17.0
• Component/s: Connectors / Hive, Table SQL / Planner
• Labels: pull-request-available
• Assignee: Weijie Guo
• Reporter: Shengkai Fang
• Created: 20/Feb/23 10:03
• Updated: 22/Feb/23 14:45
• Resolved: 22/Feb/23 14:45

Description

If the parallelism of compact operator was not set, it should use the sink parallelism and disable parallelism inference when using adaptive batch scheduler to avoid take much time to finish compaction.

Issue Links

• is related to: FLINK-30951 Release Testing: Verify FLINK-29635 Hive sink should support merge files in batch mode
• links to: GitHub Pull Request #21977