[FLINK-16413] Reduce hive source parallelism when limit push down

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.10.0
• Fix Version/s: 1.10.1, 1.11.0
• Component/s: Connectors / Hive
• Labels: pull-request-available
• Assignee: Jun Zhang
• Reporter: Jingsong Lee
• Created: 04/Mar/20 05:24
• Updated: 18/Mar/20 08:54
• Resolved: 18/Mar/20 08:54

Description

User started hive source parallelism automatic inference. For example, Set the maximum parallelism of inference to 10.

User have a similar SQL SELECT * from mytable limit 1;

There are more than 10 files in the hive table mytable. Is it a bit wasteful to start 10 parallelism.

Issue Links

• links to: GitHub Pull Request #11405
• links to: GitHub Pull Request #11429