[SPARK-37605] Support the configuration of the initial number of scan partitions when executing a take on a query

• Type: Improvement
• Status: Resolved
• Priority: Trivial
• Resolution: Duplicate
• Affects Version/s: 3.2.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: dzcxzl
• Created: 10/Dec/21 04:54
• Updated: 23/May/23 07:47
• Resolved: 23/May/23 07:47

Description

Now the initial number of scanned partitions is 1 by default when executing a take on a query.
This number does not support configuration.
Sometimes the first task runs slower. If we have this configuration, we can increase the initial parallelism.

Issue Links

• is duplicated by: SPARK-40211 Allow executeTake() / collectLimit's number of starting partitions to be customized
• links to: [Github] Pull Request #34859 (cxzl25)
• links to: [Github] Pull Request #34859 (cxzl25)