[SPARK-37221] The collect-like API in SparkPlan should support columnar output

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: SQL
• Assignee: L. C. Hsieh
• Reporter: L. C. Hsieh
• Created: 06/Nov/21 01:45
• Updated: 09/Nov/21 19:51
• Resolved: 08/Nov/21 01:20

Description

Currently, the collect-like APIs in SparkPlan, e.g. executeCollect, do not work if the plan is columnar execution.

We should extend the API coverage to all execution modes.

Issue Links

• links to: [Github] Pull Request #34499 (viirya)
• links to: [Github] Pull Request #34538 (viirya)