[SPARK-42040] SPJ: Introduce a new API for V2 input partition to report partition size

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.1
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Qi Zhu
• Reporter: Chao Sun
• Created: 13/Jan/23 00:25
• Updated: 27/Mar/24 04:58
• Resolved: 27/Mar/24 04:57

Description

It's useful for a InputPartition to also report its size (in bytes), so that Spark can use the info to decide whether partition grouping should be applied or not.

Issue Links

• links to: GitHub Pull Request #45314