[SPARK-45940] Add InputPartition to DataSourceReader interface

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: PySpark
• Labels: pull-request-available
• Assignee: Allison Wang
• Reporter: Allison Wang
• Created: 15/Nov/23 20:38
• Updated: 04/Dec/23 23:49
• Resolved: 30/Nov/23 23:41

Description

Add InputPartition class and make the partitions method return a list of input partitions.

Issue Links

• links to: GitHub Pull Request #44085
• links to: GitHub Pull Request #44164