[SPARK-23574] SinglePartition in data source V2 scan

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.4.0
• Component/s: Spark Core
• Assignee: Jose Torres
• Reporter: Jose Torres
• Created: 03/Mar/18 03:39
• Updated: 20/Mar/18 18:53
• Resolved: 20/Mar/18 18:53

Description

DataSourceV2ScanExec currently reports UnknownPartitioning whenever the reader doesn't mix in SupportsReportPartitioning. It can also report SinglePartition in the case where there's a single reader factory.

Issue Links

• links to: [Github] Pull Request #20726 (jose-torres)