[SPARK-27668] File source V2: support reporting statistics

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: Gengliang Wang
• Reporter: Gengliang Wang
• Created: 09/May/19 21:49
• Updated: 13/May/19 06:19
• Resolved: 13/May/19 06:19

Description

In File source V1, the statistics of `HadoopFsRelation` is `compressionFactor * sizeInBytesOfAllFiles`.
To follow it, we can implement the interface SupportsReportStatistics in FileScan and report the same statistics.

Issue Links

• links to: GitHub Pull Request #24571