[SPARK-30323] Support filters pushdown in CSV datasource

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 20/Dec/19 18:55
• Updated: 12/Dec/22 18:10
• Resolved: 16/Jan/20 04:10

Description

• Implement the `SupportsPushDownFilters` interface in `CSVScanBuilder`
• Apply filters in UnivocityParser
• Change API UnivocityParser - return Seq[InternalRow] from `convert()`
• Update CSVBenchmark

Issue Links

• causes: SPARK-30530 CSV load followed by "is null" filter produces incorrect results
• links to: GitHub Pull Request #26973