[SPARK-30554] Return Iterable from FailureSafeParser.rawParser

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.4.4
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 17/Jan/20 16:19
• Updated: 12/Dec/22 18:11
• Resolved: 20/Jan/20 05:00

Description

Currently, rawParser of FailureSafeParser has the signature `IN => Seq[InternalRow]` which is strict requirement for underlying rawParser. It could return Option, for example like CSV datasource. The ticket aims to refactor FailureSafeParser, and change Seq to Iterable. Also. need to modify CSV and JSON datasources where FailureSafeParser is used, basically.

Issue Links

• links to: GitHub Pull Request #27264