[SPARK-48489] Throw an user-facing error when reading invalid schema from text DataSource

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.3
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Stefan Bukorovic
• Reporter: Stefan Bukorovic
• Created: 31/May/24 12:37
• Updated: 03/Jun/24 01:51
• Resolved: 03/Jun/24 01:51

Description

Text DataSource produces table schema with only 1 column, but it is possible to try and create a table with schema having multiple columns.

Currently, when user tries this, we have an assert in the code, which fails and throws internal spark error. We should throw a better user-facing error.

 

Issue Links

• links to: GitHub Pull Request #46823