[SPARK-16848] Check schema validation for user-specified schema in jdbc and table APIs

• Type: Improvement
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.2.0
• Component/s: SQL
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 02/Aug/16 04:57
• Updated: 12/Dec/22 17:51
• Resolved: 12/Jan/17 05:05

Description

Currently,

Both APIs below:

spark.read.schema(StructType(Nil)).jdbc(...)

and

spark.read.schema(StructType(Nil)).table("usrdb.test")

ignore schemas.

It'd make sense to throw an exception rather than causing confusion to users.

Issue Links

• relates to: SPARK-16054 Verification of DataFrameReader API Usage
• links to: [Github] Pull Request #14451 (HyukjinKwon)