[SPARK-44185] Inconsistent path qualifying between catalog and data operations

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.4, 3.3.2, 3.4.1, 3.5.0
• Fix Version/s: 3.5.0
• Component/s: SQL
• Assignee: Kent Yao
• Reporter: Kent Yao
• Created: 26/Jun/23 03:49
• Updated: 03/Jul/23 09:27
• Resolved: 03/Jul/23 09:27

Description

For example

• CREATE TABLE statement with relative LOCATION will infer schema from files from the directory relative to the current working directory and store the directory relative to the warehouse path. 
• CTAS statement with relative LOCATION cannot assert empty root path as it checks the wrong path it will finally use.
• DataframeWriter does not qualify the path before checking