Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Won't Fix
-
3.1.0
-
None
-
None
Description
DataFrameWriterV2 doesn't handle fail-back if catalog.loadTable doesn't provide any Table instance. This ends up leading temp view to NoSuchTableException.
It's OK to fail for such case unless we want to resolve it later like DataFrameWriter.insertInto, but throwing NoSuchTableException is probably confusing, as view is loaded via catalog.loadTable and fails with capability check, not NoSuchTableException.
We could check in prior whether the table identifier refers temp view, and provide better exception.
Attachments
Issue Links
- is superceded by
-
SPARK-33087 DataFrameWriterV2 should delegate table resolution to the analyzer
- Resolved
- links to