[SPARK-29014] DataSourceV2: Clean up current, default, and session catalog uses

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Target Version/s: 3.0.0
• Assignee: Terry Kim
• Reporter: Ryan Blue
• Created: 06/Sep/19 21:46
• Updated: 18/Oct/19 14:48
• Resolved: 18/Oct/19 14:48

Description

Catalog tracking in DSv2 has evolved since the initial changes went in. We need to make sure that handling is consistent across plans using the latest rules:

• The current catalog should be used when no catalog is specified
• The default catalog is the catalog current is initialized to
• If the default catalog is not set, then it is the built-in Spark session catalog, which will be called `spark_catalog` (This is the v2 session catalog)

Issue Links

• links to: GitHub Pull Request #26120