[SPARK-31357] DataSourceV2: Catalog API for view metadata

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.2.0
• Component/s: SQL
• Labels: SPIP pull-request-available
• Target Version/s: 3.3.0
• Assignee: Unassigned
• Reporter: John Zhuge
• Created: 06/Apr/20 00:11
• Updated: 13/Oct/23 04:44

Description

SPARK-24252 added a catalog plugin system and `TableCatalog` API that provided table metadata to Spark. This JIRA adds `ViewCatalog` API for view metadata.

Details in SPIP document.

Issue Links

• is related to: SPARK-27067 SPIP: Catalog API for table metadata
• is related to: SPARK-27658 Catalog API to load functions
• links to: [Github] Pull Request #35636 (jzhuge)
• links to: GitHub Pull Request #28147
• links to: GitHub Pull Request #35636
• links to: SPIP: Catalog API for view metadata

Sub-Tasks

• DataSourceV2: View catalog interface: Resolved
• DataSourceV2: View support: In Progress
• DataSourceV2: Improve ViewCatalog API: Resolved
• DataSourceV2: Restore createOrReplaceView: Resolved