[SPARK-27708] Add documentation for v2 data sources

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: SQL
• Labels: documentation
• Assignee: Unassigned
• Reporter: Ryan Blue
• Created: 14/May/19 17:06
• Updated: 16/Aug/20 19:53

Description

Before the 3.0 release, the new v2 data sources should be documented. This includes:

• How to plug in catalog implementations
• Catalog plugin configuration
• Multi-part identifier behavior
• Partition transforms
• Table properties that are used to pass table info (e.g. "provider")

Issue Links

• is duplicated by: SPARK-28219 Data source v2 user guide