[SPARK-34026] DataSource V2: Inject repartition and sort nodes to satisfy required distribution and ordering

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: SQL
• Assignee: Anton Okolnychyi
• Reporter: Anton Okolnychyi
• Created: 06/Jan/21 10:42
• Updated: 25/Jun/22 19:09
• Resolved: 26/Jan/21 15:10

Description

As the next step towards requesting distribution and ordering on write, we should inject appropriate repartition and sort nodes.

Issue Links

• is related to: SPARK-23889 DataSourceV2: Add interfaces to pass required sorting and clustering for writes
• links to: [Github] Pull Request #31083 (aokolnychyi)
• links to: [Github] Pull Request #31083 (aokolnychyi)
• links to: [Github] Pull Request #36992 (pan3793)
• links to: [Github] Pull Request #36992 (pan3793)