[SPARK-41763] Refactor v1 writes

• Type: Umbrella
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: SQL
• Assignee: XiDuo You
• Reporter: XiDuo You
• Created: 29/Dec/22 03:52
• Updated: 16/Jul/24 06:14
• Resolved: 16/Jul/24 06:13

Description

This umbrella is used to track all tickets about the changes of v1 writes.

Sub-Tasks

• Pull out dynamic partition and bucket sort from FileFormatWriter: Resolved
• Avoid unnecessary sort in FileFormatWriter if it's not dynamic partition: Resolved
• Pull out empty2null conversion from FileFormatWriter: Resolved
• Improve v1 write test coverage: In Progress
• Pull out v1 write to WriteFiles: Resolved
• Make CTAS hold a nested execution for data writing: Resolved
• Remove OptimizedCreateHiveTableAsSelectCommand: Resolved
• Pull v1write information to WriteFiles: Resolved
• Pull out v1 write metrics to WriteFiles: Resolved
• Improve v1 writes with empty2null: Resolved