[SPARK-38179] Improve WritableColumnVector to better support null struct

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 3.3.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Chao Sun
• Created: 10/Feb/22 18:53
• Updated: 03/Mar/22 19:17
• Resolved: 03/Mar/22 19:17

Description

Currently WritableColumnVector of struct type requires to allocate space in all child vectors for null elements. This is not very space efficient. In addition, this model doesn't work well with Parquet vectorized scan for struct (in SPARK-34863).

Issue Links

• links to: [Github] Pull Request #35483 (sunchao)