[SPARK-36511] Remove ColumnIO once PARQUET-2050 is released in Parquet 1.13

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.4.0
• Component/s: SQL
• Assignee: BingKun Pan
• Reporter: Chao Sun
• Created: 14/Aug/21 00:41
• Updated: 16/Aug/22 20:10
• Resolved: 16/Aug/22 20:09

Description

ColumnIO doesn't expose methods to get repetition and definition level so Spark has to use a hack. This should be removed once PARQUET-2050 is released.

Issue Links

• links to: [Github] Pull Request #37529 (panbingkun)