[SPARK-34924] Add nested column scan in DataSourceReadBenchmark

• Type: Sub-task
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.2.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Cheng Su
• Created: 31/Mar/21 20:33
• Updated: 31/Mar/21 20:33

Description

For the table scan benchmark `DataSourceReadBenchmark.scala`, we are only testing atomic data type but not nested column data type (array/struct/map) - https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/DataSourceReadBenchmark.scala#L544-L567 . We should add scan benchmark for nested column data type as well.