[SPARK-42454] SPJ: encapsulate all SPJ related parameters in BatchScanExec

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.1
• Fix Version/s: 3.5.0
• Component/s: SQL
• Assignee: Szehon Ho
• Reporter: Chao Sun
• Created: 15/Feb/23 20:39
• Updated: 15/Jul/23 04:49
• Resolved: 15/Jul/23 04:46

Description

The list of SPJ parameters in BatchScanExec keeps growing, which is annoying since there are many places which do pattern-matching on BatchScanExec and they have to change accordingly.

To make this less disruptive, we can introduce a struct for all the SPJ classes and use that as the parameter for BatchScanExec.

Issue Links

• links to: [Github] Pull Request #41990 (szehon-ho)