[SPARK-38198] Fix `QueryExecution.debug#toFile` use the passed in `maxFields` when `explainMode` is `CodegenMode`

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0, 3.2.2
• Component/s: SQL
• Assignee: Yang Jie
• Reporter: Yang Jie
• Created: 14/Feb/22 07:24
• Updated: 14/Feb/22 16:47
• Resolved: 14/Feb/22 10:28

Description

`QueryExecution.debug#toFile` method supports passing in `maxFields` and this parameter will be passed down when `explainMode` is SimpleMode, ExtendedMode, or CostMode, but the passed down `maxFields` was ignored because `QueryExecution#stringWithStats` overrides it with `SQLConf.get.maxToStringFields` at present

 

Issue Links

• links to: [Github] Pull Request #35506 (LuciferYang)
• links to: [Github] Pull Request #35515 (LuciferYang)
• links to: [Github] Pull Request #35515 (LuciferYang)