[SPARK-38129] Adaptively enable timeout for BroadcastQueryStageExec

• Type: Sub-task
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.2.0, 3.2.1
• Fix Version/s: 3.2.0, 3.2.1
• Component/s: SQL
• Assignee: Unassigned
• Reporter: weixiuli
• Created: 07/Feb/22 10:50
• Updated: 07/Feb/22 13:35

Description

We should disable timeout for BroadcastQueryStageExec when it comes from shuffle query stages which runtime statistics are usually correct in AQE, but should enable timeout for it when it comes from others which statistics may be incorrect, and keep it the same as non-AQE.

Issue Links

• links to: [Github] Pull Request #35425 (weixiuli)