[SPARK-37063] SQL Adaptive Query Execution QA: Phase 2

• Type: Umbrella
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.3.0
• Component/s: SQL
• Target Version/s: 3.3.0
• Assignee: Unassigned
• Reporter: Dongjoon Hyun
• Created: 19/Oct/21 21:58
• Updated: 27/Jan/22 20:01

Issue Links

• relates to: SPARK-33828 SQL Adaptive Query Execution QA

Sub-Tasks

• Support fetching shuffle blocks in batch with i/o encryption: Reopened
• Make config maxShuffledHashJoinLocalMapThreshold fallback to advisoryPartitionSizeInBytes: In Progress
• Demote BroadcastJoin causes performance regression and increases OOM risks: Open
• Cancel all running job after AQE plan finished: In Progress
• Unify get preferred locations for shuffle in AQE: In Progress
• Avoid unnecessary sort in FileFormatWriter if user has specified sort in AQE: In Progress