[SPARK-37726] Add spill size metrics for sort merge join

• Type: Improvement
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: SQL
• Assignee: Cheng Su
• Reporter: Cheng Su
• Created: 23/Dec/21 09:57
• Updated: 30/Dec/21 04:12
• Resolved: 30/Dec/21 04:12

Description

Sort merge join allows buffered side to spill if the size is too large to hold in memory. It would be good to add a "spill size" SQL metrics in sort merge join, to track how often the spill happens, and how much of spill size would be in case when it spills.

Issue Links

• links to: [Github] Pull Request #34999 (c21)