[SPARK-35791] Release on-going map properly for NULL-aware ANTI join

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0, 3.1.3
• Component/s: SQL
• Assignee: Cheng Su
• Reporter: Cheng Su
• Created: 16/Jun/21 23:58
• Updated: 17/Jun/21 05:58
• Resolved: 17/Jun/21 05:58

Description

NULL-aware ANTI join (https://issues.apache.org/jira/browse/SPARK-32290) detects NULL join keys during building the map for `HashedRelation`, and will immediately return `HashedRelationWithAllNullKeys` without taking care of the map built already. Before returning `HashedRelationWithAllNullKeys`, the map needs to be freed properly to save memory and keep memory accounting correctly.

 

Issue Links

• links to: [Github] Pull Request #32939 (c21)
• links to: [Github] Pull Request #32939 (c21)