[SPARK-32282] Improve EnsureRquirement.reorderJoinKeys to handle more scenarios such as PartitioningCollection

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: SQL
• Assignee: Terry Kim
• Reporter: Terry Kim
• Created: 12/Jul/20 03:01
• Updated: 09/Feb/21 01:55
• Resolved: 08/Oct/20 04:59

Description

The EnsureRquirement.reorderJoinKeys can be improved to handle the following scenarios:

1. If the keys cannot be reordered to match the left-side HashPartitioning, consider the right-side HashPartitioning.
2. Handle PartitioningCollection, which may contain HashPartitioning

Issue Links

• links to: [Github] Pull Request #29074 (imback82)
• links to: [Github] Pull Request #29074 (imback82)