[SPARK-45925] SubqueryBroadcastExec is not equivalent with SubqueryAdaptiveBroadcastExec causing re-use of exchange not happening in AQE

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 3.5.1
• Component/s: SQL
• Labels: pull-request-available
• Target Version/s: 3.5.1
• Assignee: Unassigned
• Reporter: Asif
• Created: 14/Nov/23 18:49
• Updated: 15/Nov/23 21:32
• Resolved: 15/Nov/23 21:31

Description

A created stage may contain SubqueryAdaptiveBroadcastExec while incominng exchange may contain SubqueryBroadcastExec and though they are equivalent , the match does not happen because equals/hashCode do not match , resulting in non re-use of exchange.

Issue Links

• is required by: SPARK-45866 Reuse of exchange in AQE does not happen when run time filters are pushed down to the underlying Scan ( like iceberg )
• links to: GitHub Pull Request #43807
• links to: GitHub Pull Request #43807