[SPARK-37567] reuse Exchange failed

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 3.1.1
• Component/s: SQL
• Labels: bugfix performance pull-request-available
• Assignee: Unassigned
• Reporter: junbiao chen
• Created: 07/Dec/21 09:44
• Updated: 14/Dec/21 13:31
• Resolved: 14/Dec/21 13:31

Description

PR available：https://github.com/apache/spark/pull/34858

use case：query2 in TPC-DS.There are three exchange subquery will scan the same table "store_sales" in logical plan,these subqueries meet exchange reuse rule.I confirm that the exchange use rule  work in physical plan.But when spark execute the physical plan,I find out 

exchange reuse failed,reused exchange has been executed twice.

physical plan：

 

execution stages：

 

Issue Links

• links to: [Github] Pull Request #34858 (chenjunbiao001)