Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-37567

reuse Exchange failed

Rank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      PR available:https://github.com/apache/spark/pull/34858

      use case:query2 in TPC-DS.There are three exchange subquery will scan the same table "store_sales" in logical plan,these subqueries meet exchange reuse rule.I confirm that the exchange use rule  work in physical plan.But when spark execute the physical plan,I find out 

      exchange reuse failed,reused exchange has been executed twice.

      physical plan:

       

      execution stages:

       

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            dahaishuantuoba junbiao chen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment