[SPARK-33038] AQE plan string should only display one plan when the initial and the current plan are the same

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: SQL
• Assignee: Allison Wang
• Reporter: Allison Wang
• Created: 30/Sep/20 18:28
• Updated: 05/Oct/20 16:31
• Resolved: 05/Oct/20 16:31

Description

Currently, the AQE plan string displays both the initial plan and the current or the final plan. This can be redundant when the initial plan and the current physical plan are exactly the same. For instance, the `EXPLAIN` command will not actually execute the query, and thus the plan string will never change, but currently, the plan string still shows both the current and the initial plan:

 

AdaptiveSparkPlan (8)
+- == Current Plan ==
   Sort (7)
   +- Exchange (6)
      +- HashAggregate (5)
         +- Exchange (4)
            +- HashAggregate (3)
               +- Filter (2)
                  +- Scan parquet default.explain_temp1 (1)
+- == Initial Plan ==
   Sort (7)
   +- Exchange (6)
      +- HashAggregate (5)
         +- Exchange (4)
            +- HashAggregate (3)
               +- Filter (2)
                  +- Scan parquet default.explain_temp1 (1)

When the initial and the current plan are the same, there should be only one plan string displayed. For example

AdaptiveSparkPlan (8)
+- Sort (7)
   +- Exchange (6)
      +- HashAggregate (5)
         +- Exchange (4)
            +- HashAggregate (3)
               +- Filter (2)
                  +- Scan parquet default.explain_temp1 (1)

 

Issue Links

• links to: [Github] Pull Request #29915 (allisonwang-db)
• links to: [Github] Pull Request #29915 (allisonwang-db)