[HIVE-11082] Support multi edge between nodes in SparkPlan[Spark Branch]

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: spark-branch, 1.3.0, 2.0.0
• Component/s: Spark
• Assignee: Chengxiang Li
• Reporter: Chengxiang Li
• Created: 23/Jun/15 06:07
• Updated: 16/Feb/16 23:53
• Resolved: 16/Jul/15 05:24

Description

For Dynamic RDD caching optimization, we found SparkPlan::connect throw exception while we try to combine 2 works with same child, support multi edge between nodes in SparkPlan would help to enable dynamic RDD caching in more use cases, like self join and self union.

Issue Links

• is related to: HIVE-10844 Combine equivalent Works for HoS[Spark Branch]
• relates to: HIVE-11267 Combine equavilent leaf works in SparkWork[Spark Branch]
• links to: https://reviews.apache.org/r/36475/