[HIVE-7607] Spark "Explain" should give useful information on dependencies [Spark Branch]

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: spark-branch
• Component/s: Spark
• Assignee: Chao Sun
• Reporter: Chao Sun
• Created: 04/Aug/14 21:55
• Updated: 06/Sep/14 04:02
• Resolved: 13/Aug/14 02:50

Description

Currently, when using "Explain" under Spark mode, it displays dependency information like this:

 STAGE PLANS:
  Stage: Stage-1
    Spark
      Edges:
        Reducer 2 [org.apache.hadoop.hive.ql.plan.SparkWork$Dependency@29a09c49, org.apache.hadoop.hive.ql.plan.SparkWork$Dependency@6f7491f8]
      DagName: chao_20140804145151_acc57d5a-27fa-44c0-aabc-052b318ed832:2
....

I think it should be improved by giving more information on the dependencies, such as work information and edge type.

Issue Links

• is related to: HIVE-7292 Hive on Spark
• links to: Review Board Link