[HIVE-8858] Visualize generated Spark plan [Spark Branch] - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.3.0, 2.0.0
Component/s: Spark
Labels:
None

Hadoop Flags:

Reviewed

Description

The spark plan generated by SparkPlanGenerator contains info which isn't available in Hive's explain plan, such as RDD caching. Also, the graph is slight different from orignal SparkWork. Thus, it would be nice to visualize the plan as is done for SparkWork.

Preferrably, the visualization can happen as part of Hive explain extended. If not feasible, we at least can log this at info level.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-8858-spark.patch
30/Mar/15 14:29
6 kB
Chinna Rao Lalam
HIVE-8858.4-spark.patch
09/Apr/15 17:43
12 kB
Chinna Rao Lalam
HIVE-8858.3-spark.patch
09/Apr/15 16:45
12 kB
Chinna Rao Lalam
HIVE-8858.2-spark.patch
09/Apr/15 12:46
12 kB
Chinna Rao Lalam
HIVE-8858.1-spark.patch
08/Apr/15 18:29
13 kB
Chinna Rao Lalam

Activity

People

Assignee:: Chinna Rao Lalam

Reporter:: Xuefu Zhang

Votes:: 0 Vote for this issue

Watchers:: 7 Start watching this issue

Dates

Created:: 13/Nov/14 15:01

Updated:: 16/Feb/16 23:50

Resolved:: 22/Apr/15 21:54