[HIVE-18525] Add explain plan to Hive on Spark Web UI - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 4.0.0-alpha-1
Component/s: Spark
Labels:
None

Target Version/s:

3.0.0

Description

More of an investigation JIRA. The Spark UI has a "long description" of each stage in the Spark DAG. Typically one stage in the Spark DAG corresponds to either a MapWork or ReduceWork object. It would be useful if the long description contained the explain plan of the corresponding work object.

I'm not sure how much additional overhead this would introduce. If not the full explain plan, then maybe a modified one that just lists out all the operator tree along with each operator name.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-18525.1.patch
22/Feb/18 00:42
16 kB
Sahil Takiar
HIVE-18525.2.patch
22/Feb/18 02:35
16 kB
Sahil Takiar
HIVE-18525.3.patch
23/Mar/18 19:53
24 kB
Sahil Takiar
HIVE-18525.4.patch
02/Apr/18 22:43
26 kB
Sahil Takiar
Job-Page-Collapsed.png
21/Mar/18 23:52
258 kB
Sahil Takiar
Job-Page-Expanded.png
21/Mar/18 23:52
384 kB
Sahil Takiar
Map-Explain-Plan.png
22/Feb/18 00:44
169 kB
Sahil Takiar
Reduce-Explain-Plan.png
22/Feb/18 00:44
116 kB
Sahil Takiar

Issue Links

links to

Activity

People

Assignee:: Sahil Takiar

Reporter:: Sahil Takiar

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 24/Jan/18 18:38

Updated:: 17/Nov/22 08:54

Resolved:: 13/Apr/18 20:51