[TEZ-3363] Delete intermediate data at the vertex level for Shuffle Handler - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.10.2
Component/s: None
Labels:
None

Description

For applications like pig where processing times can be very long, applications may choose to delete intermediate data for a sub dag. For example if a DAG has synced data to HDFS, all upstream intermediate data can be safely deleted.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

TEZ-3363.001.patch
13/Sep/17 13:54
78 kB
Kuhu Shukla
TEZ-3363.002.patch
13/Sep/17 15:32
78 kB
Kuhu Shukla
TEZ-3363.03.patch
20/Feb/20 11:00
82 kB
Syed Shameerur Rahman

Issue Links

links to

GitHub Pull Request #60

Activity

People

Assignee:: Syed Shameerur Rahman

Reporter:: Jonathan Turner Eagles

Votes:: 0 Vote for this issue

Watchers:: 10 Start watching this issue

Dates

Created:: 19/Jul/16 15:07

Updated:: 16/Mar/22 18:47

Resolved:: 16/Mar/22 18:22

Time Tracking

Estimated:

Not Specified

Remaining:

Logged:

11.5h