[TEZ-3363] Delete intermediate data at the vertex level for Shuffle Handler

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.2
• Assignee: Syed Shameerur Rahman
• Reporter: Jonathan Turner Eagles
• Created: 19/Jul/16 15:07
• Updated: 16/Mar/22 18:47
• Resolved: 16/Mar/22 18:22

Description

For applications like pig where processing times can be very long, applications may choose to delete intermediate data for a sub dag. For example if a DAG has synced data to HDFS, all upstream intermediate data can be safely deleted.

Issue Links

• links to: GitHub Pull Request #60