[TEZ-1371] Avoid re-sending TaskContext more than once to the same node - ASF JIRA

Attach files

Attach Screenshot

Add vote

Voters

Watch issue

Watchers

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:
None

Description

Once a TaskContext has been sent to a machine then the other tasks with the same context can use the fetched TaskContext. The same container can re-use the TaskContext cached in memory from a previous run of the same task. A hash/checksum of the TaskContext could be used to identify identical task contexts that do not need to be fetched.