Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-753 [Umbrella] Scalability improvements
  3. TEZ-1371

Avoid re-sending TaskContext more than once to the same node

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Once a TaskContext has been sent to a machine then the other tasks with the same context can use the fetched TaskContext. The same container can re-use the TaskContext cached in memory from a previous run of the same task. A hash/checksum of the TaskContext could be used to identify identical task contexts that do not need to be fetched.

      Attachments

        Activity

          People

            Unassigned Unassigned
            bikassaha Bikas Saha
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: