Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-357

TaskLocalResources should be task specific

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • None
    • None
    • None
    • None

    Description

      There's a few resource (most notably the plan) that hive will set for each vertex/task. But AFAIK Tez forces the user to avoid name conflicts on the resource names. If the app doesn't resources will be clobbered.

      This causes hive to have to write processors that first detect which stage they are and then resolve the name to something that doesn't conflict.

      I think tez should handle this. It should determine shared v specific resources (or give me an api to do so) and then handle this in task subfolders with symlinks (or similar).

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              hagleitn Gunther Hagleitner
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: