Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7282 Shared Cache Phase 2
  3. YARN-2781

support more flexible policy for uploading in shared cache

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Today all resources are always uploaded as long as the client wants to upload it. We may want to implement a feature where the shared cache manager can instruct the node managers not to upload under some circumstances.

      Some examples may be uploading a resource if it is seen more than N number of times.

      This doesn't need to be included in the first version of the shared cache.

      Attachments

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue YARN-2186 Node Manager uploader service for cache manager

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              sjlee0 Sangjin Lee
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: