Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-543

[Umbrella] NodeManager localization related issues

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: nodemanager
    • Labels:
      None

      Description

      Seeing a bunch of localization related issues being worked on, this is the tracking ticket.

        Attachments

        1.
        Jobs fail during resource localization when public distributed-cache hits unix directory limits Sub-task Closed Omkar Vinit Joshi
        2.
        Jobs fail during resource localization when private distributed-cache hits unix directory limits Sub-task Closed Omkar Vinit Joshi
        3.
        Waiting containers are not informed if private localization for a resource fails. Sub-task Resolved Omkar Vinit Joshi
        4.
        Race in localization can cause containers to fail Sub-task Closed Omkar Vinit Joshi
        5.
        LocalizedResources are leaked in memory in case resource localization fails Sub-task Closed Omkar Vinit Joshi
        6.
        Failed resource localization might introduce a race condition. Sub-task Resolved Omkar Vinit Joshi
        7.
        Race condition in Public / Private Localizer may result into resource getting downloaded again Sub-task Closed Omkar Vinit Joshi
        8.
        Shared data structures in Public Localizer and Private Localizer are not Thread safe. Sub-task Closed Omkar Vinit Joshi
        9.
        PrivateLocalizer does not support parallel resource download via ContainerLocalizer Sub-task Patch Available Ajith S
        10.
        Application cache files should be localized under local-dir/usercache/userid/appcache/appid/filecache Sub-task Closed Omkar Vinit Joshi
        11.
        Consider Localizing Resources within the NM process itself in non-secure deployments Sub-task Resolved Karthik Kambatla
        12.
        Public localizer crashes with "Localized unkown resource" Sub-task Closed Jason Darrell Lowe
        13.
        YARN NodeManager with java.util.concurrent.RejectedExecutionException Sub-task Closed Varun Vasudev
        14.
        NPE in public localizer Sub-task Resolved Hong Zhiguo
        15.
        Killing a container that is localizing can orphan resources in the DOWNLOADING state Sub-task Closed Varun Saxena

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              vinodkv Vinod Kumar Vavilapalli
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: