Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6524

Avoid storing unnecessary information in the Memory for the finished apps

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.7.3
    • Fix Version/s: None
    • Component/s: RM
    • Labels:
      None

      Description

      Avoid storing unnecessary information in the Memory for the finished apps
      In case of cluster with large number of finished apps, more memory is required to store the unused information i.e. related AM's Container launch like Localization resources, tokens etc.
      In one such scenario we had around 9k finished apps each with 257 LocalResource amounting to 108 kbytes per app and just for 9k apps it was nearly taking ~ 0.8 GB of memory. In Low end machines this would create resource crunch in RM

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                Naganarasimha Naganarasimha G R
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: