Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5764

NUMA awareness support for launching containers

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0, 3.2.0
    • nodemanager, yarn
    • None
    • Reviewed

    Description

      The purpose of this feature is to improve Hadoop performance by minimizing costly remote memory accesses on non SMP systems. Yarn containers, on launch, will be pinned to a specific NUMA node and all subsequent memory allocations will be served by the same node, reducing remote memory accesses. The current default behavior is to spread memory across all NUMA nodes.

      Attachments

        1. NUMA Awareness for YARN Containers.pdf
          288 kB
          Devaraj Kavali
        2. NUMA Performance Results.pdf
          594 kB
          Devaraj Kavali
        3. YARN-5764-v0.patch
          45 kB
          Devaraj Kavali
        4. YARN-5764-v1.patch
          45 kB
          Devaraj Kavali
        5. YARN-5764-v10.patch
          65 kB
          Devaraj Kavali
        6. YARN-5764-v11.patch
          64 kB
          Devaraj Kavali
        7. YARN-5764-v2.patch
          45 kB
          Devaraj Kavali
        8. YARN-5764-v3.patch
          47 kB
          Devaraj Kavali
        9. YARN-5764-v4.patch
          63 kB
          Devaraj Kavali
        10. YARN-5764-v5.patch
          63 kB
          Devaraj Kavali
        11. YARN-5764-v6.patch
          62 kB
          Devaraj Kavali
        12. YARN-5764-v7.patch
          62 kB
          Devaraj Kavali
        13. YARN-5764-v8.patch
          62 kB
          Devaraj Kavali
        14. YARN-5764-v9.patch
          62 kB
          Devaraj Kavali

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            devaraj Devaraj Kavali
            olasoji Olasoji
            Votes:
            0 Vote for this issue
            Watchers:
            32 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment