Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2190

Add CPU and memory limit options to the default container executor for Windows containers

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.7.0
    • nodemanager
    • None
    • Reviewed

    Description

      Yarn default container executor on Windows does not set the resource limit on the containers currently. The memory limit is enforced by a separate monitoring thread. The container implementation on Windows uses Job Object right now. The latest Windows (8 or later) API allows CPU and memory limits on the job objects. We want to add the new options to the executor that can set the limits on job objects thus provides resource enforcement at OS level.

      http://msdn.microsoft.com/en-us/library/windows/desktop/ms686216(v=vs.85).aspx

      Attachments

        1. YARN-2190.1.patch
          23 kB
          Chuan Liu
        2. YARN-2190.10.patch
          25 kB
          Chuan Liu
        3. YARN-2190.11.patch
          27 kB
          Chuan Liu
        4. YARN-2190.12.patch
          29 kB
          Chuan Liu
        5. YARN-2190.13.patch
          30 kB
          Chuan Liu
        6. YARN-2190.2.patch
          23 kB
          Chuan Liu
        7. YARN-2190.3.patch
          25 kB
          Chuan Liu
        8. YARN-2190.4.patch
          26 kB
          Chuan Liu
        9. YARN-2190.5.patch
          26 kB
          Chuan Liu
        10. YARN-2190.6.patch
          28 kB
          Chuan Liu
        11. YARN-2190.7.patch
          31 kB
          Chuan Liu
        12. YARN-2190.8.patch
          19 kB
          Chuan Liu
        13. YARN-2190.9.patch
          25 kB
          Chuan Liu
        14. YARN-2190-prototype.patch
          19 kB
          Chuan Liu

        Issue Links

        breaks

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-17931 Fix typos in usage message in winutils.exe

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-11691 X86 build of libwinutils is broken

        • Critical - Crashes, loss of data, severe memory leak.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            chuanliu Chuan Liu
            chuanliu Chuan Liu
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment