Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3542

Re-factor support for CPU as a resource using the new ResourceHandler mechanism

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha1
    • nodemanager
    • None
    • Reviewed

    Description

      In YARN-3443 , a new ResourceHandler mechanism was added which enabled easier addition of new resource types in the nodemanager (this was used for network as a resource - See YARN-2140 ). We should refactor the existing CPU implementation ( LinuxContainerExecutor/CgroupsLCEResourcesHandler ) using the new ResourceHandler mechanism.

      Attachments

        1. YARN-3542.001.patch
          28 kB
          Varun Vasudev
        2. YARN-3542.002.patch
          29 kB
          Varun Vasudev
        3. YARN-3542.003.patch
          32 kB
          Varun Vasudev
        4. YARN-3542.004.patch
          41 kB
          Varun Vasudev
        5. YARN-3542.005.patch
          41 kB
          Varun Vasudev
        6. YARN-3542.006.patch
          42 kB
          Varun Vasudev
        7. YARN-3542.007.patch
          42 kB
          Varun Vasudev
        8. YARN-3542.008.patch
          44 kB
          Varun Vasudev

        Issue Links

          causes

          Test - A new unit, integration or system test. YARN-10520 Deprecated the residual nested class for the LCEResourceHandler

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. YARN-6951 Fix debug log when Resource Handler chain is enabled

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-3443 Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              vvasudev Varun Vasudev
              sidharta-s Sidharta Seethana
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: