Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2140 Add support for network IO isolation/scheduling for containers
  3. YARN-3365

Add support for using the 'tc' tool via container-executor

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • nodemanager
    • None
    • Reviewed
    • Adding support for using the 'tc' tool in batch mode via container-executor. This is a prerequisite for traffic-shaping functionality that is necessary to support outbound bandwidth as a resource in YARN.

    Description

      We need the following functionality :

      1) modify network interface traffic shaping rules - to be able to attach a qdisc, create child classes etc
      2) read existing rules in place
      3) read stats for the various classes

      Using tc requires elevated privileges - hence this functionality is to be made available via container-executor.

      Attachments

        1. YARN-3365.001.patch
          52 kB
          Sidharta Seethana
        2. YARN-3365.002.patch
          52 kB
          Sidharta Seethana
        3. YARN-3365.003.patch
          53 kB
          Sidharta Seethana

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-12210 Collect network usage on the node

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              sidharta-s Sidharta Seethana
              sidharta-s Sidharta Seethana
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: