Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: nodemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Adding support for using the 'tc' tool in batch mode via container-executor. This is a prerequisite for traffic-shaping functionality that is necessary to support outbound bandwidth as a resource in YARN.

      Description

      We need the following functionality :

      1) modify network interface traffic shaping rules - to be able to attach a qdisc, create child classes etc
      2) read existing rules in place
      3) read stats for the various classes

      Using tc requires elevated privileges - hence this functionality is to be made available via container-executor.

      1. YARN-3365.001.patch
        52 kB
        Sidharta Seethana
      2. YARN-3365.002.patch
        52 kB
        Sidharta Seethana
      3. YARN-3365.003.patch
        53 kB
        Sidharta Seethana

        Issue Links

          Activity

          Hide
          sidharta-s Sidharta Seethana added a comment -

          Patch for : adding support for using 'tc' tool via container-executor. Additional tests added to TestLinuxContainerExecutor by Varun Vasudev

          Show
          sidharta-s Sidharta Seethana added a comment - Patch for : adding support for using 'tc' tool via container-executor. Additional tests added to TestLinuxContainerExecutor by Varun Vasudev
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12707006/YARN-3365.001.patch
          against trunk revision a16bfff.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7095//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707006/YARN-3365.001.patch against trunk revision a16bfff. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7095//console This message is automatically generated.
          Hide
          sidharta-s Sidharta Seethana added a comment -

          I'll take a look at the patch failure and re-submit.

          Show
          sidharta-s Sidharta Seethana added a comment - I'll take a look at the patch failure and re-submit.
          Hide
          sidharta-s Sidharta Seethana added a comment -

          Re-created the patch against trunk - ensuring a change that is only in trunk isn't undone.

          Show
          sidharta-s Sidharta Seethana added a comment - Re-created the patch against trunk - ensuring a change that is only in trunk isn't undone.
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12707106/YARN-3365.002.patch
          against trunk revision 53a28af.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.

          Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7097//testReport/
          Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7097//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707106/YARN-3365.002.patch against trunk revision 53a28af. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7097//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7097//console This message is automatically generated.
          Hide
          sidharta-s Sidharta Seethana added a comment -

          Summary of changes included in patch :

          Additional tests, fixes, cleanup of TestLinuxContainerExecutor ( by Varun Vasudev )
          container-executor - changes to support superuser execution of ‘tc’ in batch mode ( by Sidharta Seethana )
          container-executor - refactored main.c to make it easier to read/maintain ( by Sidharta Seethana )

          Show
          sidharta-s Sidharta Seethana added a comment - Summary of changes included in patch : Additional tests, fixes, cleanup of TestLinuxContainerExecutor ( by Varun Vasudev ) container-executor - changes to support superuser execution of ‘tc’ in batch mode ( by Sidharta Seethana ) container-executor - refactored main.c to make it easier to read/maintain ( by Sidharta Seethana )
          Hide
          vvasudev Varun Vasudev added a comment -

          container-executor changes look good to me.

          Show
          vvasudev Varun Vasudev added a comment - container-executor changes look good to me.
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          Quick comments on the patch

          • operations.RUN_AS_USER_INITIALIZE_CONTAINER -> INITIALIZE_CONTAINER_AS_USER? Similarly other operations?
          • Looked in isolation, TC seems like an inside abbreviation. Let's be verbose in code and say traffic-control everywhere?
          • Move all tc related code to new files (seeing as we are going to keep adding more resources in the near future)?
          • cmd_input.hierarchy -> cgroups_hierarchy. cmd_input.command_file -> tc_command_file.
          • Test case: Use application.submitter instead of user.name for the non-secure local-user?
          • //kill me now.
            Sure, but later

          Explain a little on what the command-file contains? May be an example here on JIRA as to how NodeManager will use the tc command will help.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - Quick comments on the patch operations.RUN_AS_USER_INITIALIZE_CONTAINER -> INITIALIZE_CONTAINER_AS_USER? Similarly other operations? Looked in isolation, TC seems like an inside abbreviation. Let's be verbose in code and say traffic-control everywhere? Move all tc related code to new files (seeing as we are going to keep adding more resources in the near future)? cmd_input.hierarchy -> cgroups_hierarchy. cmd_input.command_file -> tc_command_file. Test case: Use application.submitter instead of user.name for the non-secure local-user? //kill me now. Sure, but later Explain a little on what the command-file contains? May be an example here on JIRA as to how NodeManager will use the tc command will help.
          Hide
          sidharta-s Sidharta Seethana added a comment -

          Vinod Kumar Vavilapalli Thanks for your comments. Responses below :

          • Comments w.r.t renaming : I'll make the suggested changes.
          • Test case : I'll switch to using the app submitter instead of local user.name
          • Moving tc functionality to another file - this functionality depends on local static functions which would have to be exposed/made available in the new file, if we were to move tc functionality. I would prefer to keep it in the same file.
          • tc example coming up in a follow-up comment.
          Show
          sidharta-s Sidharta Seethana added a comment - Vinod Kumar Vavilapalli Thanks for your comments. Responses below : Comments w.r.t renaming : I'll make the suggested changes. Test case : I'll switch to using the app submitter instead of local user.name Moving tc functionality to another file - this functionality depends on local static functions which would have to be exposed/made available in the new file, if we were to move tc functionality. I would prefer to keep it in the same file. tc example coming up in a follow-up comment.
          Hide
          sidharta-s Sidharta Seethana added a comment -

          Example tc usage :

          Lets say that we need to read the 'state' of the network interface w.r.t the traffic shaping rules and classes in place. We'll invoke {[container-executor}} in the following manner container-executor --read-state tmp-file-with-tc-commands.txt . container-executor in turn invokes /sbin/tc -b tmp-file-with-tc-commands.txt . The contents of the temporary file contain "show" instructions like these

          qdisc show dev eth0
          filter show dev eth0
          class show dev eth0

          The output from tc for such a batch of commands would look like this :

          qdisc htb 42: root refcnt 2 r2q 10 default 0 direct_packets_stat 27
          filter parent 42: protocol ip pref 10 cgroup handle 0x1

          filter parent 42: protocol ip pref 10 cgroup handle 0x1

          class htb 42:1 root rate 100000Kbit ceil 100000Kbit burst 1600b cburst 1600b
          class htb 42:2 parent 42:1 prio 0 rate 2000Kbit ceil 100000Kbit burst 1600b cburst 1600b
          class htb 42:3 parent 42:1 prio 0 rate 2000Kbit ceil 100000Kbit burst 1600b cburst 1600b

          Show
          sidharta-s Sidharta Seethana added a comment - Example tc usage : Lets say that we need to read the 'state' of the network interface w.r.t the traffic shaping rules and classes in place. We'll invoke {[container-executor}} in the following manner container-executor --read-state tmp-file-with-tc-commands.txt . container-executor in turn invokes /sbin/tc -b tmp-file-with-tc-commands.txt . The contents of the temporary file contain "show" instructions like these qdisc show dev eth0 filter show dev eth0 class show dev eth0 The output from tc for such a batch of commands would look like this : qdisc htb 42: root refcnt 2 r2q 10 default 0 direct_packets_stat 27 filter parent 42: protocol ip pref 10 cgroup handle 0x1 filter parent 42: protocol ip pref 10 cgroup handle 0x1 class htb 42:1 root rate 100000Kbit ceil 100000Kbit burst 1600b cburst 1600b class htb 42:2 parent 42:1 prio 0 rate 2000Kbit ceil 100000Kbit burst 1600b cburst 1600b class htb 42:3 parent 42:1 prio 0 rate 2000Kbit ceil 100000Kbit burst 1600b cburst 1600b
          Hide
          sidharta-s Sidharta Seethana added a comment -

          New patch coming up that includes code review feedback.

          Show
          sidharta-s Sidharta Seethana added a comment - New patch coming up that includes code review feedback.
          Hide
          sidharta-s Sidharta Seethana added a comment -

          Updated patch incorporating code review comments

          Show
          sidharta-s Sidharta Seethana added a comment - Updated patch incorporating code review comments
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12707355/YARN-3365.003.patch
          against trunk revision 44809b8.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          -1 eclipse:eclipse. The patch failed to build with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7110//testReport/
          Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7110//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707355/YARN-3365.003.patch against trunk revision 44809b8. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. -1 eclipse:eclipse . The patch failed to build with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7110//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7110//console This message is automatically generated.
          Hide
          sidharta-s Sidharta Seethana added a comment -

          This target passes on my machine. From the jenkins console output, it seems like a build issue

          ======================================================================
          ======================================================================
          Running mvn eclipse:eclipse.
          ======================================================================
          ======================================================================

          /home/jenkins/tools/maven/latest/bin/mvn eclipse:eclipse -DHadoopPatchProcess > /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/../patchprocess/patchEclipseOutput.txt 2>&1
          /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/dev-support/test-patch.sh: line 696: /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/../patchprocess/patchEclipseOutput.txt: No such file or directory

          Show
          sidharta-s Sidharta Seethana added a comment - This target passes on my machine. From the jenkins console output, it seems like a build issue ====================================================================== ====================================================================== Running mvn eclipse:eclipse. ====================================================================== ====================================================================== /home/jenkins/tools/maven/latest/bin/mvn eclipse:eclipse -DHadoopPatchProcess > /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/../patchprocess/patchEclipseOutput.txt 2>&1 /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/dev-support/test-patch.sh: line 696: /home/jenkins/jenkins-slave/workspace/PreCommit-YARN-Build/../patchprocess/patchEclipseOutput.txt: No such file or directory
          Hide
          sidharta-s Sidharta Seethana added a comment -

          That should read : container-executor --tc-read-state tmp-file-with-tc-commands.txt

          Show
          sidharta-s Sidharta Seethana added a comment - That should read : container-executor --tc-read-state tmp-file-with-tc-commands.txt
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          Patch looks good.

          Resubmitting to Jenkins again for blessings.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - Patch looks good. Resubmitting to Jenkins again for blessings.
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12707355/YARN-3365.003.patch
          against trunk revision 6a6a59d.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.

          Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7203//testReport/
          Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7203//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707355/YARN-3365.003.patch against trunk revision 6a6a59d. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7203//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7203//console This message is automatically generated.
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          Committed this to trunk and branch-2. Thanks Sidharta! And congratulations on your first patch to Hadoop!

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - Committed this to trunk and branch-2. Thanks Sidharta! And congratulations on your first patch to Hadoop!
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #7500 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7500/)
          YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7500 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7500/ ) YARN-3365 . Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java
          Hide
          sidharta-s Sidharta Seethana added a comment -

          Thanks, Vinod! we'll need a small patch to undo the banned users change in branch-2.

          Show
          sidharta-s Sidharta Seethana added a comment - Thanks, Vinod! we'll need a small patch to undo the banned users change in branch-2.
          Hide
          sidharta-s Sidharta Seethana added a comment -

          Actually, never mind - it seems like the banned user list wasn't affected.

          -Sid

          Show
          sidharta-s Sidharta Seethana added a comment - Actually, never mind - it seems like the banned user list wasn't affected. -Sid
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/152/)
          YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #152 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/152/ ) YARN-3365 . Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/886/)
          YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #886 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/886/ ) YARN-3365 . Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/143/)
          YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #143 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/143/ ) YARN-3365 . Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2084/)
          YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2084 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2084/ ) YARN-3365 . Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/153/)
          YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #153 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/153/ ) YARN-3365 . Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2102/)
          YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c
          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2102 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2102/ ) YARN-3365 . Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. (vinodkv: rev b21c72777ae664b08fd1a93b4f88fa43f2478d94) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestLinuxContainerExecutor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/main.c hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.h

            People

            • Assignee:
              sidharta-s Sidharta Seethana
              Reporter:
              sidharta-s Sidharta Seethana
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development