[YARN-3773] hadoop-yarn-server-nodemanager needs cross-platform equivalents of Linux /sbin/tc

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: nodemanager

Environment

BSD OSX Solaris Windows Linux

• Assignee: Alan Burlison
• Reporter: Alan Burlison
• Created: 05/Jun/15 15:02
• Updated: 01/Apr/16 17:48

Description

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c makes use of the Linux-only executable /sbin/tc (http://lartc.org/manpages/tc.txt) but there is no corresponding functionality for non-Linux platforms. The code in question also seems to try to execute tc even on platforms where it will never exist.

Other platforms provide similar functionality, e.g. Solaris has an extensive range of network management features (http://www.oracle.com/technetwork/articles/servers-storage-admin/o11-095-s11-app-traffic-525038.html). Work is needed to abstract the network management features of Yarn so that the same facilities for network management can be provided on all platforms that provide the requisite functionality,