[YARN-8619] Automate docker network configuration through YARN API

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Information Provided
• Component/s: yarn-native-services
• Labels: Docker
• Assignee: Unassigned
• Reporter: Eric Yang
• Created: 02/Aug/18 21:58
• Updated: 22/Jan/19 18:06
• Resolved: 22/Jan/19 18:03

Description

Docker supports bridge, host, overlay, macvlan networking. It might be useful to automate docker network setup through a set of YARN API to improve management of docker networks. Each type of network driver requires different type of parameters. For Hadoop use case, it seems more useful to focus on macvlan networking for ease of use and configuration. It would be great addition to support commands like:

yarn network create -d macvlan \
  --subnet=172.16.86.0/24 \
  --gateway=172.16.86.1 \
  -o parent=eth0 \
  my-macvlan-net

This changes docker configuration to hosts managed by YARN.