[YARN-6494] add mounting of HDFS Short-Circuit path for docker containers

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Auto Closed
• Component/s: nodemanager
• Labels: Docker
• Assignee: Jaeboo Jeong
• Reporter: Jaeboo Jeong
• Created: 19/Apr/17 12:24
• Updated: 02/May/18 22:34
• Resolved: 03/Nov/17 18:22

Description

Currently there is a error message about HDFS short-circuit when docker container start.

WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: error creating DomainSocket
java.net.ConnectException: connect(2) error: No such file or directory when trying to connect to ‘xxxxxxx’
    at org.apache.hadoop.net.unix.DomainSocket.connect0(Native Method)
    at org.apache.hadoop.net.unix.DomainSocket.connect(DomainSocket.java:250)
    at org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory.createSocket(DomainSocketFactory.java:164)
    at org.apache.hadoop.hdfs.BlockReaderFactory.nextDomainPeer(BlockReaderFactory.java:752)
...

if dfs.client.read.shortcircuit is true and dfs.domain.socket.path isn't equal “”, we need to mount volume for short-circuit path.