[HDFS-8311] DataStreamer.transfer() should timeout the socket InputStream.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: hdfs-client
• Target Version/s: 2.8.0
• Hadoop Flags: Reviewed
• Assignee: Esteban Gutierrez
• Reporter: Esteban Gutierrez
• Created: 01/May/15 23:29
• Updated: 24/Mar/20 05:56
• Resolved: 08/May/15 20:55

Description

While validating some HA failure modes we found that HDFS clients can take a long time to recover or sometimes don't recover at all since we don't setup the socket timeout in the InputStream:

private void transfer () { ...
...
 OutputStream unbufOut = NetUtils.getOutputStream(sock, writeTimeout);
 InputStream unbufIn = NetUtils.getInputStream(sock);
...
}

The InputStream should have its own timeout in the same way as the OutputStream.

Issue Links

• is duplicated by: HDFS-14587 Support fail fast when client wait ACK by pipeline over threshold
• is related to: HDFS-13103 HDFS Client write acknowledgement timeout should not depend on read timeout
• relates to: HDFS-8359 Normalization of timeouts in InputStream and OutputStream
• relates to: HDFS-9106 Transfer failure during pipeline recovery causes permanent write failures