[HDFS-9812] Streamer threads leak if failure happens when closing DFSOutputStream

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.1
• Fix Version/s: 2.8.0, 2.7.3, 3.0.0-alpha1
• Component/s: hdfs-client
• Hadoop Flags: Reviewed
• Assignee: Yiqun Lin
• Reporter: Yiqun Lin
• Created: 15/Feb/16 02:56
• Updated: 30/Aug/16 01:19
• Resolved: 08/Mar/16 02:20

Description

In HDFS-9794, it has solved problem of that stream thread leak if failure happens when closing the striped outputstream. And in DFSOutputStream, it also exists the same problem in DFSOutputStream#closeImpl. If failures happen when flushing data blocks, the streamer threads will also not be closed.

Issue Links

• relates to: HDFS-9794 Streamer threads may leak if failure happens when closing the striped outputstream
• relates to: HDFS-2043 TestHFlush failing intermittently