[HDFS-14892] Close the output stream if createWrappedOutputStream() fails

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: encryption
• Assignee: Unassigned
• Reporter: Kihwal Lee
• Created: 04/Oct/19 16:39
• Updated: 02/Mar/20 13:15

Description

create() in an encryption zone is a two step process by the client. First, a regular FSOutputStream is created and then it is wrapped with an encrypted stream. When there is a system issue or a KMS ACL-based denial, the second phase will fail. If the client terminates right away, the shutdown hook closes the output stream opened in the first phase. But if the client lives on, the output stream will leak.

Datanode's WebHdfsHandler, DFSClient, DistributedFileSystem, Hdfs (FileContext) and RpcProgramNfs3 do this.

Issue Links

• is related to: HADOOP-16885 Encryption zone file copy failure leaks temp file ._COPYING_ and wrapped stream
• relates to: HADOOP-16884 Encryption zone file copy failure leaks temp file ._COPYING_ and wrapped stream
• relates to: HDFS-15192 Leaking stream when access encrypted files hit exception via webhdfs