[HDFS-4855] DFSOutputStream reference should be cleared from DFSClient#filesBeingWritten if the file closure fails.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.0.4-alpha
• Component/s: hdfs-client
• Assignee: Vinayakumar B
• Reporter: Vinayakumar B
• Created: 27/May/13 14:57
• Updated: 31/May/13 23:08
• Resolved: 28/May/13 18:20

Description

If the file closure fails due to some exception, then DFSOutputStream reference should be removed from the DFSClient#filesBeingWritten.

Which is useless to keep and also memory consuming.

If the same client is being used for long time,, then there is a chance of client getting OOM due to this.

fix would be simple.

Just cover complete DFSOutputStream#close() under try-finally and move dfsClient.endFileLease(src); to finally block.

Any thoughts..?

Issue Links

• duplicates: HDFS-4504 DFSOutputStream#close doesn't always release resources (such as leases)