[HADOOP-66] dfs client writes all data for a chunk to /tmp

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.1.0
• Fix Version/s: 0.1.0
• Assignee: Doug Cutting
• Reporter: Sameer Paranjpye
• Created: 07/Mar/06 07:55
• Updated: 08/Jul/09 16:41
• Resolved: 09/Mar/06 08:18

Description

The dfs client writes all the data for the current chunk to a file in /tmp, when the chunk is complete it is shipped out to the Datanodes. This can cause /tmp to fill up fast when a lot of files are being written. A potentially better scheme is to buffer the written data in RAM (application code can set the buffer size) and flush it to the Datanodes when the buffer fills up.