[HADOOP-89] files are not visible until they are closed

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.1.0
• Fix Version/s: 0.15.0
• Assignee: Dhruba Borthakur
• Reporter: Yoram Arnon
• Created: 17/Mar/06 10:16
• Updated: 08/Jul/09 16:41
• Resolved: 19/Sep/07 22:14

Description

the current behaviour, whereby a file is not visible until it is closed has several flaws,including:
1. no practical way to know if a file/job is progressing
2. no way to implement files that never close, such as log files
3. failure to close a file results in loss of the file

The part of the file that's written should be visible.

Issue Links

• is related to: HADOOP-1700 Append to files in HDFS
• relates to: HADOOP-1708 make files visible in the namespace as soon as they are created