[#HADOOP-89] files are not visible until they are closed

Hadoop Common

files are not visible until they are closed

Created: 17/Mar/06 10:16 AM Updated: 08/Jul/09 04:41 PM

Return to search

Component/s:

None

Affects Version/s:

0.1.0

Fix Version/s:

0.15.0

Time Tracking:

Not Specified

File Attachments:

File Name	Date Attached	Attached By	Size
tail.patch	2007-09-18 06:07 PM	dhruba borthakur	38 kB
tail3.patch	2007-09-12 09:27 PM	dhruba borthakur	34 kB
tail4.patch	2007-09-18 06:08 PM	dhruba borthakur	39 kB

Issue Links:

Reference

This issue relates to:

~~HADOOP-1708~~ make files visible in the namespace as soon as they are created

This issue is related to:

~~HADOOP-1700~~ Append to files in HDFS

Resolution Date:

19/Sep/07 10:14 PM

Description

« Hide

the current behaviour, whereby a file is not visible until it is closed has several flaws,including:
1. no practical way to know if a file/job is progressing
2. no way to implement files that never close, such as log files
3. failure to close a file results in loss of the file

The part of the file that's written should be visible.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Repository	Revision	Date	User	Message
ASF	#577456	Wed Sep 19 22:12:49 UTC 2007	dhruba	~~HADOOP-89~~. A client can access file data even before the creator has closed the file. Introduce a new dfs shell command "tail". (Dhruba Borthakur via dhruba)
				Files Changed
				DEL /lucene/hadoop/trunk/src/java/org/apache/hadoop/dfs/FileUnderConstruction.java MODIFY /lucene/hadoop/trunk/src/java/org/apache/hadoop/fs/FsShell.java MODIFY /lucene/hadoop/trunk/src/java/org/apache/hadoop/dfs/INode.java DEL /lucene/hadoop/trunk/src/java/org/apache/hadoop/dfs/PendingCreates.java MODIFY /lucene/hadoop/trunk/src/test/org/apache/hadoop/dfs/TestFileCreation.java MODIFY /lucene/hadoop/trunk/src/java/org/apache/hadoop/dfs/FSNamesystem.java MODIFY /lucene/hadoop/trunk/src/java/org/apache/hadoop/dfs/FSDirectory.java MODIFY /lucene/hadoop/trunk/CHANGES.txt