[HDFS-53] RawLocalFileSystem.listStatus() should not throw FileNotFound exception if a file goes missing while the list is being computed

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Assignee: Unassigned
• Reporter: Amar Kamat
• Created: 12/Sep/08 20:13
• Updated: 02/May/13 02:29
• Resolved: 29/Nov/11 14:20

Description

RawLocalFileSystem.listStatus() first caches the filenames and then gets their statuses. Since there is no directory locking, other processes can delete files in between making the cached filenames invalid. Getting the filestatus of missing file results into FileNotFound exception.

Issue Links

• duplicates: HADOOP-7015 RawLocalFileSystem#listStatus does not deal with a directory whose entries are changing ( e.g. in a multi-thread or multi-process environment)
• is depended upon by: HADOOP-3245 Provide ability to persist running jobs (extend HADOOP-1876)