[HDFS-5546] race condition crashes "hadoop ls -R" when directories are moved/removed

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Not A Problem
• Affects Version/s: 2.2.0
• Labels: BB2015-05-TBR
• Target Version/s: 2.8.0
• Assignee: Lei (Eddy) Xu
• Reporter: Colin McCabe
• Created: 21/Nov/13 19:34
• Updated: 12/Jul/15 01:47
• Resolved: 12/Jul/15 01:47

Description

This seems to be a rare race condition where we have a sequence of events like this:
1. org.apache.hadoop.shell.Ls calls DFS#getFileStatus on directory D.
2. someone deletes or moves directory D
3. org.apache.hadoop.shell.Ls calls PathData#getDirectoryContents(D), which calls DFS#listStatus(D). This throws FileNotFoundException.
4. ls command terminates with FNF