[HDFS-6647] Edit log corruption when pipeline recovery occurs for deleted file present in snapshot

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.4.1
• Fix Version/s: 2.5.0
• Component/s: namenode, snapshots
• Target Version/s: 2.5.0
• Hadoop Flags: Reviewed
• Assignee: Kihwal Lee
• Reporter: Aaron Myers
• Created: 09/Jul/14 07:27
• Updated: 03/Sep/14 20:34
• Resolved: 10/Jul/14 18:21

Description

I've encountered a situation wherein an OP_UPDATE_BLOCKS can appear in the edit log for a file after an OP_DELETE has previously been logged for that file. Such an edit log sequence cannot then be successfully read by the NameNode.

More details in the first comment.

Issue Links

• depends upon: HDFS-6618 FSNamesystem#delete drops the FSN lock between removing INodes from the tree and deleting them from the inode map