[HDFS-7648] Verify that HDFS blocks are in the correct datanode directories

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: datanode
• Assignee: Rakesh Radhakrishnan
• Reporter: Tsz-wo Sze
• Created: 21/Jan/15 01:07
• Updated: 22/Mar/16 04:26

Description

HDFS-6482 changed datanode layout to use block ID to determine the directory to store the block. We should have some mechanism to verify it. Either DirectoryScanner or block report generation could do the check.

Issue Links

• is duplicated by: HDFS-9955 DataNode won't self-heal after some block dirs were manually misplaced
• relates to: HDFS-6482 Use block ID-based block layout on datanodes

Sub-Tasks

• Log WARN message for the blocks which are not in Block ID based layout: Closed
• DirectoryScanner: Improve logs by adding full path of both actual and expected block directories: Closed