[HDFS-5031] BlockScanner scans the block multiple times and on restart scans everything

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.1.0-beta, 3.0.0-alpha1
• Fix Version/s: 2.2.0
• Component/s: datanode
• Assignee: Vinayakumar B
• Reporter: Vinayakumar B
• Created: 25/Jul/13 12:34
• Updated: 12/May/16 18:15
• Resolved: 18/Sep/13 20:38

Description

BlockScanner scans the block twice, also on restart of datanode scans everything.

Steps:
1. Write blocks with interval of more than 5 seconds. write new block on completion of scan for written block.

Each time datanode scans new block, it also scans, previous block which is already scanned.

Now after restart, datanode scans all blocks again.

Issue Links

• duplicates: HDFS-5225 datanode keeps logging the same 'is no longer in the dataset' message over and over again
• relates to: HDFS-5225 datanode keeps logging the same 'is no longer in the dataset' message over and over again