[HDFS-6991] Notify NN of evicted block before deleting it from RAM disk

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: HDFS-6581
• Fix Version/s: 2.6.0
• Component/s: datanode, namenode
• Hadoop Flags: Reviewed
• Assignee: Arpit Agarwal
• Reporter: Arpit Agarwal
• Created: 03/Sep/14 05:56
• Updated: 12/May/15 23:48
• Resolved: 08/Sep/14 21:30

Description

Couple of bug fixes required around eviction:

1. When evicting a block from RAM disk to persistent storage, the DN should schedule an incremental block report for a 'received' replica on persistent storage.
2. BlockManager.processReportedBlock needs a fix to correctly update the storage ID to reflect the block moving from RAM_DISK to DISK.

Found by xyao via HDFS-6950.

Issue Links

• duplicates: HDFS-6930 Improve replica eviction from RAM disk
• duplicates: HDFS-6988 Improve HDFS-6581 eviction configuration
• relates to: HDFS-8380 Always call addStoredBlock on blocks which have been shifted from one storage to another
• requires: HDFS-6930 Improve replica eviction from RAM disk
• requires: HDFS-6950 Add Additional unit tests for HDFS-6581
• requires: HDFS-6977 Delete all copies when a block is deleted from the block space