[HDFS-10800] [SPS]: Daemon thread in Namenode to find blocks placed in other storage than what the policy specifies

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: HDFS-10285
• Fix Version/s: HDFS-10285, 3.2.0
• Component/s: namenode
• Hadoop Flags: Reviewed
• Assignee: Uma Maheswara Rao G
• Reporter: Uma Maheswara Rao G
• Created: 25/Aug/16 23:34
• Updated: 13/Aug/18 05:39
• Resolved: 23/Sep/16 20:43

Description

This JIRA is for implementing a daemon thread called StoragePolicySatisfier in namatode, which scans the asked files blocks which are placed in different storages in DNs than the related policies specifie.

The idea is:

1. When user called on some files/dirs to satisfy storage policy, they should have been tracked in NN and then StoragePolicySatisfier thread will pick one by one file, then check the blocks which might have been placed in different storage in DN than what the storage policy is expecting it to.
2. After checking all, it should also construct the data structures with the required information to move a block from one storage to another.