[HDFS-6997] Archival Storage: add more tests for data migration and replicaion

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: Archival Storage (HDFS-6584)
• Component/s: balancer & mover, namenode
• Hadoop Flags: Reviewed

Release Note

This JIRA also includes a fix for free space calculation in BlockPlacementPolicyDefault. Previously, when calculating the amount of free space per storage, it was using the per-node rather than the per-storage number of blocks currently scheduled for write. This grossly overestimates the amount of space to reserve for open files, and can result in storages being incorrectly marked as full.

• Assignee: Tsz-wo Sze
• Reporter: Tsz-wo Sze
• Created: 04/Sep/14 21:24
• Updated: 09/Apr/15 23:01
• Resolved: 06/Sep/14 23:50

Description

This JIRA is to add more tests to check if the data migration tool could move the replicas correctly and if the replication monitor could replicate block correctly when storage policy is considered.