[HDFS-220] Transparent archival and restore of files from HDFS

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Assignee: Dhruba Borthakur
• Reporter: Dhruba Borthakur
• Created: 03/Sep/08 05:41
• Updated: 18/Jul/14 22:45
• Resolved: 18/Jul/14 22:45

Description

There should be a facility to migrate old files away from a production cluster. Access to those files from applications should continue to work transparently, without changing application code, but maybe with reduced performance. The policy engine that does this could be layered on HDFS rather than being built into HDFS itself.

Issue Links

• depends upon: HADOOP-1869 access times of HDFS files
• depends upon: HDFS-245 Create symbolic links in HDFS
• is blocked by: MAPREDUCE-642 distcp could have an option to preserve the full source path
• is blocked by: HADOOP-5620 discp can preserve modification times of files