[HDFS-4683] Per directory trash settings / trash override

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Invalid

Environment

Hadoop2

• Assignee: Unassigned
• Reporter: John Vines
• Created: 10/Apr/13 17:09
• Updated: 02/May/13 02:30
• Resolved: 10/Apr/13 17:44

Description

With the migration of trash settings to server side, it becomes more complicated for applications built on top of HDFS to properly deal with their trash. Applications like HBase and Accumulo already have a fair amount of trash management, adding the HDFS Trash will simply put more stress on DFS. But fully disabling the trash is overkill, as there still may be use for it in other uses of hadoop.

I would like to request either:
A. per directory or user trash settings, so that applications which work in a specific directory or use a specific user can continue to ignore the trash.
B. An updated DistributedFileSystem delete() call which allows you to force ignoring the trash. I'm not sure how feasible this is due to the FileSystem API, but it may be possible.

Issue Links

• is related to: ACCUMULO-1254 no-trash option doesn't work against hadoop2 and CDH4
• relates to: HADOOP-8689 Make trash a server side configuration option