[HADOOP-7209] Extensions to FsShell

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.3
• Fix Version/s: 0.23.0
• Assignee: Daryn Sharp
• Reporter: Olga Natkovich
• Created: 25/Mar/11 00:17
• Updated: 24/Sep/12 17:35
• Resolved: 16/Apr/12 13:42

Description

Our project, Pig, exposes FsShell functionality to our end users through a shell command. We want to use this command with no modifications to make sure that whether you work with HDFS through Hadoop or Pig you get identical semantics.

The main concern that has been recently raised by our users is that there is no way to ignore certain failures that they consider to be benign, for instance, removing a non-existent directory.

We have 2 asks related to this issue:

(1) Meaningful error code returned from FsShell (we use java class) so that we can take different actions on different errors
(2) Unix like ways to tell the command to ignore certain behavior. Here are the commands that we would like to be expanded/implemented:

• rm -f
• rmdir ---ignore-fail-on-non-empty
• mkdir -p

Issue Links

• incorporates: HDFS-639 dfs does not support -rmdir
• incorporates: HADOOP-6385 dfs does not support -rmdir (was HDFS-639)
• is part of: HADOOP-7176 Redesign FsShell

Sub-Tasks

• Add mkdir -p flag: Resolved