Our project, Pig, exposes FsShell functionality to our end users through a shell command. We want to use this command with no modifications to make sure that whether you work with HDFS through Hadoop or Pig you get identical semantics.
The main concern that has been recently raised by our users is that there is no way to ignore certain failures that they consider to be benign, for instance, removing a non-existent directory.
We have 2 asks related to this issue:
(1) Meaningful error code returned from FsShell (we use java class) so that we can take different actions on different errors
(2) Unix like ways to tell the command to ignore certain behavior. Here are the commands that we would like to be expanded/implemented:
- rm -f
- rmdir ---ignore-fail-on-non-empty
- mkdir -p