Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.3
    • Fix Version/s: 0.23.0
    • Component/s: None
    • Labels:
      None

      Description

      Our project, Pig, exposes FsShell functionality to our end users through a shell command. We want to use this command with no modifications to make sure that whether you work with HDFS through Hadoop or Pig you get identical semantics.

      The main concern that has been recently raised by our users is that there is no way to ignore certain failures that they consider to be benign, for instance, removing a non-existent directory.

      We have 2 asks related to this issue:

      (1) Meaningful error code returned from FsShell (we use java class) so that we can take different actions on different errors
      (2) Unix like ways to tell the command to ignore certain behavior. Here are the commands that we would like to be expanded/implemented:

      • rm -f
      • rmdir ---ignore-fail-on-non-empty
      • mkdir -p

        Issue Links

          Activity

          Daryn Sharp made changes -
          Fix Version/s 0.23.0 [ 12315569 ]
          Fix Version/s 0.24.0 [ 12317652 ]
          Daryn Sharp made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Fix Version/s 0.24.0 [ 12317652 ]
          Fix Version/s 0.23.0 [ 12315569 ]
          Daryn Sharp made changes -
          Fix Version/s 0.23.0 [ 12315569 ]
          Daryn Sharp made changes -
          Link This issue incorporates HADOOP-6385 [ HADOOP-6385 ]
          Daryn Sharp made changes -
          Link This issue incorporates HDFS-639 [ HDFS-639 ]
          Daryn Sharp made changes -
          Link This issue is part of HADOOP-7176 [ HADOOP-7176 ]
          Daryn Sharp made changes -
          Assignee Daryn Sharp [ daryn ]
          Chris Douglas made changes -
          Project Hadoop HDFS [ 12310942 ] Hadoop Common [ 12310240 ]
          Key HDFS-1784 HADOOP-7209
          Affects Version/s 0.20.3 [ 12314812 ]
          Affects Version/s 0.20.3 [ 12314814 ]
          Chris Douglas made changes -
          Field Original Value New Value
          Project Hadoop Map/Reduce [ 12310941 ] Hadoop HDFS [ 12310942 ]
          Key MAPREDUCE-2404 HDFS-1784
          Affects Version/s 0.20.3 [ 12314814 ]
          Affects Version/s 0.20.3 [ 12314813 ]
          Olga Natkovich created issue -

            People

            • Assignee:
              Daryn Sharp
              Reporter:
              Olga Natkovich
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development