Hadoop Common
  1. Hadoop Common
  2. HADOOP-10492

Help Commands needs change after deprecation

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Tags:
      help, deprecation

      Description

      As hadoop dfs is deprecated, the help should show usage with HDFS

      e.g in the following command it still refers to
      Usage: hadoop fs [generic options]

      D:\Apps\java\BI\hadoop\hw\hdp\hadoop-2.2.0.2.0.6.0-0009>hdfs dfs
      Usage: hadoop fs [generic options]
      [-appendToFile <localsrc> ... <dst>]
      [-cat [-ignoreCrc] <src> ...]
      [-checksum <src> ...]
      [-chgrp [-R] GROUP PATH...]
      [-chmod [-R] <MODE[,MODE]... | OCTALMODE> PATH...]
      [-chown [-R] [OWNER][:[GROUP]] PATH...]
      [-copyFromLocal [-f] [-p] <localsrc> ... <dst>]
      [-copyToLocal [-p] [-ignoreCrc] [-crc] <src> ... <localdst>]
      [-count [-q] <path> ...]
      [-cp [-f] [-p] <src> ... <dst>]
      [-createSnapshot <snapshotDir> [<snapshotName>]]
      [-deleteSnapshot <snapshotDir> <snapshotName>]
      [-df [-h] [<path> ...]]
      [-du [-s] [-h] <path> ...]

      1. HADOOP-10492.patch
        0.7 kB
        Kenji Kikushima

        Activity

        Hide
        Harsh J added a comment -

        +1 for just "hadoop fs". There's a lot of confusion that its been
        deprecated, but it is not.


        Harsh J

        Show
        Harsh J added a comment - +1 for just "hadoop fs". There's a lot of confusion that its been deprecated, but it is not. – Harsh J
        Hide
        Daryn Sharp added a comment -

        IMHO, "hdfs dfs" should be deprecated too unless it explicitly & artificially restricts access to only hdfs filesystems. That's not reasonably going to happen, so I think it's fine for the usage to display the proper "hadoop fs" since "hdfs dfs" is essentially a compatibility wrapper.

        Show
        Daryn Sharp added a comment - IMHO, "hdfs dfs" should be deprecated too unless it explicitly & artificially restricts access to only hdfs filesystems. That's not reasonably going to happen, so I think it's fine for the usage to display the proper "hadoop fs" since "hdfs dfs" is essentially a compatibility wrapper.
        Kenji Kikushima made changes -
        Attachment HADOOP-10492.patch [ 12642816 ]
        Hide
        Kenji Kikushima added a comment -

        Hi, I checked hadoop and hdfs commands. We have three ways to call FsShell, "hadoop fs" "hadoop dfs" and "hdfs dfs". Only "hadoop dfs" is deprecated.
        So, I think we should print "hadoop fs" and "hdfs dfs" like this patch. Thanks.

        Show
        Kenji Kikushima added a comment - Hi, I checked hadoop and hdfs commands. We have three ways to call FsShell, "hadoop fs" "hadoop dfs" and "hdfs dfs". Only "hadoop dfs" is deprecated. So, I think we should print "hadoop fs" and "hdfs dfs" like this patch. Thanks.
        Raja Nagendra Kumar made changes -
        Field Original Value New Value
        Description As hadoop fs is deprecated, the help should show usage with HDFS

        e.g in the following command it still refers to
        Usage: hadoop fs [generic options]

        D:\Apps\java\BI\hadoop\hw\hdp\hadoop-2.2.0.2.0.6.0-0009>hdfs dfs
        Usage: hadoop fs [generic options]
                [-appendToFile <localsrc> ... <dst>]
                [-cat [-ignoreCrc] <src> ...]
                [-checksum <src> ...]
                [-chgrp [-R] GROUP PATH...]
                [-chmod [-R] <MODE[,MODE]... | OCTALMODE> PATH...]
                [-chown [-R] [OWNER][:[GROUP]] PATH...]
                [-copyFromLocal [-f] [-p] <localsrc> ... <dst>]
                [-copyToLocal [-p] [-ignoreCrc] [-crc] <src> ... <localdst>]
                [-count [-q] <path> ...]
                [-cp [-f] [-p] <src> ... <dst>]
                [-createSnapshot <snapshotDir> [<snapshotName>]]
                [-deleteSnapshot <snapshotDir> <snapshotName>]
                [-df [-h] [<path> ...]]
                [-du [-s] [-h] <path> ...]
        As hadoop dfs is deprecated, the help should show usage with HDFS

        e.g in the following command it still refers to
        Usage: hadoop fs [generic options]

        D:\Apps\java\BI\hadoop\hw\hdp\hadoop-2.2.0.2.0.6.0-0009>hdfs dfs
        Usage: hadoop fs [generic options]
                [-appendToFile <localsrc> ... <dst>]
                [-cat [-ignoreCrc] <src> ...]
                [-checksum <src> ...]
                [-chgrp [-R] GROUP PATH...]
                [-chmod [-R] <MODE[,MODE]... | OCTALMODE> PATH...]
                [-chown [-R] [OWNER][:[GROUP]] PATH...]
                [-copyFromLocal [-f] [-p] <localsrc> ... <dst>]
                [-copyToLocal [-p] [-ignoreCrc] [-crc] <src> ... <localdst>]
                [-count [-q] <path> ...]
                [-cp [-f] [-p] <src> ... <dst>]
                [-createSnapshot <snapshotDir> [<snapshotName>]]
                [-deleteSnapshot <snapshotDir> <snapshotName>]
                [-df [-h] [<path> ...]]
                [-du [-s] [-h] <path> ...]
        Hide
        Daryn Sharp added a comment -

        As hadoop fs is deprecated, the help should show usage with HDFS

        I thought "hdfs dfs" is being deprecated, not "hadoop fs"? Both call FsShell which is in hadoop-common because it works with any filesystem implementation. Requiring users to invoke "hdfs dfs" doesn't make sense for non-hdfs filesystems.

        Show
        Daryn Sharp added a comment - As hadoop fs is deprecated, the help should show usage with HDFS I thought "hdfs dfs" is being deprecated, not "hadoop fs"? Both call FsShell which is in hadoop-common because it works with any filesystem implementation. Requiring users to invoke "hdfs dfs" doesn't make sense for non-hdfs filesystems.
        Raja Nagendra Kumar created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Raja Nagendra Kumar
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:

              Development