Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1593

FsShell should work with paths in non-default FileSystem

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.17.0
    • fs
    • None
    • Hide
      This bug allows non default path to specifeid in fsshell commands.

      So, you can now specify hadoop dfs -ls hdfs://remotehost1:port/path
        and hadoop dfs -ls hdfs://remotehost2:port/path without changing the config.
      Show
      This bug allows non default path to specifeid in fsshell commands. So, you can now specify hadoop dfs -ls hdfs://remotehost1:port/path   and hadoop dfs -ls hdfs://remotehost2:port/path without changing the config.

    Description

      If the default filesystem is, e.g., hdfs://foo:8888/, one should still be able to do 'bin/hadoop fs -ls hdfs://bar:9999/' or 'bin/hadoop fs -ls s3://cutting/foo'. Currently these generate a filesystem mismatch exception. This is because FsShell assumes that all paths are in the default FileSystem. Rather, the default filesystem should only be used for paths that do not specify a FileSystem. This would easily be accomplished by using Path#getFileSystem().

      Attachments

        1. patch_1593_1.patch
          27 kB
          Mahadev Konar
        2. patch_1593.patch
          28 kB
          Mahadev Konar

        Activity

          People

            mahadev Mahadev Konar
            cutting Doug Cutting
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: