Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12292

Federation: Support viewfs:// schema path for DfsAdmin commands

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: federation
    • Labels:
      None

      Description

      Motivation:
      As of now, clients need to specify a nameservice when a cluster is federated, otherwise, the exception is fired:

      hdfs dfsadmin -setQuota 10 viewfs://vfs-root/user/uname
      setQuota: FileSystem viewfs://vfs-root/ is not an HDFS file system
      
      # with fs.defaultFS = viewfs://vfs-root/
      hdfs dfsadmin -setQuota 10 vfs-root/user/uname
      setQuota: FileSystem viewfs://vfs-root/ is not an HDFS file system
      
      # works fine thanks to https://issues.apache.org/jira/browse/HDFS-11432
      hdfs dfsadmin -setQuota 10 hdfs://users-fs/user/uname
      

      This creates inconvenience, inability to rely on fs.defaultFS and forces to create client-side mappings for management scripts

      Implementation:
      PathData that is passed to commands should be resolved to its actual FileSystem

      Result:
      ViewFS will be resolved to the actual HDFS file system

        Attachments

        1. HDFS-12292-004.patch
          5 kB
          Mikhail Erofeev
        2. HDFS-12292-003.patch
          6 kB
          Mikhail Erofeev
        3. HDFS-12292-002.patch
          5 kB
          Mikhail Erofeev
        4. HDFS-12292.patch
          5 kB
          Mikhail Erofeev

          Issue Links

            Activity

              People

              • Assignee:
                erofeev Mikhail Erofeev
                Reporter:
                erofeev Mikhail Erofeev
              • Votes:
                1 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: