Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12292

Federation: Support viewfs:// schema path for DfsAdmin commands

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • federation
    • None

    Description

      Motivation:
      As of now, clients need to specify a nameservice when a cluster is federated, otherwise, the exception is fired:

      hdfs dfsadmin -setQuota 10 viewfs://vfs-root/user/uname
      setQuota: FileSystem viewfs://vfs-root/ is not an HDFS file system
      
      # with fs.defaultFS = viewfs://vfs-root/
      hdfs dfsadmin -setQuota 10 vfs-root/user/uname
      setQuota: FileSystem viewfs://vfs-root/ is not an HDFS file system
      
      # works fine thanks to https://issues.apache.org/jira/browse/HDFS-11432
      hdfs dfsadmin -setQuota 10 hdfs://users-fs/user/uname
      

      This creates inconvenience, inability to rely on fs.defaultFS and forces to create client-side mappings for management scripts

      Implementation:
      PathData that is passed to commands should be resolved to its actual FileSystem

      Result:
      ViewFS will be resolved to the actual HDFS file system

      Attachments

        1. HDFS-12292-004.patch
          5 kB
          Mikhail Erofeev
        2. HDFS-12292-003.patch
          6 kB
          Mikhail Erofeev
        3. HDFS-12292-002.patch
          5 kB
          Mikhail Erofeev
        4. HDFS-12292.patch
          5 kB
          Mikhail Erofeev

        Issue Links

          Activity

            People

              erofeev Mikhail Erofeev
              erofeev Mikhail Erofeev
              Votes:
              1 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated: