Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11575

Supporting HDFS NFS gateway with Federated HDFS

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • nfs
    • None

    Description

      Currently HDFS NFS gateway only supports HDFS as the underlying filesystem.

      Federated HDFS with ViewFS helps in improving the scalability of the name nodes. However NFS is not supported with ViewFS.

      With this change, ViewFS using HDFS as the underlying filesystem can be exported using NFS. ViewFS mount table will be used to determine the exports which needs to be supported.

      Some important points
      1) This patch only supports HDFS as the underlying filesystem for ViewFS.
      2) This patch add support to add more than one export point in the NFS gateway
      3) Root filesystem of the ViewFS will not be mountable for NFS gateway with ViewFS,
      however this will not be the case for NFS gateway with HDFS
      4) A filehandle now apart from the field will also contain an identifier to identify the name node, this will be used to map to correct name node for file operations.

      Please find the attached pdf document which helps in explaining the design and the solution.

      Attachments

        1. HDFS-11575.001.patch
          95 kB
          Mukul Kumar Singh
        2. HDFS-11575.002.patch
          96 kB
          Mukul Kumar Singh
        3. HDFS-11575.003.patch
          98 kB
          Mukul Kumar Singh
        4. HDFS-11575.004.patch
          99 kB
          Mukul Kumar Singh
        5. HDFS-11575.005.patch
          99 kB
          Mukul Kumar Singh
        6. HDFS-11575.006.patch
          102 kB
          Mukul Kumar Singh
        7. HDFS-11575.007.patch
          96 kB
          Mukul Kumar Singh
        8. HDFS-11575.008.patch
          103 kB
          Mukul Kumar Singh
        9. HDFS-11575.009.patch
          106 kB
          Mukul Kumar Singh
        10. HDFS-11575.010.patch
          106 kB
          Mukul Kumar Singh
        11. HDFS-11575.011.patch
          109 kB
          Mukul Kumar Singh
        12. SupportingNFSwithFederatedHDFS.pdf
          84 kB
          Mukul Kumar Singh

        Issue Links

          Activity

            People

              msingh Mukul Kumar Singh
              msingh Mukul Kumar Singh
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: