Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11575

Supporting HDFS NFS gateway with Federated HDFS

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.1.0
    • Component/s: nfs
    • Labels:
      None

      Description

      Currently HDFS NFS gateway only supports HDFS as the underlying filesystem.

      Federated HDFS with ViewFS helps in improving the scalability of the name nodes. However NFS is not supported with ViewFS.

      With this change, ViewFS using HDFS as the underlying filesystem can be exported using NFS. ViewFS mount table will be used to determine the exports which needs to be supported.

      Some important points
      1) This patch only supports HDFS as the underlying filesystem for ViewFS.
      2) This patch add support to add more than one export point in the NFS gateway
      3) Root filesystem of the ViewFS will not be mountable for NFS gateway with ViewFS,
      however this will not be the case for NFS gateway with HDFS
      4) A filehandle now apart from the field will also contain an identifier to identify the name node, this will be used to map to correct name node for file operations.

      Please find the attached pdf document which helps in explaining the design and the solution.

        Attachments

        1. SupportingNFSwithFederatedHDFS.pdf
          84 kB
          Mukul Kumar Singh
        2. HDFS-11575.011.patch
          109 kB
          Mukul Kumar Singh
        3. HDFS-11575.010.patch
          106 kB
          Mukul Kumar Singh
        4. HDFS-11575.009.patch
          106 kB
          Mukul Kumar Singh
        5. HDFS-11575.008.patch
          103 kB
          Mukul Kumar Singh
        6. HDFS-11575.007.patch
          96 kB
          Mukul Kumar Singh
        7. HDFS-11575.006.patch
          102 kB
          Mukul Kumar Singh
        8. HDFS-11575.005.patch
          99 kB
          Mukul Kumar Singh
        9. HDFS-11575.004.patch
          99 kB
          Mukul Kumar Singh
        10. HDFS-11575.003.patch
          98 kB
          Mukul Kumar Singh
        11. HDFS-11575.002.patch
          96 kB
          Mukul Kumar Singh
        12. HDFS-11575.001.patch
          95 kB
          Mukul Kumar Singh

          Issue Links

            Activity

              People

              • Assignee:
                msingh Mukul Kumar Singh
                Reporter:
                msingh Mukul Kumar Singh
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: