Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4750

Support NFSv3 interface to HDFS

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: nfs
    • Labels:
      None

      Description

      Access HDFS is usually done through HDFS Client or webHDFS. Lack of seamless integration with client’s file system makes it difficult for users and impossible for some applications to access HDFS. NFS interface support is one way for HDFS to have such easy integration.

      This JIRA is to track the NFS protocol support for accessing HDFS. With HDFS client, webHDFS and the NFS interface, HDFS will be easier to access and be able support more applications and use cases.

      We will upload the design document and the initial implementation.

        Attachments

        1. HADOOP-NFS-Proposal.pdf
          221 kB
          Brandon Li
        2. HDFS-4750.patch
          371 kB
          Brandon Li
        3. nfs-trunk.patch
          368 kB
          Brandon Li

        Issue Links

        1.
        Provide HDFS based NFSv3 and Mountd implementation Sub-task Closed Brandon Li Actions
        2.
        Add script changes/utility for starting NFS gateway Sub-task Closed Brandon Li Actions
        3.
        Add NFS server export table to control export by hostname or IP range Sub-task Closed Jing Zhao Actions
        4.
        Use enum for nfs constants Sub-task Closed Tsz-wo Sze Actions
        5.
        Move IO operations out of locking in OpenFileCtx Sub-task Closed Jing Zhao Actions
        6.
        Support symlink operations Sub-task Closed Brandon Li Actions
        7.
        Include hadoop-nfs and hadoop-hdfs-nfs into hadoop dist for NFS deployment Sub-task Closed Brandon Li Actions
        8.
        Change hdfs-nfs parent project to hadoop-project Sub-task Closed Brandon Li Actions
        9.
        Support file append in NFSv3 gateway to enable data streaming to HDFS Sub-task Closed Brandon Li Actions
        10.
        Add namespace ID and snapshot ID into fileHandle to support Federation and Snapshot Sub-task Open Unassigned Actions
        11.
        Refactor o.a.h.nfs to support different types of authentications Sub-task Closed Jing Zhao Actions
        12.
        Support dotdot name in NFS LOOKUP operation Sub-task Closed Brandon Li Actions
        13.
        Fix array copy error in Readdir and Readdirplus responses Sub-task Closed Brandon Li Actions
        14.
        Change FSDataOutputStream to HdfsDataOutputStream for opened streams to fix type cast error Sub-task Closed Brandon Li Actions
        15.
        MNT EXPORT should give the full group list which can mount the exports Sub-task Closed Brandon Li Actions
        16.
        Improve WriteManager for processing stable write requests and commit requests Sub-task Resolved Jing Zhao Actions
        17.
        NFS should create input stream for a file and try to share it with multiple read requests Sub-task Closed Haohui Mai Actions
        18.
        Handle race condition for writes Sub-task Resolved Brandon Li Actions
        19.
        Add more debug trace for NFS READ and WRITE Sub-task Closed Brandon Li Actions
        20.
        Include NFS jars in the maven assembly Sub-task Resolved Unassigned Actions
        21.
        Refactor RpcMessage and NFS3Response to support different types of authentication information Sub-task Closed Jing Zhao Actions
        22.
        Introduce RpcInfo to decouple XDR classes from the RPC API Sub-task Closed Haohui Mai Actions
        23.
        Move RpcFrameDecoder out of the public API Sub-task Closed Haohui Mai Actions
        24.
        Remove excessive copying due to XDR Sub-task Resolved Haohui Mai Actions
        25.
        Fix dumper thread which may die silently Sub-task Closed Brandon Li Actions
        26.
        Stable write is not handled correctly in someplace Sub-task Closed Brandon Li Actions
        27.
        Support client which combines appended data with old data before sends it to NFS server Sub-task Closed Brandon Li Actions
        28.
        COMMIT request should not block Sub-task Closed Brandon Li Actions
        29.
        Make Hadoop nfs server port and mount daemon port configurable Sub-task Closed Jinghui Wang Actions
        30.
        Close idle connections in portmap Sub-task Closed Haohui Mai Actions
        31.
        fix readdir and readdirplus for large directories Sub-task Closed Brandon Li Actions
        32.
        should do hsync for a commit request even there is no pending writes Sub-task Closed Brandon Li Actions
        33.
        add HDFS NFS user guide Sub-task Closed Brandon Li Actions
        34.
        Add OpenFileCtx cache Sub-task Closed Brandon Li Actions
        35.
        Add more unit tests for the inputstream cache Sub-task Open Unassigned Actions
        36.
        Add more unit tests for the data streaming Sub-task Open Unassigned Actions
        37.
        COMMIT handler should update the commit status after sync Sub-task Closed Brandon Li Actions

          Activity

            People

            • Assignee:
              brandonli Brandon Li
              Reporter:
              brandonli Brandon Li

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment