Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3053

Support for true zero-copy (mmap-based) reads

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • hdfs-client
    • None

    Description

      Continuing a discussion started in HDFS-2834, it would be slick to provide support for a true zero-copy read API. In this style API, rather than having the user pass buffers to read into, the DFS client would provide buffers to the user. This allows the client to pass slices of mmaped blocks, for example, which can cut one or two copies out of many read scenarios.

      Attachments

        Issue Links

          duplicates

          New Feature - A new feature of the product, which has yet to be developed. HDFS-4953 enable HDFS local reads via mmap

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-2834 ByteBuffer-based read API for DFSInputStream

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: