Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3110

libhdfs implementation of direct read API

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.2-alpha
    • Component/s: libhdfs, performance
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      libhdfs is enhanced to read directly into user-supplied buffers when possible, reducing the number of memory copies.

      Description

      Once HDFS-2834 gets committed, we can add support for the new API to libhdfs, which leads to significant performance increases when reading local data from C.

        Attachments

        1. HDFS-3110.0.patch
          4 kB
          Henry Robinson
        2. HDFS-3110.1.patch
          13 kB
          Henry Robinson
        3. HDFS-3110.2.patch
          20 kB
          Henry Robinson
        4. HDFS-3110.3.patch
          19 kB
          Henry Robinson
        5. HDFS-3110.4.patch
          20 kB
          Henry Robinson
        6. HDFS-3110.5.patch
          20 kB
          Henry Robinson

          Issue Links

            Activity

              People

              • Assignee:
                henryr Henry Robinson
                Reporter:
                henryr Henry Robinson
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: