Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3110

libhdfs implementation of direct read API

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.2-alpha
    • Component/s: libhdfs, performance
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      libhdfs is enhanced to read directly into user-supplied buffers when possible, reducing the number of memory copies.

      Description

      Once HDFS-2834 gets committed, we can add support for the new API to libhdfs, which leads to significant performance increases when reading local data from C.

      1. HDFS-3110.5.patch
        20 kB
        Henry Robinson
      2. HDFS-3110.4.patch
        20 kB
        Henry Robinson
      3. HDFS-3110.3.patch
        19 kB
        Henry Robinson
      4. HDFS-3110.2.patch
        20 kB
        Henry Robinson
      5. HDFS-3110.1.patch
        13 kB
        Henry Robinson
      6. HDFS-3110.0.patch
        4 kB
        Henry Robinson

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Henry Robinson
              Reporter:
              Henry Robinson
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development