Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14483

Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.10.0, 2.9.3
    • None
    • None
    • Reviewed

    Description

      Provide a positioned ByteBuffer-based read, that is particularly useful for HBase which does a lot of preads

      Attachments

        1. HDFS-14483.branch-2.8.v1.patch
          49 kB
          Lisheng Sun
        2. HDFS-14483.branch-2.9.v1.patch
          56 kB
          Michael Stack
        3. HDFS-14483.branch-2.9.v1.patch
          56 kB
          Lisheng Sun
        4. HDFS-14483.branch-2.9.v2.patch
          56 kB
          Michael Stack
        5. HDFS-14483.branch-2.9.v2.patch
          56 kB
          Lisheng Sun
        6. HDFS-14483.branch-2.9.v2 (2).patch
          56 kB
          Michael Stack
        7. HDFS-14585.branch-2.9.v3.patch
          58 kB
          Michael Stack
        8. HDFS-14585.branch-2.9.v3.patch
          58 kB
          Michael Stack
        9. HDFS-14585.branch-2.9.v3.patch
          58 kB
          Lisheng Sun

        Issue Links

          Blocked

          Task - A task that needs to be done. HDFS-14585 Backport HDFS-8901 Use ByteBuffer in DFSInputStream#read to branch2.9

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-14111 hdfsOpenFile on HDFS causes unnecessary IO from file offset 0

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-21946 Use ByteBuffer pread instead of byte[] pread in HFileBlock when applicable

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-3246 pRead equivalent for direct read path

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-21879 Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #1046

          Activity

            People

              leosun08 Lisheng Sun
              openinx Zheng Hu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: