Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21946

Use ByteBuffer pread instead of byte[] pread in HFileBlock when applicable

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.5.0, 3.0.0-alpha-2
    • Offheaping
    • None

    Description

      stakiar is working on HDFS-3246, so now we have to keep the byte[] pread in HFileBlock reading. Once it get resolved, we can upgrade the hadoop version and do the replacement.
      I think it will be a great p999 latency improvement in 100% Get case, anyway file a issue address this firstly.

      Attachments

        1. HBASE-21946.HBASE-21879.v01.patch
          5 kB
          Zheng Hu
        2. HBASE-21946.HBASE-21879.v02.patch
          5 kB
          Zheng Hu
        3. HBASE-21946.HBASE-21879.v03.patch
          5 kB
          Zheng Hu
        4. HBASE-21946.HBASE-21879.v04.patch
          5 kB
          Zheng Hu

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HDDS-10511 OzoneFSInputStream to support ByteBufferPositionedReadable

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-28446 Remove the reflection for ByteBufferPositionedReadable

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-21879 Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. HDFS-14483 Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. HDFS-14585 Backport HDFS-8901 Use ByteBuffer in DFSInputStream#read to branch2.9

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #3434

          Activity

            People

              weichiu Wei-Chiu Chuang
              openinx Zheng Hu
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: