Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-17770

WASB : Support disabling buffered reads in positional reads

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.4.0, 3.3.2
    • Component/s: None

      Description

      This is just like HADOOP-17038

      Right now it will do a seek to the position , read and then seek back to the old position. (As per the impl in the super class)
      In HBase kind of workloads we rely mostly on short preads. (like 64 KB size by default). So would be ideal to support a pure pos read API which will not even keep the data in a buffer but will only read the required data as what is asked for by the caller. (Not reading ahead more data as per the read size config)

      Allow an optional boolean config to be specified while opening file for read using which buffered pread can be disabled.
      FutureDataInputStreamBuilder openFile(Path path)

        Attachments

        1. Throughput_0 cache hit.png
          15 kB
          Anoop Sam John
        2. AvgLatency_0 cache hit.png
          14 kB
          Anoop Sam John
        3. Throughput_50% cache hit.png
          21 kB
          Anoop Sam John
        4. AvgLatency_50% cache hit.png
          19 kB
          Anoop Sam John

          Activity

            People

            • Assignee:
              anoop.hbase Anoop Sam John
              Reporter:
              anoop.hbase Anoop Sam John
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 5h 10m
                5h 10m