Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-17770

WASB : Support disabling buffered reads in positional reads

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      This is just like HADOOP-17038

      Right now it will do a seek to the position , read and then seek back to the old position. (As per the impl in the super class)
      In HBase kind of workloads we rely mostly on short preads. (like 64 KB size by default). So would be ideal to support a pure pos read API which will not even keep the data in a buffer but will only read the required data as what is asked for by the caller. (Not reading ahead more data as per the read size config)

      Allow an optional boolean config to be specified while opening file for read using which buffered pread can be disabled.
      FutureDataInputStreamBuilder openFile(Path path)

      Attachments

        1. AvgLatency_0 cache hit.png
          14 kB
          Anoop Sam John
        2. AvgLatency_50% cache hit.png
          19 kB
          Anoop Sam John
        3. Throughput_0 cache hit.png
          15 kB
          Anoop Sam John
        4. Throughput_50% cache hit.png
          21 kB
          Anoop Sam John

        Activity

          People

            anoop.hbase Anoop Sam John
            anoop.hbase Anoop Sam John
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 5h 10m
                5h 10m