Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18028 High performance S3A input stream with prefetching & caching
  3. HADOOP-18378

Implement readFully(long position, byte[] buffer, int offset, int length)

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Implement readFully(long position, byte[] buffer, int offset, int length) in PrefetchingInputStream, as it currently uses FSInputStream's readFully which calls read(long position, byte[] buffer, int offset, int length).

      This read then seeks to the position (which is ok), but then seeks back to the original starting position at the end (so always seeking back to 0). this is pretty bad for the prefetching implementation as it means lots of caching to disk and getting blocks from disk. 

      when backporting. follow with HADOOP-18531

      Attachments

        Issue Links

          Activity

            People

              passaro Alessandro Passaro
              ahmar Ahmar Suhail
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: