Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12761 Ozone: Merge Ozone to trunk
  3. HDFS-12767

Ozone: Handle larger file sizes for OzoneOutputStream & OzoneInputStream

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • HDFS-7240
    • HDFS-7240
    • ozone
    • None

    Description

      This is based on stevel@apache.org's comments on HDFS-7240. This jira will add capabilities to OzoneOutputStream and OzoneInputStream stream to handle larger file sizes. This jira will also address other Streams related review comments.

      OzoneOutputStream

      Implement StreamCapabilities and declare that hsync/hflush are not supported.
      Unless there is no limit on the size of a PUT request/multipart uploads are supported, consider
      having the stream's write(int) method fail when the limit is reached.
      That way, things will at least fail fast.
      after close, set backupStream = null.
      flush() should be a no-op if called on a closed stream, so if (closed) return
      write() must fail if called on a closed stream,
      Again, OzoneException -> IOE translation which could/should be eliminated.

      OzoneInputStream
      1) You have chosen an interesting solution to the "efficient seek" problem here: D/L the entire file and then seek around. While this probably works for the first release, larger files will have problems in both disk space and size of
      2) Again, OzoneException -> IOE translation which could/should be eliminated.

      Attachments

        Activity

          People

            msingh Mukul Kumar Singh
            msingh Mukul Kumar Singh
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: