Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12376

S3NInputStream.close() downloads the remaining bytes of the object from S3

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 2.6.0, 2.7.1
    • None
    • fs/s3
    • None

    Description

      This is the same as HADOOP-11570, possibly the swift code has the same problem.

      Apparently (as raised on ASF lists), when you close an s3n input stream, it
      reads through the remainder of the file. This kills performance on partial reads of large files.

      Attachments

        Issue Links

          is broken by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-9623 Update jets3t dependency to 0.9.0

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue HADOOP-11570 S3AInputStream.close() downloads the remaining bytes of the object from S3

          • Major - Major loss of function.
          • Closed

          Activity

            People

              ajithshetty Ajith S
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: