Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12376

S3NInputStream.close() downloads the remaining bytes of the object from S3

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 2.6.0, 2.7.1
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None

      Description

      This is the same as HADOOP-11570, possibly the swift code has the same problem.

      Apparently (as raised on ASF lists), when you close an s3n input stream, it
      reads through the remainder of the file. This kills performance on partial reads of large files.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ajithshetty Ajith S
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: