[HADOOP-11851] s3n to swallow IOEs on inner stream close

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.6.0
• Component/s: fs/s3
• Target Version/s: 2.7.1
• Assignee: Tadayoshi Sato
• Reporter: Steve Loughran
• Created: 20/Apr/15 20:10
• Updated: 05/Jan/17 19:44
• Resolved: 23/Apr/15 21:51

Description

We've seen a situation where some work was failing from (recurrent) connection reset exceptions.

Irrespective of the root cause, these were surfacing not in the read operations, but when the input stream was being closed -including during a seek()

These exceptions could be caught & logged & warn, rather than trigger immediate failures. It shouldn't matter to the next GET whether the last stream closed prematurely, as long as the new one works

Issue Links

• Is contained by: HADOOP-11730 Regression: s3n read failure recovery broken
• is related to: HADOOP-11874 s3a can throw spurious IOEs on close()
• is related to: HADOOP-11570 S3AInputStream.close() downloads the remaining bytes of the object from S3
• relates to: HADOOP-11730 Regression: s3n read failure recovery broken