[HADOOP-17312] S3AInputStream to be resilient to faiures in abort(); translate AWS Exceptions

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 3.3.0, 3.2.1
• Fix Version/s: 3.3.1
• Component/s: fs/s3
• Assignee: Yongjun Zhang
• Reporter: Steve Loughran
• Created: 19/Oct/20 11:01
• Updated: 06/Jan/21 16:07
• Resolved: 06/Jan/21 16:07

Description

Stack overflow issue complaining about ConnectionClosedException during S3AInputStream close(), seems triggered by an EOF exception in abort. That is: we are trying to close the stream and it is failing because the stream is closed. oops.

https://stackoverflow.com/questions/64412010/pyspark-org-apache-http-connectionclosedexception-premature-end-of-content-leng

Looking @ the stack, we aren't translating AWS exceptions in abort() to IOEs, which may be a factor.

Issue Links

• duplicates: HADOOP-17338 Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc