[HADOOP-12844] Recover when S3A fails on IOException in read()

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.1, 2.7.2
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: fs/s3
• Assignee: Pieter Reuse Assign to me
• Reporter: Pieter Reuse
• Created: 26/Feb/16 16:19
• Updated: 30/Aug/16 01:18
• Resolved: 12/May/16 18:32

Description

This simple patch catches IOExceptions in S3AInputStream.read(byte[] buf, int off, int len) and reopens the connection on the same location as it was before the exception.
This is similar to the functionality introduced in S3N in HADOOP-6254, for exactly the same reason.

Patch developed in cooperation with Emre Sevinç.

Issue Links

• Is contained by: HADOOP-13028 add low level counter metrics for S3A; use in read performance tests
• relates to: HADOOP-6254 s3n fails with SocketTimeoutException
• requires: HADOOP-12444 Support lazy seek in S3AInputStream