[HADOOP-14606] S3AInputStream: Handle http stream skip(n) skipping < n bytes in a forward seek

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Invalid
• Affects Version/s: 2.8.1
• Component/s: fs/s3
• Target Version/s: 3.2.0
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 28/Jun/17 12:04
• Updated: 21/Mar/18 23:58
• Resolved: 16/Feb/18 17:06

Description

There's some hints in the InputStream docs that skip may skip <n bytes. Codepaths only seem to do this if read() returns -1, meaning end of stream is reached.

If that happens when doing a forward seek via skip, then we have got our numbers wrong and are in trouble. Look for a negative response, log @ ERROR and revert to a close/reopen seek to an absolute position.

I have no evidence of this acutally occurring

Issue Links

• is duplicated by: HADOOP-14736 S3AInputStream to implement an efficient skip() call through seeking
• is related to: HADOOP-14736 S3AInputStream to implement an efficient skip() call through seeking