[HADOOP-17335] s3a listing operation will fail in async prefetch if fs closed

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Cannot Reproduce
• Affects Version/s: 3.4.0
• Component/s: fs/s3
• Assignee: Mukund Thakur
• Reporter: Steve Loughran
• Created: 28/Oct/20 16:53
• Updated: 17/May/21 05:38
• Resolved: 17/May/21 05:38

Description

The async prefetch logic in the S3A listing code gets into trouble if the FS closed and there was an async listing in progress.

In this situation we should think about recognising and converting into some FS-is-closed exception

Issue Links

• relates to: HADOOP-13811 s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize XML document destined for handler class
• relates to: HADOOP-17074 Optimise s3a Listing to be fully asynchronous.