Details
-
Bug
-
Status: Open
-
P3
-
Resolution: Unresolved
-
2.7.0, 2.8.0
-
None
-
None
Description
S3FileSystem should have some retry behaviour if ObjectsDelete fails. I have seen such example in our job where 1 item from the delete batch cannot be deleted due to S3 InternalError causing the whole job to restart. The source code I am referring to:
The retry logic might be added to other S3 calls in S3FileSystem as well.