[HADOOP-14714] handle InternalError in bulk object delete through retries - ASF JIRA

Voters

Watch issue

Watchers

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Duplicate
Affects Version/s: 2.8.0
Fix Version/s: None
Component/s: fs/s3
Labels:
None

Description

There's some more detail appearing on ~~HADOOP-11572~~ about the errors seen here; sounds like its large fileset related (or just probability working against you). Most importantly: retries may make it go away.

Proposed: implement a retry policy.

Issue: delete is not idempotent, not if someone else adds things.

Attachments

Issue Links

Add Link

Is contained by

HADOOP-13786 Add S3A committers for zero-rename commits to S3 endpoints

Resolved

Delete this link

Activity

Comment

This comment will be Viewable by All Users Viewable by All Users

Cancel

People

Assignee:: Unassigned

Reporter:: Steve Loughran

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 01/Aug/17 20:22

Updated:: 29/Oct/18 19:53

Resolved:: 22/Mar/18 05:20

Agile

View on Board

handle InternalError in bulk object delete through retries