[HADOOP-14825] Über-JIRA: S3Guard Phase II: Hadoop 3.1 features

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-beta1
• Fix Version/s: 3.1.0
• Component/s: fs/s3
• Target Version/s: 3.2.0
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 01/Sep/17 13:35
• Updated: 27/Mar/18 10:38
• Resolved: 27/Mar/18 10:38

Description

JIRA covering everything we want/need for a phase II of S3Guard

That includes

• features
• fixes
• Everything which was open under the HADOOP-13345 JIRA when S3Guard was committed to trunk

Issue Links

• depends upon: HADOOP-14531 [Umbrella] Improve S3A error handling & reporting
• is depended upon by: HADOOP-14831 Über-jira: S3a phase IV: Hadoop 3.1 features
• is superceded by: HADOOP-15226 Über-JIRA: S3Guard Phase III: Hadoop 3.2 features
• supercedes: HADOOP-13345 S3Guard: Improved Consistency for S3A

Sub-Tasks

• Enhance S3GuardTool with bucket-info and set-capacity commands, tests: Resolved
• Handle FNFE from S3Guard.getMetadataStore() in S3A initialize(): Resolved
• ITestS3AInconsistency.testGetFileStatus failing in -DS3guard test runs: Resolved
• S3Guard to perform retry and translation of exceptions: Resolved
• S3Guard: implement retries for DDB failures and throttling; translate exceptions: Resolved
• eliminate double stack trace on some s3guard CLI failures: Resolved