-
Type:
New Feature
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 2.8.1
-
Fix Version/s: 2.9.0, 3.0.0-beta1
-
Component/s: fs/s3
-
Labels:None
-
Target Version/s:
-
Release Note:
This issue proposes S3Guard, a new feature of S3A, to provide an option for a stronger consistency model than what is currently offered. The solution coordinates with a strongly consistent external store to resolve inconsistencies caused by the S3 eventual consistency model.
- depends upon
-
HADOOP-14432 S3A copyFromLocalFile to be robust, tested
-
- Resolved
-
-
HADOOP-13912 S3a Multipart Committer (avoid rename)
-
- Resolved
-
-
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set
-
- Resolved
-
- incorporates
-
HADOOP-14838 backport S3guard to branch-2
-
- Resolved
-
- is depended upon by
-
SPARK-17593 list files on s3 very slow
-
- Resolved
-
-
HADOOP-13204 Über-jira: S3a phase III: scale and tuning
-
- Resolved
-
- is related to
-
HADOOP-11487 FileNotFound on distcp to s3n/s3a due to creation inconsistency
-
- Resolved
-
-
SPARK-18883 FileNotFoundException on _temporary directory
-
- Resolved
-
- is superceded by
-
HADOOP-14825 Über-JIRA: S3Guard Phase II: Hadoop 3.1 features
-
- Resolved
-
- supercedes
-
HADOOP-14161 Failed to rename file in S3A during FileOutputFormat commitTask
-
- Resolved
-