Bulk Operation

HADOOP-15620 fs.s3a.authoritative.path should support multiple FS URIs

HADOOP-15620 ITestS3GuardOutOfBandOperations failing on versioned S3 buckets

HADOOP-15620 TestHarFileSystem.testInheritedMethodsImplemented broken

HADOOP-15620 Large DeleteObject requests are their own Thundering Herd

HADOOP-15620 S3Guard listFiles will not query S3 if all listings are authoritative

HADOOP-15620 S3A reverts KMS encryption to the bucket's default KMS key in rename/copy

HADOOP-15620 Let s3 clients configure request timeout

HADOOP-15620 S3AInputStream reopening does not handle non IO exceptions properly

HADOOP-15620 Filesystem openFile() builder to take a FileStatus param

HADOOP-15620 Refine testing.md to tell user better how to use auth-keys.xml

HADOOP-15620 Increase timeout unit test rule for MetadataStoreTestBase

HADOOP-15620 DurationInfo text parsing/formatting should be moved out of hotpath

HADOOP-15620 S3A empty dir markers are not created in s3guard as authoritative

HADOOP-15620 S3Guard to support encrypted DynamoDB table

HADOOP-15620 s3guard prune can delete directories -leaving orphan children.

HADOOP-15620 S3GuardTool to support FilterFileSystem

HADOOP-15620 S3A bucket existence checks to support v2 API and "no checks at all"

HADOOP-15620 S3Guard: Make authoritative mode exclusive for metadata - don't check for expiry for authoritative paths

HADOOP-15620 HadoopExecutors cleanup to only log at debug

HADOOP-15620 S3Guard DDB overreacts to no tag access

HADOOP-15620 S3 getBucketLocation() can return "US" for us-east

HADOOP-15620 ITestS3AClosedFS failing -junit test thread

HADOOP-15620 S3A Delegation Token extension point to use StoreContext

HADOOP-15620 S3A innerGetFileStatus s"directories only" scan still does a HEAD

HADOOP-15620 S3A ITest failures without S3Guard

HADOOP-15620 Speculating & Partitioned S3A magic committers can leave pending files under __magic

HADOOP-15620 S3A ITestRestrictedReadAccess fails

HADOOP-15620 s3a attempts to look up password/encryption fail if JCEKS file unreadable

HADOOP-15620 S3A ITest*MRjob failures

HADOOP-15620 S3A committers leak threads/raises OOM on job/task commit at scale

HADOOP-15620 S3ADelegationTokens to only log at debug on startup

HADOOP-15620 S3A retry policy to be exponential

HADOOP-15620 S3Guard bucket-info fails if the bucket location is denied to the caller

HADOOP-15620 S3A delegation token tests fail if fs.s3a.encryption.key set

HADOOP-15620 Restore (documented) fs.s3a.SharedInstanceProfileCredentialsProvider

HADOOP-15620 Make last AWS credential provider in default auth chain EC2ContainerCredentialsProviderWrapper

HADOOP-15620 Typo in s3a committers.md doc

HADOOP-15620 ITestS3ACommitterFactory failing, S3 client is not inconsistent

HADOOP-15620 Downgrade INFO message on rm s3a root dir to DEBUG

HADOOP-15620 AbstractITCommitMRJob.testMRJob test failures

HADOOP-15620 S3A returns 400 "bad request" on a single path within an S3 bucket

HADOOP-15620 S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

HADOOP-15620 Option to disable GCM for SSL connections when running on Java 8

HADOOP-15620 S3A NullPointerException: null uri host. This can be caused by unencoded / in the password string

HADOOP-15620 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

HADOOP-15620 MapReduce job tasks fails on S3A ssl3_get_server_certificate:certificate verify

HADOOP-15620 Stabilize S3A OpenSSL support

HADOOP-15620 Test Hang in S3A S3guard test MetadataStoreTestBase.testListChildren

HADOOP-15620 Remove S3A's depedency on http core

HADOOP-15620 Regression: TestStagingPartitionedJobCommit failing with empty etag list

HADOOP-15620 ClassCastException in S3GuardTool.checkMetadataStoreUri

HADOOP-15620 s3a test docs to mention non-auth; or s3a tests to default to non-auth

HADOOP-15620 S3A Delegation Token code to spell "Marshalled" as Marshaled

HADOOP-15620 S3A Etag tests fail with default encryption enabled on bucket

HADOOP-15620 S3A delegation tests fail if you set fs.s3a.secret.key

HADOOP-15620 S3AFileStatus to declare that isEncrypted() is always true

HADOOP-15620 Improved S3A MR tests

HADOOP-15620 S3AFileSystem#innerMkdirs builds needless lists

HADOOP-15620 S3AUtils.translateException to map CredentialInitializationException to AccessDeniedException

HADOOP-15620 S3A MarshalledCredentials.toString() doesn't print full date/time of expiry

HADOOP-15620 S3A copyFile operation to include source versionID or etag in the copy request

HADOOP-15620 regression: ITestS3AMiniYarnCluster failing on branch-3.2

HADOOP-15620 S3Guard to add DynamoDBLocal Support

HADOOP-15620 Extend documentation in testing.md about endpoint constants

HADOOP-15620 Update AWS SDK to 1.11.563

HADOOP-15620 Parquet reading S3AFileSystem causes EOF

HADOOP-15620 Move DurationInfo from hadoop-aws to hadoop-common org.apache.hadoop.util

HADOOP-15620 Token.toString faulting if any token listed can't load.

HADOOP-15620 S3A tests to include Terasort

HADOOP-15620 S3A SSL connections should use OpenSSL

HADOOP-15620 hamcrest-library declaration in hadoop-aws to be scoped test

HADOOP-15620 [DOC] Effective use of FS instances during S3A integration tests

HADOOP-15620 Add bouncycastle jars to hadoop-aws as test dependencies

HADOOP-15620 S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2

HADOOP-15620 S3A committers: make sure there's regular progress() calls

HADOOP-15620 Oozie unable to create sharelib in s3a filesystem

HADOOP-15620 Hadoop aws does not use shaded jars

HADOOP-15620 get patch for S3a nextReadPos(), through Yetus

HADOOP-15620 Some S3A committer tests don't match ITest* pattern; don't run in maven

HADOOP-15620 ITestS3AContractMultipartUploader#testMultipartUploadEmptyPart test error

HADOOP-15620 Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys

HADOOP-15620 @Retries annotation of putObject() call & uses wrong

HADOOP-15620 Move ITestS3AMiniYarnCluster to S3A committers

HADOOP-15620 remove obsolete S3A test ITestS3ACredentialsInURL

HADOOP-15620 S3 listing inconsistency can raise NPE in globber

HADOOP-15620 warning about user:pass in URI to explicitly call out Hadoop 3.2 as removal

HADOOP-15620 [s3a] stop treat fs.s3a.max.threads as the long-term minimum

HADOOP-15620 add s3guard CLI command to generate session keys for an assumed role

HADOOP-15620 FileSystemMultipartUploader should verify that UploadHandle has non-0 length

HADOOP-15620 Memory leak in S3AOutputStream

HADOOP-15620 S3A input stream to use etags/version number to detect changed source files

HADOOP-15620 Bulk commits of S3A MPUs place needless excessive load on S3 & S3Guard

HADOOP-15620 Stabilise/formalise the JSON _SUCCESS format used in the S3A committers

HADOOP-15620 S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2

HADOOP-15620 S3A log message on rm s3a://bucket/ not intuitive

HADOOP-15620 Add support for S3 Select to S3A

HADOOP-15620 S3A Retry policy to retry on NoResponseException

HADOOP-15620 S3a to support get/set permissions through S3 object tags

HADOOP-15620 S3aUtils.getEncryptionAlgorithm() always logs@Debug "Using SSE-C"

HADOOP-15620 S3A warning of obsolete encryption key which is never used

HADOOP-15620 S3AInputStream to implement CanUnbuffer

HADOOP-15620 S3A client raising ConnectionPoolTimeoutException in test

HADOOP-15620 S3A to support Delegation Tokens

HADOOP-15620 S3A init hangs if you try to connect while the system is offline

HADOOP-15620 s3a create(overwrite=true) to only look for dir/ and list entries, not file

HADOOP-15620 fs -expunge to take a filesystem

HADOOP-15620 S3a rename() to copy files in a directory in parallel

HADOOP-15620 S3A: Consider using TransferManager.download for copyToLocalFile

HADOOP-15620 S3A should allow renaming to a pre-existing destination directory to move the source path under that directory, similar to HDFS.

HADOOP-15620 Add S3A implementation of FSMainOperationsBaseTest

HADOOP-15620 Parallelize S3A directory deletes

HADOOP-15620 Add HTrace to the s3a connector