Export - CSV (All fields)
Export - CSV (Current fields)
HADOOP-17401
GCS to support per-bucket configuration
S3A: Consider avoiding array copy in S3ABlockOutputStream (ByteArrayBlock)
fix some typos in the s3a docs
ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks performance awful
S3AUtils.translateException to map (wrapped) InterruptedExceptions to InterruptedIOEs
Fix a couple of the s3a statistic names to be consistent with the rest
s3a rename: fail if dest file exists
regression: ITestS3AMiniYarnCluster failing
ITestS3AContractRootDir still playing up, bug in eventually() retry logic?
Purge superfluous/obsolete S3A Tests
ITestS3AFileContextStatistics.testStatistics() failing
switch to Configuration.getLongBytes for byte options
S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider.
S3ABlockOutputStream to pass Yetus & Jenkins
hadoop-aws should declare explicit dependency on Jackson 2 jars to prevent classpath conflicts.
fs.s3a.readahead.range to use getLongBytes
S3A can provide a more detailed error message when accessing a bucket through an incorrect S3 endpoint.
document object store use with fs shell and distcp
s3:// should have been fully cut off from trunk
Purge some superfluous/obsolete S3 FS tests that are slowing test runs down
s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown
S3AFastOutputStream to take ProgressListener in file create()
S3AFileSystem to override getStorageStatistics() and so serve up its statistics
NPE in S3AFastOutputStream.write
S3ABlockOutputStream to support huge (many GB) file writes
explicitly declare the Joda time version S3A depends on
improve section on troubleshooting s3a auth problems
S3A output streams to share a single LocalDirAllocator for round-robin drive use
doc for “fs.s3a.acl.default” indicates incorrect values
S3A to support per-bucket configuration
s3a tests don't authenticate with S3 frankfurt (or other V4 auth only endpoints)
S3A to list InstanceProfileCredentialsProvider after EnvironmentVariableCredentialsProvider
S3A TemporaryAWSCredentialsProvider to support Hadoop Credential providers for secrets
S3A reporting of file group as empty is harmful to compatibility for the shell.
Document S3A known limitations in file ownership and permission model.
add a S3A scale test to do gunzip and linecount
S3A to track multipart upload count, size, duration
hadoop fs command path doesn't include translation of amazon client exceptions
set multipart delete timeout to 5 * 60s in S3ATestUtils.createTestFileSystem
mvn fs/s3 test runs to set DNS TTL to 20s
Tune S3A provider plugin mechanism
document s3a better
s3a initialization against public bucket fails if caller lacks any credentials
Isolate test path used by a few S3A tests for more reliable parallel execution.
Provide an option to set the socket buffers in S3AFileSystem
S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories
S3A: Support fadvise "random" mode for high performance readPositioned() reads
S3A file-create should throw error rather than overwrite directories
Add StorageStatistics to S3A; instrument some more operations
Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs