Bulk Operation

  1. Choose Issues
  2. Choose Operation
  3. Operation Details
  4. Confirmation

Step 1 of 4: Choose Issues

Cancel

T Patch Info Key Summary Assignee Reporter P Status Resolution Created Updated Due Development
Sub-task HADOOP-17181

HADOOP-16829 ITestS3AContractUnbuffer failure -stream.read didn't return all data

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-17167

HADOOP-16829 ITestS3AEncryptionWithDefaultS3Settings fails if default bucket encryption != KMS

Mukund Thakur Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-17139

HADOOP-16829 Re-enable optimized copyFromLocal implementation in S3AFileSystem

Unassigned Sahil Takiar Minor Open Unresolved  
Sub-task HADOOP-17135

HADOOP-16829 ITestS3GuardOutOfBandOperations testListingDelete[auth=false] fails on unversioned bucket

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-17134

HADOOP-16829 S3AFileSystem.listLocatedStatu(file) does a LIST even with S3Guard

Mukund Thakur Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-17112

HADOOP-16829 whitespace not allowed in paths when saving files to s3a via committer

Unassigned Krzysztof Adamski Major Open Unresolved  
Sub-task HADOOP-17077

HADOOP-16829 S3A delegation token binding to support secondary binding list

Steve Loughran Steve Loughran Major In Progress Unresolved  
Sub-task HADOOP-17074

HADOOP-16829 Optimise s3a Listing to be fully asynchronous.

Mukund Thakur Mukund Thakur Major Open Unresolved  
Sub-task HADOOP-17066

HADOOP-16829 S3A staging committer committing duplicate files

Steve Loughran Steve Loughran Major Open Unresolved  
Sub-task HADOOP-17063

HADOOP-16829 S3A deleteObjects hanging/retrying forever

Unassigned Dyno Minor Open Unresolved  
Sub-task HADOOP-17023

HADOOP-16829 Tune listStatus() api of s3a.

Mukund Thakur Mukund Thakur Major Open Unresolved  
Sub-task HADOOP-17017

HADOOP-16829 S3A client retries on SSL Auth exceptions triggered by "." bucket names

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16995

HADOOP-16829 ITestS3AConfiguration proxy tests fail when bucket probes == 0

Mukund Thakur Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16945

HADOOP-16829 log accepted/rejected fs.s3a.authoritative.path paths @ debug

Unassigned Steve Loughran Trivial Open Unresolved  
Sub-task HADOOP-16940

HADOOP-16829 ITestCustomSigner uses absolute paths off the bucket root rather than fork-relative

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16926

HADOOP-16829 s3guard can't init table if caller doesn't have tag permissions

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16923

HADOOP-16829 mkdir on s3a should not be sensitive to trailing '/'

Unassigned Zoltan Haindrich Major Open Unresolved  
Sub-task HADOOP-16921

HADOOP-16829 NPE in s3a byte buffer block upload

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16911

HADOOP-16829 S3A mkdirs to indicate which parent path element refers to a file

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16906

HADOOP-16829 Add some Abortable.abort() interface for streams etc which can be terminated

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16879

HADOOP-16829 s3a mkdirs() to not check dest for a dir marker

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16863

HADOOP-16829 Report on S3A cached 404 recovery better

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16843

HADOOP-16829 S3A DT marshalling to include nested error text in wrapped message

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16819

HADOOP-16829 Possible inconsistent state of AbstractDelegationTokenSecretManager

Hankó Gergely Hankó Gergely Major Patch Available Unresolved  
Sub-task HADOOP-16806

HADOOP-16829 AWS AssumedRoleCredentialProvider needs ExternalId add

Unassigned Jon Hartlaub Minor Open Unresolved  
Sub-task HADOOP-16804

HADOOP-16829 s3a mkdir path/ can add 404 to S3 load balancers

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16800

HADOOP-16829 ITestDynamoDBMetadataStore.testTableVersioning failure -DDB deleteItem consistency?

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16796

HADOOP-16829 Add AWS S3 Transfer acceleration support

Unassigned Pat H Minor Open Unresolved  
Sub-task HADOOP-16742

HADOOP-16829 Possible NPE in S3A MultiObjectDeleteSupport error handling

Steve Loughran Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16741

HADOOP-16829 Document `dynamodb:TagResource` an explicit client-side permission for S3Guard

Gabor Bota Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16721

HADOOP-16829 Add fs.s3a.rename.raises.exceptions to raise exceptions on rename failures

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16667

HADOOP-16829 s3guard LimitExceededException -too many tables

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16666

HADOOP-16829 typo in TestNeworkBinding

Steve Loughran Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16633

HADOOP-16829 Tune hadoop-aws parallel test surefire/failsafe settings

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16622

HADOOP-16829 intermittent failure of ITestCommitOperations: too many s3guard writes

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16618

HADOOP-16829 increase the default number of threads and http connections in S3A

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16613

HADOOP-16829 s3a to set fake directory marker contentType to application/x-directory

Steve Loughran Jose Torres Minor Open Unresolved  
Sub-task HADOOP-16574

HADOOP-16829 ITestS3AAWSCredentialsProvider tests fail if a bucket has DTs enabled

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16573

HADOOP-16829 IAM role created by S3A DT doesn't include DynamoDB scan

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16572

HADOOP-16829 S3A DT support to warn when loading expired token

Steve Loughran Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16571

HADOOP-16829 s3a to improve diags on s3a bad request message

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16567

HADOOP-16829 S3A Secret access to fall back to XML if credential provider raises IOE.

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16546

HADOOP-16829 make sure staging committers collect DTs for the staging FS

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16538

HADOOP-16829 S3AFilesystem trash handling should respect the current UGI

Unassigned Siddharth Seth Major Open Unresolved  
Sub-task HADOOP-16522

HADOOP-16829 Encrypt S3A buffered data on disk

Unassigned Mike Yoder Major Open Unresolved  
Sub-task HADOOP-16493

HADOOP-16829 S3AFilesystem.initiateRename() can skip check on dest.parent status if src has same parent

Steve Loughran Steve Loughran Minor In Progress Unresolved  
Sub-task HADOOP-16480

HADOOP-16829 S3 Select Exceptions are not being converted to IOEs

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16476

HADOOP-16829 Intermittent failure of ITestS3GuardConcurrentOps#testConcurrentTableCreations

Unassigned Gabor Bota Minor Open Unresolved  
Sub-task HADOOP-16473

HADOOP-16829 S3Guard prune to only remove auth dir marker if files (not tombstones) are removed

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16468

HADOOP-16829 S3AFileSystem.getContentSummary() to use listFiles(recursive)

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16442

HADOOP-16829 Intermittent failure of ITestS3GuardToolDynamoDB#testDynamoDBInitDestroyCycle

Unassigned Gabor Bota Minor Open Unresolved  
Sub-task HADOOP-16436

HADOOP-16829 Fix ITestS3GuardToolLocal#testInitNegativeRead test failure

Steve Loughran Gabor Bota Major Open Unresolved  
Sub-task HADOOP-16432

HADOOP-16829 Review S3A documentation to make sure it is consistent with the current codebase

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16415

HADOOP-16829 Speed up S3A test runs

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16414

HADOOP-16829 ITestS3AMiniYarnCluster fails on sequential runs with Kerberos error

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16413

HADOOP-16829 ITestS3ARemoteFileChanged doesn't overwrite test data creation

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16412

HADOOP-16829 S3a getFileStatus to update DDB if an S3 query returns etag/versionID

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16407

HADOOP-16829 Improve isolation of FS instances in S3A committer tests

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16393

HADOOP-16829 S3Guard init command uses global settings, not those of target bucket

Steve Loughran Steve Loughran Major Reopened Unresolved  
Sub-task HADOOP-16382

HADOOP-16829 Clock skew can cause S3Guard to think object metadata is out of date

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16370

HADOOP-16829 S3AFileSystem copyFile to propagate etag/version from getObjectMetadata to copy request

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16362

HADOOP-16829 ITestS3GuardToolDynamoDB.testDynamoDBInitDestroyCycle fails if test bucket isn't on demand

Steve Loughran Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16355

HADOOP-16829 ZookeeperMetadataStore: Use Zookeeper as S3Guard backend store

Unassigned Mingliang Liu Major Open Unresolved  
Sub-task HADOOP-16343

HADOOP-16829 Add option for a prefix to put in front of every s3guard table

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16313

HADOOP-16829 multipart/huge file upload tests to look at checksums returned

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16308

HADOOP-16829 ITestS3AContractSeek teardown closes test FS before superclass can do its cleanup

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16223

HADOOP-16829 remove misleading fs.s3a.delegation.tokens.enabled prompt

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16203

HADOOP-16829 ITestS3AContractGetFileStatusV1List may have consistency issues

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16202

HADOOP-16829 Enhance S3A openFile()

Steve Loughran Steve Loughran Major In Progress Unresolved  
Sub-task HADOOP-16189

HADOOP-16829 S3A copy/rename of large files to be parallelized as a multipart operation

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16188

HADOOP-16829 s3a rename failed during copy, "Unable to copy part" + 200 error code

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16185

HADOOP-16829 S3Guard: Optimize performance of handling OOB operations in non-authoritative mode

Unassigned Gabor Bota Minor Open Unresolved  
Sub-task HADOOP-16176

HADOOP-16829 Add some tests about S3 timestamp tracking

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16164

HADOOP-16829 S3aDelegationTokens to add accessor for tests to get at the token binding

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16155

HADOOP-16829 S3AInputStream read(bytes[]) to not retry on read failure: pass action up

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16154

HADOOP-16829 ITestS3A select tests fail if user kinited in

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16134

HADOOP-16829 Add S3AWriteOpContext for write ops; pass in statistics and other settings

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-16133

HADOOP-16829 S3A statistic collection underrecords bytes written in helper threads

Steve Loughran Steve Loughran Minor In Progress Unresolved  
Sub-task HADOOP-16132

HADOOP-16829 Support multipart download in S3AFileSystem

Unassigned Justin Uang Major Open Unresolved  
Sub-task HADOOP-16128

HADOOP-16829 Some S3A tests leak filesystem instances

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16101

HADOOP-16829 Use lighter-weight alternatives to innerGetFileStatus where possible

Unassigned Sean Mackrory Major Open Unresolved  
Sub-task HADOOP-16066

HADOOP-16829 S3a DelegationToken bindings to to support a "correlation ID" for the UA header

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-16017

HADOOP-16829 Add some S3A-specific create file options

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15964

HADOOP-16829 Add S3A support for Async Scatter/Gather IO

Gabor Bota Steve Loughran Major Open Unresolved  
Sub-task HADOOP-15955

HADOOP-16829 declare that fs.s3a.ext. is a prefix for arbitrary extensions

Unassigned Steve Loughran Trivial Open Unresolved  
Sub-task HADOOP-15944

HADOOP-16829 S3AInputStream logging to make it easier to debug file leakage

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15915

HADOOP-16829 Report problems w/ local S3A buffer directory meaningfully

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-15894

HADOOP-16829 getFileChecksum() needs to adopt S3Guard

lqjacklee Steve Loughran Minor In Progress Unresolved  
Sub-task HADOOP-15875

HADOOP-16829 S3AInputStream.seek should throw EOFException if seeking past the end of file

Unassigned Shixiong Zhu Minor Open Unresolved  
Sub-task HADOOP-15870

HADOOP-16829 S3AInputStream.remainingInFile should use nextReadPos

lqjacklee Shixiong Zhu Major Reopened Unresolved  
Sub-task HADOOP-15844

HADOOP-16829 tag S3GuardTool entry points as limitedPrivate("management-tools")/evolving

Steve Loughran Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15834

HADOOP-16829 Improve throttling on S3Guard DDB batch retries

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15807

HADOOP-16829 ITestS3AContractRootDir failure on non-S3Guarded bucket

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15782

HADOOP-16829 Clarify committers.md around v2 failure handling

Unassigned Gera Shegalov Major Open Unresolved  
Sub-task HADOOP-15779

HADOOP-16829 S3guard: add inconsistency detection metrics

Unassigned Aaron Fabbri Major Open Unresolved  
Sub-task HADOOP-15751

HADOOP-16829 AWS Data read stack trace in S3a putObjectDirect

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15737

HADOOP-16829 intermittent failure of ITestS3GuardListConsistency.testInconsistentS3ClientDeletes in parallel runs

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15651

HADOOP-16829 NPE in S3AInputStream.read() in ITestS3AInconsistency.testOpenFailOnRead

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-15650

HADOOP-16829 Add custom InstanceProfileCredentialsProvider with more resilience to throttling

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15631

HADOOP-16829 Remove transient dependency on hadoop-hdfs-client

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-15628

HADOOP-16829 S3A Filesystem does not check return from AmazonS3Client deleteObjects

Unassigned Steve Jacobs Minor Open Unresolved  
Sub-task HADOOP-15603

HADOOP-16829 S3A to support configuring various AWS S3 client extended options

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15575

HADOOP-16829 Add a way for an FS instance to say "really, no trash interval at all"

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-15570

HADOOP-16829 s3guard uploads command to list date and initiator of outstanding uploads

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15555

HADOOP-16829 S3AFileStatus to add a serialVersionUID; review & test serialization

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-15503

HADOOP-16829 strip s3.amazonaws.com off hostnames before making s3a calls

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15492

HADOOP-16829 increase performance of s3guard import command

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15489

HADOOP-16829 S3Guard to self update on directory listings of S3

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15485

HADOOP-16829 reduce/tune read failure fault injection on inconsistent client

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-15479

HADOOP-16829 s3guard bucket-info command to add a verify-property <key>=<value> <bucket>

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15460

HADOOP-16829 S3A FS to add "s3a:no-existence-checks" to the builder file creation option set

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-15348

HADOOP-16829 S3A Input Stream bytes read counter isn't getting through to StorageStatistics/instrumentation properly

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15347

HADOOP-16829 S3ARetryPolicy to handle AWS 500 responses/error code TooBusyException with the throttle backoff policy

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15314

HADOOP-16829 Scheme assertion in S3Guard DynamoDBMetadataStore::checkPath is unnecessarily restrictive

Unassigned DJ Hoffman Major Open Unresolved  
Sub-task HADOOP-15303

HADOOP-16829 make s3a read fault injection configurable including "off"

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15249

HADOOP-16829 review S3A translateException translation matches IBM CORS spec

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15245

HADOOP-16829 S3AInputStream.skip() to use lazy seek

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-15243

HADOOP-16829 test and document use of fs.s3a.signing-algorithm

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15224

HADOOP-16829 builld up md5 checksum as blocks are built in S3ABlockOutputStream; validate upload

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15140

HADOOP-16829 S3guard mistakes root URI without / as non-absolute path

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-15069

HADOOP-16829 support git-secrets commit hook to keep AWS secrets out of git

Steve Loughran Steve Loughran Minor Patch Available Unresolved  
Sub-task HADOOP-15057

HADOOP-16829 s3guard bucket-info command to include default bucket encryption info

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15034

HADOOP-16829 S3Guard instrumentation to include cost of DynamoDB ops as metric

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-15000

HADOOP-16829 s3a new getdefaultblocksize be called in getFileStatus which has not been implemented in s3afilesystem yet

Unassigned Yonger Minor Open Unresolved  
Sub-task HADOOP-14972

HADOOP-16829 S3A add histogram metrics types for latency, etc.

Sean Mackrory Sean Mackrory Major Open Unresolved  
Sub-task HADOOP-14943

HADOOP-16829 Add common getFileBlockLocations() emulation for object stores, including S3A

Steve Loughran Steve Loughran Minor Patch Available Unresolved  
Sub-task HADOOP-14937

HADOOP-16829 initial part uploads seem to block unnecessarily in S3ABlockOutputStream

Steven Rand Steven Rand Major Open Unresolved  
Sub-task HADOOP-14837

HADOOP-16829 Handle S3A "glacier" data

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-14776

HADOOP-16829 clean up ITestS3AFileSystemContract

Unassigned Steve Loughran Minor Patch Available Unresolved  
Sub-task HADOOP-14750

HADOOP-16829 s3guard to provide better diags on ddb init failures

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-14707

HADOOP-16829 AbstractContractDistCpTest to test attr preservation with -p, verify blobstores downgrade

Steve Loughran Steve Loughran Major Open Unresolved  
Sub-task HADOOP-14661

HADOOP-16829 S3A to support Requester Pays Buckets

Mandus Momberg Mandus Momberg Minor Patch Available Unresolved  
Sub-task HADOOP-14639

HADOOP-16829 test YARN log collection works to s3a

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-14603

HADOOP-16829 S3A input stream to support ByteBufferReadable

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-14585

HADOOP-16829 Ensure controls in-place to prevent clients with significant clock skews pruning aggressively

Unassigned Sean Mackrory Minor Open Unresolved  
Sub-task HADOOP-14510

HADOOP-16829 Use error code detail in AWS server responses for finer grained exceptions

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-14425

HADOOP-16829 Add more s3guard metrics

Unassigned Ai Deng Major Open Unresolved  
Sub-task HADOOP-14391

HADOOP-16829 s3a: auto-detect region for bucket and use right endpoint

Aaron Fabbri Aaron Fabbri Major Open Unresolved  
Sub-task HADOOP-14335

HADOOP-16829 Improve DynamoDB schema update story

Sean Mackrory Sean Mackrory Major Open Unresolved  
Sub-task HADOOP-14334

HADOOP-16829 S3 SSEC tests to downgrade when running against a mandatory encryption object store

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-14302

HADOOP-16829 Test MR split optimisation with recursive listing

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-14237

HADOOP-16829 S3A Support Shared Instance Profile Credentials Across All Hadoop Nodes

Kazuyuki Tanimura Kazuyuki Tanimura Minor Patch Available Unresolved  
Sub-task HADOOP-14159

HADOOP-16829 Add some Java-8 friendly way to work with RemoteIterable, especially listings

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-14158

HADOOP-16829 Possible for modified configuration to leak into metadatastore in S3GuardTool

Unassigned Sean Mackrory Minor Open Unresolved  
Sub-task HADOOP-14132

HADOOP-16829 Filesystem discovery to stop loading implementation classes

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-14124

HADOOP-16829 S3AFileSystem silently deletes "fake" directories when writing a file.

Unassigned Joel Baranick Minor Reopened Unresolved  
Sub-task HADOOP-14109

HADOOP-16829 improvements to S3GuardTool destroy command

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-14093

HADOOP-16829 add tests/docs for HAR files on s3a

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-14070

HADOOP-16829 S3a: Failed to reset the request input stream/make S3A uploadPart() retriable

Unassigned Seth Fitzsimmons Major Open Unresolved  
Sub-task HADOOP-14000

HADOOP-16829 S3guard metadata stores to support millions of entries

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-13887

HADOOP-16829 Encrypt S3A data client-side with AWS SDK (S3-CSE)

Igor Mazur Jeeyoung Kim Minor Patch Available Unresolved  
Sub-task HADOOP-13846

HADOOP-16829 S3A to implement rename(final Path src, final Path dst, final Rename... options)

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-13845

HADOOP-16829 s3a to instrument duration of HTTP calls

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-13841

HADOOP-16829 S3a auth exception to link to a wiki page on the problem

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-13762

HADOOP-16829 S3A: Set thread names with more specific information about the call.

Unassigned Chris Nauroth Major Open Unresolved  
Sub-task HADOOP-13728

HADOOP-16829 S3A can support short user-friendly aliases for configuration of credential providers.

Unassigned Chris Nauroth Minor Open Unresolved  
Sub-task HADOOP-13704

HADOOP-16829 S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-13695

HADOOP-16829 S3A to use a thread pool for async path operations

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-13637

HADOOP-16829 improve setting of max connections in AWS client

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-13636

HADOOP-16829 s3a rm on the CLI generates deprecation warning on io.bytes.per.checksum

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-13611

HADOOP-16829 FileSystem/s3a processDeleteOnExit to skip the exists() check

Unassigned Steve Loughran Trivial Open Unresolved  
Sub-task HADOOP-13585

HADOOP-16829 shell rm command to not rename to ~/.Trash in object stores

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-13551

HADOOP-16829 hook up AwsSdkMetrics to hadoop metrics

Steve Loughran Steve Loughran Major In Progress Unresolved  
Sub-task HADOOP-13525

HADOOP-16829 Optimize uses of FS operations in the ASF analysis frameworks and libraries

Steve Loughran Steve Loughran Major Open Unresolved  
Sub-task HADOOP-13507

HADOOP-16829 export s3a BlockingThreadPoolExecutorService pool info (size, load) as gauges

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-13430

HADOOP-16829 Optimize getFileStatus in S3A

Steven K. Wong Steven K. Wong Minor Open Unresolved  
Sub-task HADOOP-13407

HADOOP-16829 s3a directory housekeeping operations to be done in async thread

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-13334

HADOOP-16829 AmazonClient 30x exceptions to include redirect URL in message

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-13294

HADOOP-16829 Test hadoop fs shell against s3a; fix problems

Unassigned Steve Loughran Major Open Unresolved  
Sub-task HADOOP-13293

HADOOP-16829 add a special 0 byte input stream for empty blobs

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-13276

HADOOP-16829 S3a operations keep retrying if the password is wrong

Thomas Poepping Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-13230

HADOOP-16829 S3A to optionally retain directory markers

Steve Loughran Aaron Fabbri Major In Progress Unresolved  
Sub-task HADOOP-13007

HADOOP-16829 cherry pick s3 ehancements from PrestoS3FileSystem

Unassigned Steve Loughran Minor Open Unresolved  
Sub-task HADOOP-12878

HADOOP-16829 Impersonate hosts in s3a for better data locality handling

Thomas Demoor Thomas Demoor Major Open Unresolved  
Sub-task HADOOP-12020

HADOOP-16829 Support AWS S3 reduced redundancy storage class

Unassigned Yann Landrin-Schweitzer Major Open Unresolved  
Sub-task HADOOP-11621

HADOOP-16829 s3a doesn't consider blobs with trailing / and content-length >0 as directories

Unassigned Denis Jannot Major Open Unresolved  

Cancel