Bulk Operation

  1. Choose Issues
  2. Choose Operation
  3. Operation Details
  4. Confirmation

Step 1 of 4: Choose Issues

Cancel

T Patch Info Key Summary Assignee Reporter P Status Resolution Created Updated Due Development
Sub-task HADOOP-16860

HADOOP-15619 Prune -tombstones to remove children entries

Gabor Bota Gabor Bota Major Resolved Invalid  
Sub-task HADOOP-16697

HADOOP-15619 audit/tune s3a authoritative flag in s3guard DDB Table

Steve Loughran Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16684

HADOOP-15619 s3guard bucket info to list a bit more about authoritative paths

Steve Loughran Steve Loughran Minor Resolved Duplicate  
Sub-task HADOOP-16642

HADOOP-15619 ITestDynamoDBMetadataStoreScale fails when throttled.

Steve Loughran Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16576

HADOOP-15619 ITestS3GuardDDBRootOperations. test_100_FilesystemPrune failure

Steve Loughran Steve Loughran Major Resolved Duplicate  
Sub-task HADOOP-16565

HADOOP-15619 Region must be provided when requesting session credentials or SdkClientException will be thrown

Gabor Bota Gabor Bota Major Resolved Fixed  
Sub-task HADOOP-16547

HADOOP-15619 s3guard prune command doesn't get AWS auth chain from FS

Steve Loughran Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16520

HADOOP-15619 Race condition in DDB table init and waiting threads

Gabor Bota Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16501

HADOOP-15619 s3guard auth path checks only check against unqualified source path

Steve Loughran Steve Loughran Minor Resolved Duplicate  
Sub-task HADOOP-16490

HADOOP-15619 Avoid/handle cached 404s during S3A file creation

Steve Loughran Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16489

HADOOP-15619 S3Guard operations log has tombstone/PUT swapped

Steve Loughran Steve Loughran Minor Resolved Duplicate  
Sub-task HADOOP-16484

HADOOP-15619 S3A to warn or fail if S3Guard is disabled

Gabor Bota Steve Loughran Minor Resolved Fixed  
Sub-task HADOOP-16481

HADOOP-15619 ITestS3GuardDDBRootOperations.test_300_MetastorePrune needs to set region

Steve Loughran Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16474

HADOOP-15619 S3Guard ProgressiveRenameTracker to mark dest dir as authoritative on success

Steve Loughran Steve Loughran Major Resolved Duplicate  
Sub-task HADOOP-16472

HADOOP-15619 findbugs warning on LocalMetadataStore.ttlTimeProvider sync

Steve Loughran Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16464

HADOOP-15619 S3Guard in auth mode doesn't raise AccessDeniedException on read of 0-byte file

Unassigned Steve Loughran Minor Resolved Won't Fix  
Sub-task HADOOP-16433

HADOOP-15619 S3Guard: Filter expired entries and tombstones when listing with MetadataStore#listChildren

Gabor Bota Gabor Bota Blocker Resolved Fixed  
Sub-task HADOOP-16430

HADOOP-15619 S3AFilesystem.delete to incrementally update s3guard with deletions

Steve Loughran Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16429

HADOOP-15619 DynamoDBMetaStore deleteSubtree to delete leaf nodes first

Unassigned Steve Loughran Major Resolved Done  
Sub-task HADOOP-16421

HADOOP-15619 ITestS3GuardOutOfBandOperations.deleteAfterTombstoneExpiryOobCreate failure

Unassigned Steve Loughran Minor Resolved Cannot Reproduce  
Sub-task HADOOP-16419

HADOOP-15619 Transient failure of ITestS3ARemoteFileChanged

Unassigned Steve Loughran Minor Resolved Cannot Reproduce  
Sub-task HADOOP-16416

HADOOP-15619 mark DynamoDBMetadataStore.deleteTrackingValueMap as final

Kevin Su Steve Loughran Trivial Resolved Fixed  
Sub-task HADOOP-16406

HADOOP-15619 ITestDynamoDBMetadataStore.testProvisionTable times out intermittently

Steve Loughran Steve Loughran Minor Resolved Fixed  
Sub-task HADOOP-16397

HADOOP-15619 Hadoop S3Guard Prune command to support a -tombstone option.

Steve Loughran Steve Loughran Minor Resolved Fixed  
Sub-task HADOOP-16392

HADOOP-15619 S3Guard Diff tool to list+ compare the etag and version fields

Unassigned Steve Loughran Minor Resolved Duplicate  
Sub-task HADOOP-16384

HADOOP-15619 S3A: Avoid inconsistencies between DDB and S3

Steve Loughran Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16383

HADOOP-15619 Pass ITtlTimeProvider instance in initialize method in MetadataStore interface

Gabor Bota Gabor Bota Major Resolved Fixed  
Sub-task HADOOP-16380

HADOOP-15619 S3A tombstones can confuse empty directory status

Steve Loughran Steve Loughran Blocker Resolved Fixed  
Sub-task HADOOP-16375

HADOOP-15619 ITestS3AMetadataPersistenceException failure

Unassigned Steve Loughran Minor Resolved Cannot Reproduce  
Sub-task HADOOP-16368

HADOOP-15619 S3A list operation doesn't pick up etags from results

Steve Loughran Steve Loughran Minor Resolved Fixed  
Sub-task HADOOP-16364

HADOOP-15619 S3Guard table destroy to map IllegalArgumentExceptions to IOEs

Steve Loughran Steve Loughran Minor Resolved Fixed  
Sub-task HADOOP-16363

HADOOP-15619 S3Guard DDB store prune() doesn't translate AWS exceptions to IOEs

Steve Loughran Steve Loughran Minor Resolved Fixed  
Sub-task HADOOP-16349

HADOOP-15619 DynamoDBMetadataStore.getVersionMarkerItem() to log at info/warn on retry

Gabor Bota Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16329

HADOOP-15619 "Wrong Billing mode" test failure in ITestS3GuardToolDynamoDB

Steve Loughran Steve Loughran Minor Resolved Duplicate  
Sub-task HADOOP-16326

HADOOP-15619 S3Guard: Remove LocalMetadataStore

Unassigned Gabor Bota Minor Resolved Won't Fix  
Sub-task HADOOP-16280

HADOOP-15619 S3Guard: Retry failed read with backoff in Authoritative mode when file can be opened

Steve Loughran Gabor Bota Major Resolved Duplicate  
Sub-task HADOOP-16279

HADOOP-15619 S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

Gabor Bota Gabor Bota Major Resolved Fixed  
Sub-task HADOOP-16274

HADOOP-15619 transient failure of ITestS3GuardToolDynamoDB.testDestroyUnknownTable

Unassigned Steve Loughran Minor Resolved Cannot Reproduce  
Sub-task HADOOP-16252

HADOOP-15619 Use configurable dynamo table name prefix in S3Guard tests

Ben Roling Ben Roling Major Resolved Fixed  
Sub-task HADOOP-16250

HADOOP-15619 Add a way to declare a toplevel path in a non-auth FS as auth

Sean Mackrory Steve Loughran Minor Resolved Duplicate  
Sub-task HADOOP-16221

HADOOP-15619 S3Guard: fail write that doesn't update metadata store

Ben Roling Ben Roling Major Resolved Fixed  
Sub-task HADOOP-16187

HADOOP-15619 ITestS3GuardToolDynamoDB test failures

Steve Loughran Steve Loughran Major Resolved Duplicate  
Sub-task HADOOP-16186

HADOOP-15619 S3Guard: NPE in DynamoDBMetadataStore.lambda$listChildren

Gabor Bota Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16184

HADOOP-15619 S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

Gabor Bota Gabor Bota Major Resolved Fixed  
Sub-task HADOOP-16118

HADOOP-15619 S3Guard to support on-demand DDB tables

Steve Loughran Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-16085

HADOOP-15619 S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite

Ben Roling Ben Roling Major Resolved Fixed  
Sub-task HADOOP-16057

HADOOP-15619 IndexOutOfBoundsException in ITestS3GuardToolLocal

Adam Antal Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-15999

HADOOP-15619 S3Guard: Better support for out-of-band operations

Gabor Bota Sean Mackrory Major Resolved Fixed  
Sub-task HADOOP-15988

HADOOP-15619 Should be able to set empty directory flag to TRUE in DynamoDBMetadataStore#innerGet when using authoritative directory listings

Gabor Bota Gabor Bota Major Resolved Fixed  
Sub-task HADOOP-15987

HADOOP-15619 ITestDynamoDBMetadataStore should check if test ddb table set properly before initializing the test

Gabor Bota Gabor Bota Major Resolved Fixed  
Sub-task HADOOP-15888

HADOOP-15619 ITestDynamoDBMetadataStore can leak (large) DDB tables in test failures/timeout

Steve Loughran Steve Loughran Major Resolved Duplicate  
Sub-task HADOOP-15847

HADOOP-15619 S3Guard testConcurrentTableCreations to set r & w capacity == 0

lqjacklee Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-15845

HADOOP-15619 s3guard init and destroy command will create/destroy tables if ddb.table & region are set

Gabor Bota Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-15843

HADOOP-15619 s3guard bucket-info command to not print a stack trace on bucket-not-found

Adam Antal Steve Loughran Minor Resolved Fixed  
Sub-task HADOOP-15837

HADOOP-15619 DynamoDB table Update can fail S3A FS init

Steve Loughran Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-15833

HADOOP-15619 Intermittent failures of some S3A tests with S3Guard in parallel test runs

Unassigned Steve Loughran Minor Resolved Cannot Reproduce  
Sub-task HADOOP-15827

HADOOP-15619 NPE in DynamoDBMetadataStore.lambda$listChildren for root + auth S3Guard

Gabor Bota Steve Loughran Blocker Resolved Fixed  
Sub-task HADOOP-15800

HADOOP-15619 ITestS3GuardListConsistency#testConsistentListAfterDelete fails when running with dynamo

Unassigned Gabor Bota Major Resolved Cannot Reproduce  
Sub-task HADOOP-15799

HADOOP-15619 ITestS3AEmptyDirectory#testDirectoryBecomesEmpty fails when running with dynamo

Gabor Bota Gabor Bota Major Resolved Cannot Reproduce  
Sub-task HADOOP-15798

HADOOP-15619 LocalMetadataStore put() does not retain isDeleted in parent listing

Gabor Bota Gabor Bota Major Resolved Fixed  
Sub-task HADOOP-15796

HADOOP-15619 ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled

Gabor Bota Gabor Bota Major Resolved Cannot Reproduce  
Sub-task HADOOP-15780

HADOOP-15619 S3Guard: document how to deal with non-S3Guard processes writing data to S3Guarded buckets

Gabor Bota Aaron Fabbri Major Resolved Fixed  
Sub-task HADOOP-15709

HADOOP-15619 Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants

Gabor Bota Gabor Bota Minor Resolved Fixed  
Sub-task HADOOP-15635

HADOOP-15619 s3guard set-capacity command to fail fast if bucket is unguarded

Gabor Bota Steve Loughran Minor Resolved Fixed  
Sub-task HADOOP-15621

HADOOP-15619 S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

Gabor Bota Aaron Fabbri Major Resolved Fixed  
Sub-task HADOOP-15573

HADOOP-15619 s3guard set-capacity to not retry on an access denied exception

Steve Loughran Steve Loughran Minor Resolved Duplicate  
Sub-task HADOOP-15563

HADOOP-15619 S3Guard to support creating on-demand DDB tables

Steve Loughran Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-15430

HADOOP-15619 hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

Steve Loughran Steve Loughran Minor Resolved Fixed  
Sub-task HADOOP-15428

HADOOP-15619 s3guard bucket-info will create s3guard table if FS is set to do this automatically

Gabor Bota Steve Loughran Major Resolved Fixed  
Sub-task HADOOP-15193

HADOOP-15619 add bulk delete call to metastore API & DDB impl

Unassigned Steve Loughran Major Resolved Won't Fix  
Sub-task HADOOP-15183

HADOOP-15619 S3Guard store becomes inconsistent after partial failure of rename

Steve Loughran Steve Loughran Blocker Resolved Fixed  
Sub-task HADOOP-14936

HADOOP-15619 S3Guard: remove "experimental" from documentation

Gabor Bota Aaron Fabbri Major Resolved Fixed  
Sub-task HADOOP-14927

HADOOP-15619 ITestS3GuardTool failures in testDestroyNoBucket()

Gabor Bota Aaron Fabbri Minor Resolved Fixed  
Sub-task HADOOP-14757

HADOOP-15619 S3AFileSystem.innerRename() to size metadatastore lists better

Unassigned Steve Loughran Minor Resolved Won't Fix  
Sub-task HADOOP-14576

HADOOP-15619 s3guard DynamoDB resource not found: tables not ACTIVE state after initial connection

Unassigned Sean Mackrory Major Resolved Duplicate  
Sub-task HADOOP-14468

HADOOP-15619 S3Guard: make short-circuit getFileStatus() configurable

Gabor Bota Aaron Fabbri Minor Resolved Fixed  
Sub-task HADOOP-13936

HADOOP-15619 S3Guard: DynamoDB can go out of sync with S3AFileSystem.delete()

Steve Loughran Rajesh Balamohan Blocker Resolved Duplicate  
Sub-task HADOOP-13843

HADOOP-15619 S3Guard, MetadataStore to support atomic create(path, overwrite=false)

Unassigned Steve Loughran Major Resolved Won't Fix  
Sub-task HADOOP-13454

HADOOP-15619 S3Guard: Provide custom FileSystem Statistics.

Unassigned Chris Nauroth Major Resolved Done  

Cancel