[HADOOP-18168] ITestMarkerTool.testRunLimitedLandsatAudit failing due to most of bucket content purged

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.5
• Fix Version/s: 3.3.5
• Component/s: fs/s3, test
• Labels: pull-request-available
• Assignee: Daniel Carl Jones
• Reporter: Steve Loughran
• Created: 22/Mar/22 13:43
• Updated: 03/May/22 13:57
• Resolved: 03/May/22 13:56

Description

ITestMarkerTool.testRunLimitedLandsatAudit is failing -a scan which was meant to stop after the first page of results is finishing because there aren't so many objects there.

first visible sign of the landsat-pds cleanup

now we have requester pays, we could do this against another store with stability promises, e.g common crawl.

This test failure is fixed in branch-3.3 and trunk: don't worry about the test failing in earlier releases

Issue Links

• is caused by: HADOOP-17784 hadoop-aws landsat-pds test bucket will be deleted after Jul 1, 2021
• relates to: HADOOP-18194 Public dataset class for S3A integration tests
• links to: GitHub Pull Request #4140