[HADOOP-17784] hadoop-aws landsat-pds test bucket will be deleted after Jul 1, 2021

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: fs/s3, test
• Assignee: Unassigned
• Reporter: Leona Yoda
• Created: 01/Jul/21 04:55
• Updated: 30/Jan/24 20:00
• Resolved: 30/Jan/24 20:00

Description

I found an anouncement that landsat-pds buket will be deleted on July 1, 2021

(https://registry.opendata.aws/landsat-8/)

and  I think this bucket  is used in th test of hadoop-aws module use

https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/S3ATestConstants.java#L93

 

At this time I can access the bucket but we might have to change the test bucket in someday.

Issue Links

• causes: HADOOP-18168 ITestMarkerTool.testRunLimitedLandsatAudit failing due to most of bucket content purged
• is fixed by: HADOOP-19057 S3 public test bucket landsat-pds unreadable -needs replacement
• is related to: SPARK-36024 Switch the datasource example due to the depreciation of the dataset