[HADOOP-17228] Backport HADOOP-13230 listing changes for preserved directory markers to 3.1.x

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.4
• Fix Version/s: 3.1.5
• Component/s: fs/s3
• Release Note: This release of Hadoop 3.1 can safely interact with S3 Buckets where directory markers are not deleted as and when files and directories are created underneath
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 25/Aug/20 21:57
• Updated: 03/Sep/20 12:30
• Resolved: 03/Sep/20 12:30

Description

Backport a small subset of HADOOP-17199 to branch-3.1

No path capabities, declarative test syntax etc

just

-getFileStatus/list
-markers changes to bucket-info
-startup info message if option is set
-relevant test changes

Issue Links

• relates to: HADOOP-13230 S3A to optionally retain directory markers
• relates to: HADOOP-17199 Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers