[HADOOP-18925] S3A: add option "fs.s3a.optimized.copy.from.local.enabled" to enable/disable CopyFromLocalOperation

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.6
• Fix Version/s: 3.4.0, 3.3.9
• Component/s: fs/s3
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 09/Oct/23 10:50
• Updated: 30/Mar/24 17:38
• Resolved: 07/Dec/23 14:42

Description

reported failure of CopyFromLocalOperation.getFinalPath() during job submission with s3a declared as cluster fs.

add an emergency option to disable this optimised uploader and revert to the superclass implementation

Issue Links

• is related to: HADOOP-18173 S3a copyFromLocalOperation doesn't support single file
• links to: GitHub Pull Request #6163
• links to: GitHub Pull Request #6259