[HADOOP-19189] ITestS3ACommitterFactory failing

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.5.0, 3.4.1
• Component/s: fs/s3, test
• Labels: pull-request-available
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 31/May/24 13:22
• Updated: 10/Sep/24 18:26
• Resolved: 10/Sep/24 18:26

Description

we've had ITestS3ACommitterFactory failing for a while, where it looks like changed committer settings aren't being picked up.

ERROR] ITestS3ACommitterFactory.testEverything:115->testInvalidFileBinding:165 Expected a org.apache.hadoop.fs.s3a.commit.PathCommitException to be thrown, but got the result: : FileOutputCommitter{PathOutputCommitter{context=TaskAttemptContextImpl{JobContextImpl

I've spent some time looking at it and it is happening because the test sets the fileystem ref for the local test fs, and not that of the filesystem created by the committer, which is where the option is picked up.

i've tried to parameterize it but things are still playing up and I'm not sure how hard to try to fix.

Issue Links

• links to: GitHub Pull Request #6857