[HADOOP-17483] magic committer to be enabled for all S3 buckets

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.1
• Component/s: fs/s3
• Labels: pull-request-available
• Target Version/s: 3.3.1
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 21/Jan/21 10:36
• Updated: 19/Feb/21 16:36
• Resolved: 27/Jan/21 19:07

Description

• core-default.xml updated so that fs.s3a.committer.magic.enabled = true
• CommitConstants updated to match
• All tests which previously enabled the magic committer now rely on
  default settings. This helps make sure it is enabled.
• Docs cover the switch, mention its enabled and explain why you may
  want to disable it.
  Note: this doesn't switch to using the committer -it just enables the path
  rewriting magic which it depends on.

Issue Links

• is duplicated by: HADOOP-17406 enable s3a magic committer by default
• links to: GitHub Pull Request #2637
• links to: GitHub Pull Request #2656