[HADOOP-18162] hadoop-common enhancements for the Manifest Committer of MAPREDUCE-7341

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.5
• Fix Version/s: 3.3.5
• Component/s: fs
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 16/Mar/22 14:47
• Updated: 17/Mar/22 11:51
• Resolved: 17/Mar/22 11:51

Description

Make the necessary changes to hadoop-common to support the manifest committer of
MAPREDUCE-7341j

• new stats names in StoreStatisticNames (for joint use with s3a committers)
• improvements to IOStatistics
• s3a committer task pool to move over as ThreadPool

this does not break s3a committer as they will only adopt these changes in HADOOP-17833

Issue Links

• is part of: MAPREDUCE-7341 Add a task-manifest output committer for Azure and GCS
• relates to: HADOOP-17833 Improve Magic Committer Performance