[HADOOP-19140] [ABFS, S3A] Add IORateLimiter api to hadoop common

• Type: Sub-task
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.4.0
• Component/s: fs, fs/azure, fs/s3
• Labels: pull-request-available
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 03/Apr/24 15:53
• Updated: 04/Sep/24 10:06

Description

Create a rate limiter API in hadoop common which code (initially, manifest committer, bulk delete).. can request iO capacity for a specific operation.

this can be exported by filesystems so support shared rate limiting across all threads

pulled from HADOOP-19093 PR

Issue Links

• links to: GitHub Pull Request #6703