[HDFS-16163] Avoid locking entire blockPinningFailures map

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: balancer
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Viraj Jasani
• Reporter: Viraj Jasani
• Created: 11/Aug/21 13:07
• Updated: 11/Feb/24 09:20
• Resolved: 16/Aug/21 05:41

Description

In order for mover to exclude pinned blocks in subsequent iteration, we try to put pinned blocks in a map of blockIds to set of Datanode sources. However, while updating an entry of this map, we don't need to lock the entire map. We can use fine-grained concurrency here.

Issue Links

• links to: GitHub Pull Request #3296
• links to: https://github.com/apache/hadoop/pull/3296