[HDFS-16090] Fine grained locking for datanodeNetworkCounts

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.3.2
• Fix Version/s: 3.4.0, 3.3.2
• Component/s: datanode
• Labels: pull-request-available
• Target Version/s: 3.4.0, 3.2.3, 3.3.2
• Hadoop Flags: Reviewed
• Assignee: Viraj Jasani
• Reporter: Viraj Jasani
• Created: 26/Jun/21 17:01
• Updated: 27/Jan/24 02:43
• Resolved: 30/Jun/21 20:11

Description

While incrementing DataNode network error count, we lock entire LoadingCache in order to increment network count of specific host. We should provide fine grained concurrency for this update because locking entire cache is redundant and could impact performance while incrementing network count for multiple hosts.

Issue Links

• links to: GitHub Pull Request #3148