[HDFS-16283] RBF: improve renewLease() to call only a specific NameNode rather than make fan-out calls

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.4.0
• Component/s: rbf
• Labels: pull-request-available
• Hadoop Flags: Reviewed
• Assignee: ZanderXu
• Reporter: Aihua Xu
• Created: 25/Oct/21 23:04
• Updated: 18/Jul/24 08:29
• Resolved: 14/Jul/22 01:57

Description

Currently renewLease() against a router will make fan-out to all the NameNodes. Since renewLease() call is so frequent and if one of the NameNodes are slow, then eventually the router queues are blocked by all renewLease() and cause router degradation.

We will make a change in the client side to keep track of NameNode Id in additional to current fileId so routers understand which NameNodes the client is renewing lease against.

Issue Links

• links to: GitHub Pull Request #3595
• links to: GitHub Pull Request #4524