[HDFS-4495] Allow client-side lease renewal to be retried beyond soft-limit

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.3-alpha, 0.23.5
• Fix Version/s: 0.23.7, 2.1.0-beta
• Component/s: hdfs-client
• Assignee: Kihwal Lee
• Reporter: Kihwal Lee
• Created: 13/Feb/13 03:48
• Updated: 27/Aug/13 22:07
• Resolved: 13/Feb/13 23:04

Description

The current lease renewal code in DFSClient gives up after several retries, if the soft limit exceeds. This causes the client to abort. Without this self destruction behavior, lease renewal can be retried infinitely due to unrelated low-level issue and prevent DFSClient and associated Connection from getting garbage collected.

However, giving up at passage of the soft limit has been shown to be too fragile; A long GC on namenode or transient network outage can make clients fail. We need the self-destruct behavior, but clients should be allowed to retry for longer period of time.