[HBASE-8449] Refactor recoverLease retries and pauses informed by findings over in hbase-8389

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.94.7, 0.95.0
• Fix Version/s: 0.98.0, 0.95.1
• Component/s: Filesystem Integration
• Hadoop Flags: Reviewed
• Assignee: Michael Stack
• Reporter: Michael Stack
• Created: 26/Apr/13 22:07
• Updated: 23/Sep/13 19:08
• Resolved: 24/May/13 16:20

Description

HBASE-8359 is an interesting issue that roams near and far. This issue is about making use of the findings handily summarized on the end of hbase-8359 which have it that trunk needs refactor around how it does its recoverLease handling (and that the patch committed against HBASE-8359 is not what we want going forward).

This issue is about making a patch that adds a lag between recoverLease invocations where the lag is related to dfs timeouts – the hdfs-side dfs timeout – and optionally makes use of the isFileClosed API if it is available (a facility that is not yet committed to a branch near you and unlikely to be within your locality with a good while to come).

Issue Links

• is related to: HBASE-8389 HBASE-8354 forces Namenode into loop with lease recovery requests
• is related to: HBASE-8670 [0.94] Backport HBASE-8449,HBASE-8204 and HBASE-8699 to 0.94 (Refactor recoverLease retries and pauses)
• is related to: HBASE-8485 Retry to open a HLog on more exceptions
• relates to: HBASE-8394 Utilize isFileClosed() so that the wait for lease recovery can be optimized