[HDFS-8270] create() always retried with hardcoded timeout when file already exists with open lease

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.6.0
• Fix Version/s: 2.6.1, 2.8.0, 2.7.1, 3.0.0-alpha1
• Component/s: hdfs-client
• Labels: 2.6.1-candidate
• Hadoop Flags: Reviewed
• Release Note: Proxy level retries will not be done on AlreadyBeingCreatedExeption for create() op.
• Assignee: J.Andreina
• Reporter: Andrey Stepachev
• Created: 27/Apr/15 18:39
• Updated: 06/Jan/17 01:20
• Resolved: 03/Jun/15 06:58

Description

In Hbase we stumbled on unexpected behaviour, which could
break things.
HDFS-6478 fixed wrong exception
translation, but that apparently led to unexpected bahaviour:
clients trying to create file without override=true will be forced
to retry hardcoded amount of time (60 seconds).
That could break or slowdown systems, that use filesystem
for locks (like hbase fsck did, and we got it broken HBASE-13574).

We should make this behaviour configurable, do client really need
to wait lease timeout to be sure that file doesn't exists, or it it should
be enough to fail fast.

Issue Links

• blocks: HBASE-13574 Broken TestHBaseFsck in master with hadoop 2.6.0
• relates to: HDFS-8403 Eliminate retries in TestFileCreation#testOverwriteOpenForWrite