[HBASE-20686] Asyncfs should retry upon RetryStartFileException

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: asyncclient

Environment

HBase 2.0, Hadoop 3 with at-rest encryption

• Assignee: Unassigned
• Reporter: Wei-Chiu Chuang
• Created: 05/Jun/18 16:40
• Updated: 15/Jun/22 00:27

Description

In Hadoop-2.6 and above, HDFS client retries on RetryStartFileException when NameNode experience encryption zone related issue. The code exists in DFSOutputStream#newStreamForCreate(). (HDFS-6970)

In HBase-2's asyncfs implementation, FanOutOneBlockAsyncDFSOutputHelper#createOutput() is somewhat an imitation of HDFS's DFSOutputStream#newStreamForCreate(). However it does not retry upon RetryStartFileException. So it is less resilient to such issues.

Also, DFSOutputStream#newStreamForCreate() upwraps RemoteExceptions, but asyncfs does not. Therefore, hbase gets different exceptions than before.

File this jira to get this corrected.