[HADOOP-12635] Adding Append API support for WASB

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.1
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: fs/azure
• Target Version/s: 2.8.0
• Hadoop Flags: Reviewed

Release Note

The Azure Blob Storage file system (WASB) now includes optional support for use of the append API by a single writer on a path. Please note that the implementation differs from the semantics of HDFS append. HDFS append internally guarantees that only a single writer may append to a path at a given time. WASB does not enforce this guarantee internally. Instead, the application must enforce access by a single writer, such as by running single-threaded or relying on some external locking mechanism to coordinate concurrent processes. Refer to the Azure Blob Storage documentation page for more details on enabling append in configuration.

• Assignee: Dushyanth
• Reporter: Dushyanth
• Created: 11/Dec/15 02:42
• Updated: 03/Jan/17 11:15
• Resolved: 18/Jan/16 17:22

Description

Currently the WASB implementation of the HDFS interface does not support Append API. This JIRA is added to design and implement the Append API support to WASB. The intended support for Append would only support a single writer.

Issue Links

• relates to: HADOOP-13181 WASB append support: getPos incorrect