[HADOOP-16182] Update abfs storage back-end with "close" flag when application is done writing to a file

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.3.0
• Component/s: fs/azure
• Target Version/s: 3.3.0
• Assignee: Vishwajeet Dusane
• Reporter: Vishwajeet Dusane
• Created: 13/Mar/19 06:01
• Updated: 07/Jun/19 14:12
• Resolved: 18/Mar/19 13:16

Description

As part of Azure Data Lake Storage Gen2 notifications design, customers are interested in knowing when a client is done writing to a file so they can take certain actions like initiate a pipeline, or replicate a file, or start certain processing. To satisfy that, ABFS client should send "close" flag during Flush rest API when invoked by OutputStream::close() API.

Issue Links

• is related to: HADOOP-16353 Backport ABFS changes from trunk to branch-3.2