[FLINK-12115] Add support in Flink to persist state in Azure's blob store

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Done
• Fix Version/s: 1.9.0
• Component/s: FileSystems
• Labels: pull-request-available
• Assignee: Piyush Narang
• Reporter: Piyush Narang
• Created: 04/Apr/19 20:15
• Updated: 31/May/19 08:16
• Resolved: 28/May/19 15:27

Description

The existing set of flink-filesystems include filesystems like S3 / HDFS / MapR etc. For folks using Azure, it would be nice to include support for Azure's blob store as a filesystem as well. This would enable us to use Azure blob store to store state / checkpoints for running Flink jobs.
Support for Azure's filesystem is part of the hadoop project in the hadoop-azure module.

Issue Links

• causes: FLINK-12689 flink-dist is missing flink-azure-fs-hadoop dependency
• relates to: FLINK-12654 Enable Azure FS E2E tests on AzureCI
• links to: GitHub Pull Request #8117
• links to: GitHub Pull Request #8135
• links to: GitHub Pull Request #8537