[HADOOP-16848] add initial S3A layering + async init

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.3.0
• Component/s: fs/s3
• Labels: pull-request-available
• Target Version/s: 3.5.0
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 09/Feb/20 15:38
• Updated: 04/Jan/24 12:49

Description

Split the S3A code into layers

• S3AFileSystem
• S3AStore + Impl
• RawS3A + Impl

S3AFS will create the others and start in order: DelegationTokens, RawS3A, S3AStore, Metastore

this will involve wrapping all access of DTs, s3client, Metastore to block until that layer is complete, or raise an exception if instantiation of it/predecessor failed.

New layers will all be subclasses of Service, split into Interface and Impl, so we can manage the init/start/stop lifecycle with existing code

Issue Links

• links to: GitHub Pull Request #1834
• links to: GitHub Pull Request #1839