Documentation declares that pyarrow can work in this way:
from pyarrow import fs s3 = fs.S3FileSystem(region='eu-west-3')
Follow link to documentation: https://arrow.apache.org/docs/python/filesystems.html#example
After installing pyarrow with this command:
pipenv install pyarrow==0.17.0
And when trying to run a simple python application: https://github.com/gumartinm/MLForFun/tree/master/playground
Application ends up with the following error:
AttributeError: module 'pyarrow.fs' has no attribute 'S3FileSystem'
This line is failing https://github.com/apache/arrow/blob/apache-arrow-0.17.0/python/pyarrow/fs.py#L42 because pyarrow._s3fs does not exist.
- links to