Documentation declares that pyarrow can work in this way:
Follow link to documentation: https://arrow.apache.org/docs/python/filesystems.html#example
After installing pyarrow with this command:
And when trying to run a simple python application: https://github.com/gumartinm/MLForFun/tree/master/playground
Application ends up with the following error:
This line is failing https://github.com/apache/arrow/blob/apache-arrow-0.17.0/python/pyarrow/fs.py#L42 because pyarrow._s3fs does not exist.