Currently We don't run S3 integration tests regularly.
- mock it within python/pytest
- simply run the s3 tests with an S3 credential provided
- create a hdfs-integration like docker-compose setup and run an S3 mock server (e.g.: https://github.com/adobe/S3Mock, https://github.com/jubos/fake-s3, https://github.com/gaul/s3proxy, https://github.com/jserver/mock-s3)
For more see discussion https://github.com/apache/arrow/pull/3286