Joda-time has problems with formatting time zones starting with Java 1.8u60, and this will cause s3 request to fail. It is said to have been fixed at joda-time 2.8.1.
Spark is still using joda-time 2.5 by fault, if java8 is used to build spark, should set -Djoda.version=2.8.1 or above.
I was hit by this problem, and -Djoda.version=2.9 worked.
I don't see any reason not to bump up joda-time version in pom.xml
Should I create a pull request for this? It is trivial.