[SPARK-11413] Java 8 build has problem with joda-time and s3 request, should bump joda-time version

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: Build
• Assignee: Yongjia Wang
• Reporter: Yongjia Wang
• Created: 30/Oct/15 01:15
• Updated: 19/Jan/19 17:10
• Resolved: 02/Nov/15 08:59

Description

Joda-time has problems with formatting time zones starting with Java 1.8u60, and this will cause s3 request to fail. It is said to have been fixed at joda-time 2.8.1.
Spark is still using joda-time 2.5 by fault, if java8 is used to build spark, should set -Djoda.version=2.8.1 or above.
I was hit by this problem, and -Djoda.version=2.9 worked.
I don't see any reason not to bump up joda-time version in pom.xml
Should I create a pull request for this? It is trivial.

https://github.com/aws/aws-sdk-java/issues/484
https://github.com/aws/aws-sdk-java/issues/444
http://stackoverflow.com/questions/32058431/aws-java-sdk-aws-authentication-requires-a-valid-date-or-x-amz-date-header

Issue Links

• is related to: HADOOP-16055 Upgrade AWS SDK to 1.11.271 in branch-2
• relates to: HADOOP-13050 Upgrade to AWS SDK 1.11.45
• relates to: SPARK-7481 Add spark-hadoop-cloud module to pull in object store support
• links to: [Github] Pull Request #9379 (yongjiaw)