Description
Currently, Spark uses joda-time library version 2.9.
This might have to be upgraded to 2.9.3 because it fixes some minor bugs as below:
Changes in 2.9.3
----------------
- DateTimeZone data updated to version 2016c
- Make DateTimeUtils.SYSTEM_MILLIS_PROVIDER public 357
- Fix bug when adding months at the maximum limits of integer 361
- Add Turkish period translations 364
Changes in 2.9.2
----------------
- DateTimeZone data updated to version 2016a (version 2.9 had time-zone data 2015g)
- Fix bug in time-zone binary search 332
- Minor fixes to code internals 339, #326, #344, #350, #343
- Better document behaviour 325
Changes in 2.9.1
----------------
- Fix bug introduced by Long.MIN_VALUE and Long.MAX_VALUE changes 328
For Spark, there can be some issues by bugs below:
1. Fix bug introduced by Long.MIN_VALUE and Long.MAX_VALUE changes
DateTime minDT = new DateTime(Long.MIN_VALUE);
2. Fix bug in time-zone binary search
It looks there is a bug for parsing time-zone. It looks a binary search is introduced for parsing time-zone but there is a bug. So, If Spark tries to parse some timezones, this could be possibly an issue.
3.Fix bug when adding months at the maximum limits of integer
It looks it throws an exception, ArrayIndexOutOfBoundsException, the codes below:
DateTime dateTime = new DateTime(1455993437373l);
DateTime date = dateTime.plusMonths(2147483647);