Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14787

Upgrade Joda-Time library from 2.9 to 2.9.3

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 1.6.2, 2.0.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Currently, Spark uses joda-time library version 2.9.

      This might have to be upgraded to 2.9.3 because it fixes some minor bugs as below:

      Changes in 2.9.3
      ----------------

      • DateTimeZone data updated to version 2016c
      • Make DateTimeUtils.SYSTEM_MILLIS_PROVIDER public 357
      • Fix bug when adding months at the maximum limits of integer 361
      • Add Turkish period translations 364

      Changes in 2.9.2
      ----------------

      • DateTimeZone data updated to version 2016a (version 2.9 had time-zone data 2015g)
      • Fix bug in time-zone binary search 332
      • Better document behaviour 325

      Changes in 2.9.1
      ----------------

      • Fix bug introduced by Long.MIN_VALUE and Long.MAX_VALUE changes 328

      For Spark, there can be some issues by bugs below:

      1. Fix bug introduced by Long.MIN_VALUE and Long.MAX_VALUE changes

      DateTime minDT = new DateTime(Long.MIN_VALUE);
      

      2. Fix bug in time-zone binary search

      It looks there is a bug for parsing time-zone. It looks a binary search is introduced for parsing time-zone but there is a bug. So, If Spark tries to parse some timezones, this could be possibly an issue.

      3.Fix bug when adding months at the maximum limits of integer

      It looks it throws an exception, ArrayIndexOutOfBoundsException, the codes below:

      DateTime dateTime = new DateTime(1455993437373l);
      DateTime date = dateTime.plusMonths(2147483647);
      

        Attachments

          Activity

            People

            • Assignee:
              hyukjin.kwon Hyukjin Kwon
              Reporter:
              hyukjin.kwon Hyukjin Kwon
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: