Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14787

Upgrade Joda-Time library from 2.9 to 2.9.3

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 2.0.0
    • 1.6.2, 2.0.0
    • SQL
    • None

    Description

      Currently, Spark uses joda-time library version 2.9.

      This might have to be upgraded to 2.9.3 because it fixes some minor bugs as below:

      Changes in 2.9.3
      ----------------

      • DateTimeZone data updated to version 2016c
      • Make DateTimeUtils.SYSTEM_MILLIS_PROVIDER public 357
      • Fix bug when adding months at the maximum limits of integer 361
      • Add Turkish period translations 364

      Changes in 2.9.2
      ----------------

      • DateTimeZone data updated to version 2016a (version 2.9 had time-zone data 2015g)
      • Fix bug in time-zone binary search 332
      • Better document behaviour 325

      Changes in 2.9.1
      ----------------

      • Fix bug introduced by Long.MIN_VALUE and Long.MAX_VALUE changes 328

      For Spark, there can be some issues by bugs below:

      1. Fix bug introduced by Long.MIN_VALUE and Long.MAX_VALUE changes

      DateTime minDT = new DateTime(Long.MIN_VALUE);
      

      2. Fix bug in time-zone binary search

      It looks there is a bug for parsing time-zone. It looks a binary search is introduced for parsing time-zone but there is a bug. So, If Spark tries to parse some timezones, this could be possibly an issue.

      3.Fix bug when adding months at the maximum limits of integer

      It looks it throws an exception, ArrayIndexOutOfBoundsException, the codes below:

      DateTime dateTime = new DateTime(1455993437373l);
      DateTime date = dateTime.plusMonths(2147483647);
      

      Attachments

        Activity

          People

            gurwls223 Hyukjin Kwon
            gurwls223 Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: