Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-4190 Add Spark 3.1.1 support in carbondata
  3. CARBONDATA-4247

Add fix for timestamp issue induced due to Spark3.0 changes

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.2.0
    • None
    • None

    Description

      Add fix for timestamp issue induced due to Spark3.0 changes

       

      With spark 3.1, timestamp values loaded before 1900 years gives wrong results

       

      Refer https://github.com/apache/carbondata/blob/master/integration/spark/src/test/scala/org/apache/carbondata/spark/testsuite/directdictionary/TimestampNoDictionaryColumnTestCase.scala

      Attachments

        Activity

          People

            Indhumathi27 Indhumathi Muthumurugesh
            vikramahuja_ Vikram Ahuja
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 8.5h
                8.5h