Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-43380

Fix Avro data type conversion issues to avoid producing incorrect results

    XMLWordPrintableJSON

Details

    Description

      We found the following issues with open-source Avro:

      • Interval types can be read as date or timestamp types that would lead to wildly different results
      • Decimal types can be read with lower precision, that leads to data being read as¬†null¬†instead of suggesting that a wider decimal format should be provided

      Attachments

        Activity

          People

            zeruibao Zerui Bao
            zeruibao Zerui Bao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: