Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13530

Add ShortType support to UnsafeRowParquetRecordReader

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • SQL
    • None

    Description

      By enabling vectorized parquet scanner by default, the unit test ParquetHadoopFsRelationSuite based on HadoopFsRelationTest will be failed due to the lack of short type support in UnsafeRowParquetRecordReader. We should fix it.

      Attachments

        Activity

          People

            viirya L. C. Hsieh
            viirya L. C. Hsieh
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: