[SPARK-36271] Hive SerDe and V1 Insert data to parquet/orc/avro need to check schema too

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: SQL
• Assignee: angerszhu
• Reporter: angerszhu
• Created: 23/Jul/21 06:30
• Updated: 09/Aug/21 09:18
• Resolved: 09/Aug/21 09:18

Description

withTempPath { path =>
        spark.sql(
          s"""
             |SELECT
             |NAMED_STRUCT('ID', ID, 'IF(ID=1,ID,0)', IF(ID=1,ID,0), 'B', ABS(ID)) AS col1
             |FROM v
               """.stripMargin).write.mode(SaveMode.Overwrite).parquet(path.getCanonicalPath)
      }

Issue Links

• links to: [Github] Pull Request #33566 (AngersZhuuuu)