[SPARK-32768] Add Parquet Timestamp output configuration to docs

• Type: Documentation
• Status: Resolved
• Priority: Minor
• Resolution: Not A Problem
• Affects Version/s: 2.3.0, 2.3.1, 2.3.2, 2.3.3, 2.3.4, 2.4.0, 2.4.1, 2.4.2, 2.4.3, 2.4.4, 2.4.5, 2.4.6, 3.0.0
• Component/s: Documentation
• Labels: docs-missing parquet
• Assignee: Unassigned
• Reporter: Ron DeFreitas
• Created: 01/Sep/20 16:52
• Updated: 15/Nov/21 18:26
• Resolved: 02/Sep/20 09:29

Description

Spark 2.3.0 added the spark.sql.parquet.outputTimestampType configuration option for controlling the underlying datatype used when writing Timestamp column types into parquet files. This option is helpful for compatibility with external systems that need to read the output from Spark.

This was never exposed in the documentation. Fix should be applied to docs for both the next 3.x release and 2.4.x release.

Issue Links

• links to: [Github] Pull Request #29613 (rdefreitas)