[SPARK-29778] saveAsTable append mode is not passing writer options

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: Wesley Hoffman
• Reporter: Burak Yavuz
• Created: 06/Nov/19 19:58
• Updated: 13/Nov/19 22:13
• Resolved: 13/Nov/19 22:11

Description

There was an oversight where AppendData is not getting the WriterOptions in saveAsTable. https://github.com/apache/spark/blob/782992c7ed652400e33bc4b1da04c8155b7b3866/sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala#L530

Issue Links

• links to: GitHub Pull Request #26474