[SPARK-15493] Allow setting the quoteEscapingEnabled flag when writing CSV

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Component/s: SQL
• Assignee: Jurriaan Pruis
• Reporter: Jurriaan Pruis
• Created: 23/May/16 22:11
• Updated: 29/Dec/16 19:31
• Resolved: 25/May/16 19:40

Description

See https://github.com/uniVocity/univocity-parsers/blob/f3eb2af26374940e60d91d1703bde54619f50c51/src/main/java/com/univocity/parsers/csv/CsvWriterSettings.java#L231-L247

This kind of functionality is needed to be able to write RFC 4180 (https://tools.ietf.org/html/rfc4180#section-2) / Amazon Redshift compatible CSV files (https://docs.aws.amazon.com/redshift/latest/dg/copy-parameters-data-format.html#copy-csv)

Issue Links

• is related to: SPARK-13638 Support for saving with a quote mode
• links to: [Github] Pull Request #13267 (jurriaan)