[SPARK-19942] DataFrameWriter - CSV options "ignoreLeadingWhiteSpace" and "ignoreTrailingWhiteSpace" Not working

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.0.1
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: nirav patel
• Created: 14/Mar/17 00:41
• Updated: 14/Mar/17 00:56
• Resolved: 14/Mar/17 00:56

Description

Hi, I found that by default CSV writer trims white spaces around field values. I tried to disable that by setting following options to true but its not working.
"ignoreLeadingWhiteSpace" and "ignoreTrailingWhiteSpace"
Since names of the options are not very clear I also tried setting them to false but it still trimming.
I also found following jira which might be related to this.
https://github.com/databricks/spark-csv/issues/304

Issue Links

• duplicates: SPARK-18579 spark-csv strips whitespace (pyspark)