Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
2.0.2
-
None
Description
ignoreLeadingWhiteSpace and ignoreTrailingWhiteSpace are supported on CSV reader (and defaults to false).
However these are not supported options on the CSV writer and so the library defaults take place which strips the whitespace.
I think it would make the most sense if the writer semantics matched the reader (and did not alter the data) however this would be a change in behaviour. In any case it'd be great to have the option to strip or not.
Attachments
Issue Links
- is duplicated by
-
SPARK-19942 DataFrameWriter - CSV options "ignoreLeadingWhiteSpace" and "ignoreTrailingWhiteSpace" Not working
- Resolved
-
SPARK-21442 Spark CSV writer trims trailing spaces
- Resolved
- links to