Description
There is anĀ option in the CSV parser to set values when we have empty values in the CSV files or in our dataframes.
Currently, this option cannot be configured and always sets a default value (empty string for reading and `""` for writing).
I think it'd be interesting to enable this option in the CSV reader/writer to allow customizing these empty values.
Attachments
Issue Links
- is duplicated by
-
SPARK-25739 Double quote coming in as empty value even when emptyValue set as null
- Resolved
- links to