Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.0.0
    • 2.0.0
    • SQL
    • None

    Description

      https://github.com/databricks/spark-csv/pull/254

      tobithiel reported this.

      I'm dealing with some messy csv files and being able to just quote all fields is very useful,
      so that other applications don't misunderstand the file because of some sketchy characters....

      When writing there are several quote modes in apache commons csv. (See https://commons.apache.org/proper/commons-csv/apidocs/org/apache/commons/csv/QuoteMode.html)

      This might have to be supported.

      However, it looks univocity parser used for writing (it looks currently only this library is supported) does not support this quote mode. I think we can drop this backwards compatibility if we are not going to add apache commons csv.

      This is a reminder that it might break backwards compatibility for the options, quoteMode.

      Attachments

        Issue Links

          Activity

            People

              jurriaanpruis Jurriaan Pruis
              hyukjin.kwon Hyukjin Kwon
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: