Uploaded image for project: 'Apache AsterixDB'
  1. Apache AsterixDB
  2. ASTERIXDB-2710

Incorrect CSV quote handling

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.4.1
    • 0.9.5
    • None
    • None

    Description

      the delimited text parser chokes on this quoted input for some reason. to reproduce use this ddl:

      create type foo as closed

      { messageid: string, userid: string, message: string, updated_time: string, nchar: string }

      ;

      create dataset foods(foo) primary key messageid;

      load dataset foods using localfs
      (("path"="127.0.0.1:///home/parshimers/status_synth.csv"),
      ("format"="delimited-text"),
      ("quote"="\""));

      where status_synth.csv contains:

      1,foo,", bar",baz,1
      2,foo,"bar",baz,2

      will error out with:

      At record: 1, field#: 4 - a quote enclosing a field needs to be placed in the beginning of that field. [IOException]

      Attachments

        Issue Links

          Activity

            People

              alsuliman Ali Alsuliman
              imaxon Ian Maxon
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: