[CAMEL-16553] camel-flatpack - Issues when parsing CSV files that extensively use text qualifiers

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Information Provided
• Affects Version/s: 3.4.0
• Component/s: camel-flatpack
• Estimated Complexity: Unknown
• Assignee: Unassigned
• Reporter: MykhailoVlakh
• Created: 26/Apr/21 10:29
• Updated: 24/Jun/21 13:15
• Resolved: 24/Jun/21 13:15

Description

It looks like Flatpack library has defects that do not allow to parse CSV files that use text qualifiers a lot. The issues are:

• it cannot process files that contain multiline strings like:

  Bob,Smith,[e-mail],"This is a long fragment of text
  that should be processed as a single field", 1988, 111-222-33,"another field with new line character
   that should be considered as a field of the same data row" 

• also if string starts with text qualifier characters it also cannot handle it properly, like:

  Bob, Smith, """Test"" , 2, Some string, still string, also part of the string.",11111111
  

I have reported a defect https://github.com/Appendium/flatpack/issues/60 for Flatpack. But I am not sure if there are chances that these issues will be fixed any time soon since they released the latest available version in 2019.