[NIFI-8232] REGRESSION CSVReader no longer detects duplicate header values

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.13.0
• Fix Version/s: 1.14.0, 1.13.1
• Assignee: Chris Sampson
• Reporter: Chris Sampson
• Created: 17/Feb/21 19:22
• Updated: 23/Feb/21 14:35
• Resolved: 23/Feb/21 05:51

Description

The update of commons-csv from version 1.6 to 1.8 in NIFI-7187 has meant that duplicate CSV Fields are no longer detected when inferring the schema from a CSV file's header (either via infer or use header strings schema access strategy).

The ability to dis/enable this detection was added in commons-csv 1.8 and should be allowed to be toggled in NiFi (effectively this has been implicitly changed from false to true by the aforementioned upgrade).

Issue Links

• links to: GitHub Pull Request #4828