[DRILL-5498] CSV text reader does not handle duplicate header names

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.8.0
• Fix Version/s: 1.11.0
• Component/s: Storage - Text & CSV
• Labels: ready-to-commit
• Assignee: Paul Rogers
• Reporter: Paul Rogers
• Reviewer: Sorabh Hamirwasia
• Created: 10/May/17 03:42
• Updated: 06/Jul/17 07:09
• Resolved: 22/May/17 17:50

Description

Consider the following CSV file:

h,h,h
a,b,c
d,e,f

Parse this with the CSV storage plugins to parse headers. The result:

2 row(s):
h
c
f

Expected a runtime error for the duplicate column names, or automatic "uniqification" of the names. Certainly did not expect the first two columns to be dropped.

Issue Links

• links to: GitHub Pull Request #830

Sub-Tasks

• CSV reader does not validate header names, causes nonsense output: Resolved
• NPE when reading a CSV file, with headers, but blank header line: Resolved