[IGNITE-7546] SQL COPY command: implement CSV header row parsing

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 2.4
• Component/s: sql
• Assignee: Unassigned
• Reporter: Kirill Shirokov
• Created: 26/Jan/18 09:55
• Updated: 14/Feb/19 14:50
• Resolved: 14/Feb/19 14:49

Description

Implement optional reading of CSV format header row and matching it to column numbers.

So, there are the following options:

• just skip the header row (or arbitrary number of rows)
• match the fields in the header row to the query entity columns and map them to the column list

A possible syntax for this option might look like this:

COPY
    ...
    [(MATCH | SKIP) HEADER]

When implementing this feature please keep in mind that we might have an option for skipping user-specified number of header lines / left columns and importing only user-specified number of lines and columns.

Issue Links

• is blocked by: IGNITE-6917 SQL: implement COPY command for efficient data loading
• is related to: IGNITE-7548 SQL COPY: handle CSV lines with less values than required correctly