[DRILL-7020] big varchar doesn't work with extractHeader=true

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.15.0
• Component/s: Storage - Text & CSV
• Assignee: Unassigned
• Reporter: benj
• Created: 30/Jan/19 19:39
• Updated: 11/Jun/19 16:32
• Resolved: 11/Jun/19 16:31

Description

with a TEST file of csv type like

col1,col2
w,x
...y...,z

where ...y... is > 65536 characters string (let say 66000 for example)

SELECT with extractHeader=false are OK

SELECT * FROM TABLE(tmp.`TEST`(type => 'text', fieldDelimiter => ',', extractHeader => false));
    col1  | col2
+---------+------
| w       | x
| ...y... | z

But SELECT with extractHeader=true gives an error

SELECT * FROM TABLE(tmp.`TEST`(type => 'text', fieldDelimiter => ',', extractHeader => true));
Error: UNSUPPORTED_OPERATION ERROR: Trying to write something big in a column
columnIndex 1
Limit 65536
Fragment 0:0

Note that is possible to use extractHeader=false with skipFirstLine=true but in this case it's not possible to automatically get columns names.

Issue Links

• duplicates: DRILL-7258 [Text V3 Reader] Unsupported operation error is thrown when select a column with a long string