[DRILL-4660] TextReader should support multibyte field delimiters

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.6.0
• Fix Version/s: Future
• Component/s: Storage - Text & CSV
• Assignee: Unassigned
• Reporter: Arina Ielchiieva
• Created: 10/May/16 08:39
• Updated: 05/Jun/20 14:09

Description

Data file /tmp/foo.txt contents:

0::2::3
0::3::1
0::5::2
0::9::4
0::11::1
0::12::2
0::15::1

Query:

select
	columns
from
	table(dfs.`/tmp/foo.txt`(type => 'text', fieldDelimiter => '::'))

Results in a error message:

PARSE ERROR:
Expected single character but was String: ::
table /tmp/foo.txt
parameter fieldDelimiter SQL Query null

It would be nice that fieldDelimiter accepts text of any length.

Issue Links

• is duplicated by: DRILL-2556 support delimiters of multiple characters
• is related to: DRILL-4658 cannot specify tab as a fieldDelimiter in table function
• relates to: DRILL-3149 TextReader should support multibyte line delimiters