[DRILL-3393] Quotes not being recognized in tab delimited (tsv) files

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.2.0
• Component/s: Storage - Text & CSV
• Assignee: Chun Chang
• Reporter: Chi Lang
• Created: 26/Jun/15 15:29
• Updated: 17/Sep/15 00:59
• Resolved: 15/Sep/15 22:45

Description

Drill doesn't seem to recognise quotes in tsv, while working fine for csv files.

For example, given the following files

test.tsv
-------
foobar bar
"aa" "bc"
-------

test.csv
----------
foobar,bar
"aa","bc"
----------

I get these results:

0: jdbc:drill:zk=local> select columns[0], columns[1] from dfs.`test.csv`;
----------------+

EXPR$0

EXPR$1

----------------+

foobar	bar
aa	bc

----------------+
2 rows selected (0.259 seconds)
0: jdbc:drill:zk=local> select columns[0], columns[1] from dfs.`test.tsv`;
-----------------+

EXPR$0

EXPR$1

-----------------+

foobar	bar
aa" "bc	null

-----------------+
2 rows selected (0.122 seconds)