[DRILL-6984] from table escape parameter not deleted when defined with value other than '"'

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.15.0
• Fix Version/s: 1.17.0
• Component/s: Functions - Drill
• Assignee: Unassigned
• Reporter: benj
• Created: 17/Jan/19 10:38
• Updated: 11/Oct/19 12:06
• Resolved: 11/Oct/19 12:06

Description

When change the escape char, it's kept in the output instead of be deleted like with '"'

Example :

the file sample.csv :

name|age|subject|info
Bob|21|"lovely quotes"|none
Bill|23|"character @"|@" pipe"|none

SELECT * FROM table(tmp`sample.csv`(`escape`=>'@', type => 'text', fieldDelimiter => '|',quote=>'"', extractHeader => true));

The result is

|  name   | age  |       subject         | info  |
+---------+------+-----------------------+-------+
| Bob     | 21   | lovely quotes         | none  |
| Bill    | 23   | character @"|@" pipe  | none  |

As we expect : < character "|" pipe > (without the escape char (@)  

 

Note that we have the good behavior when using quote ('"') as escaping character

name|age|subject|info
Bob|21|"lovely quotes"|none
Bill|23|"character ""|"" pipe"|none

SELECT * FROM table(tmp`sample.csv`(`escape`=>'"', type => 'text', fieldDelimiter => '|',quote=>'"', extractHeader => true));

OR

SELECT * FROM table(tmp`sample.csv`(type => 'text', fieldDelimiter => '|',quote=>'"', extractHeader => true));

The result is OK with

|  name   | age  |       subject         | info  |
+---------+------+-----------------------+-------+
| Bob     | 21   | lovely quotes         | none  |
| Bill    | 23   | character "|" pipe  | none  |

 

Issue Links

• Is contained by: DRILL-6986 Table function improvements / issues (UMBRELLA JIRA)